Abstract
Pervasive Social Computing is a novel collective paradigm, derived from pervasive computing, social media, social networking, social signal processing, etc. This paper reviews Pervasive Social Computing as an integrated computing environment, which promises to augment five facets of human intelligence: physical environment awareness, behavior awareness, community awareness, interaction awareness, and content awareness. Reviews of related studies are given, and their generic architectures are designed. The resulting architecture for Pervasive Social Computing is presented. A prototype is developed and examined, in order to investigate the characteristics exhibited by Pervasive Social Computing.
Similar content being viewed by others
References
Aarabi P, Hughes D, Mohajer K, Emami M (2001) The automatic measurement of facial beauty. In: Proceedings of IEEE international conference on systems, man, and cybernetics, pp 2644–2647
Agre PE, Douglas S (eds) (1996) Reinventing technology, rediscovering community-critical explorations of computing as a social practice. Ablex Publishing Corporation, Greenwich
Alexa (2011) Alexa, http://www.alexa.com/. Accessed 15 June 2011
Atukorala K, Wijekoon D, Tharugasini M, Perera I, Silva C (2009) SmartEye integrated solution to home automation, security and monitoring through mobile phones. In: Proceedings of the 2009 third international conference on next generation mobile applications, services and technologies, pp 64–69
Baldauf M, Fröhlich P (2009) Supporting hand gesture manipulation of projected content with mobile phones. In: Proceedings of the workshop on mobile interaction with the real world (MIRW)
Beadle HWP, Maguire JrGQ, Smith MT (1997) Using location and environment awareness in mobile communications. In: Proceedings of 1997 international conference on information, communications and signal processing, vol 3, pp 1781–1785
Ben Mokhtar S, Capra L (2009) From pervasive to social computing: algorithms and deployments. In: Proceedings of the 2009 international conference on pervasive services, ICPS ‘09, pp 169–178
Bertot JC, Jaeger PT, Munson S, Glaisyer T (2010) Social media technology and government transparency. Computer 43:53–59
Broll G, Siorpaes S, Rukzio E, Paolucci M, Hamard J, Wagner M, Schmidt A (2007) Supporting mobile service usage through physical mobile interaction. Proc Percom 2007:262–271
Bush V (1945) As we may think. Atlantic Monthly 7:1–19
Charron C, Favier J, Li C (2006) Social computing: how networks erode institutional power, and what to do about it, forrester customer report. February 13
Chetan S (2005) Mobile Gaia: a middleware for ad-hoc pervasive computing. In: Consumer communications and networking conference, pp 223–228
Chibelushi CC, Deravi F, Mason JSD (2002) A review of speech-based bimodal recognition. IEEE Trans Multimedia 4:23–37
Cho J, Tomkins A (2007) Guest editors’ introduction: social media and search. Internet Comput IEEE 11:13–15
Darrell T, Gordon G, Harville M, Woodfill J (2000) Integrated person tracking using stereo, color, and pattern detection. Int J Comput Vis 37(2):175–185
David K (2011) Wired and shrewd, young Egyptians guide revolt, http://www.nytimes.com/2011/02/10/world/middleeast/10youth.html?_r=2. Accessed 15 June 2011
Dey AK (2000) Providing architectural support for building context-aware applications. Dissertation, Georgia Institute of Technology
Dietz P, Leigh D (2001) Diamond touch: a multiuser touch technology. In: Proceedings of UIST’01, ACM, NY, pp 219–226
Dryer DC, Eisbach C, Ark WS (1999) At what cost pervasive? a social computing view of mobile computing systems. IBM Syst J 38:652–676
Eagle N, Pentland A (2006) Reality mining: sensing complex social signals. J Pers Ubiquitous Comput 10(4):255–268
Ekman P, Friesen W (2002) Facial action coding system (FACS): manual
FingerWorks (2011) FingerWorks. http://www.fingerworks.com. Accessed by 15 June 2011
Fragopanagos N, Taylor J (2005) Emotion recognition in human–computer interaction. Neural Netw 18(4):389–405
Gilbert E, Karahalios K (2009) Predicting tie strength with social media. In: CHI ‘09: Proceedings of the 27th international conference on human factors in computing systems, pp 211–220
Greenberg S (2001) Context as a dynamic construct. J Human-Comput Interact 16(2):257–268
Hardy R, Rukzio E, Holleis P, Wagner M (2010) Mobile interaction with static and dynamic NFC-based displays. In: Proceeding of MobileHCI’10
Hosio S, Jurmu M, Kukka H, Riekki J, Ojala T (2010) Supporting distributed private and public user interfaces in urban environments. In: Proceedings of the eleventh workshop on mobile computing systems and applications, pp 25–30
Howard R (1993) The virtual community: homesteading on the electronic frontier. Addison Wesley, Reading
Howard Philip N (2011) The Arab Spring’s cascading effects, http://www.miller-mccune.com/politics/the-cascading-effects-of-the-arab-spring-28575/. Accessed 15 June 2011
Ito A, Wang X, Suzuki M, Makino S (2005) Smile and laughter recognition using speech processing and face recognition from conversation video. In: Proceedings of international conference on cyberworlds, pp 437–444
Jacobs S, Egert CA, Barnes SB (2009) Social media theory and practice: lessons learned for a pioneering course. In: Frontiers in education conference, pp 1–5
Jaimes A, Omura K, Nagamine T, Hirata K (2004) Memory cues for meeting video retrieval. In: Proceedings of workshop on continuous archival and retrieval of personal experiences, pp 74–85
Jones CM, Jonsson I (2005) Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses. In: Proceedings of the 17th Australia conference on computer-human interaction, pp 1–10
Kellogg WA (2005) Research and emerging trends in social computing. In: Proceedings of the 2005 international symposium on collaborative technologies and systems, pp 4–4
Kennedy L, Ellis D (2004) Laughter detection in meetings. In: Proceedings of the NIST meeting recognition workshop, pp 118–121
Kolvenbach S, Grather W, Klockner K (2004) Making community work aware. In: Proceedings of 12th Euromicro conference on parallel, distributed and network-based processing, pp 358–363
Kurvinen E, Oulasvirta A (2004) Towards socially aware pervasive computing: a turntaking approach. In: Proceedings of the second ieee international conference on pervasive computing and communications (PerCom’04), p 346
Lee JD, Caven B, Haake S (2001) Speech-based Interaction with In-vehicle Computers: the effect of speech-based E-mail on drivers’ attention to the roadway. Hum Factors 43:631–640
Lee FSL, Vogel D, Limayem M (2003) Virtual community informatics: a review and research agenda. J Inform Technol Theory Appl 5:47–61
Licklider JCR, Taylor Robert W (1968) The computer as a communication device. Sci Technol 76:21–31
Mana N, Pianesi F (2006) HMM-based synthesis of emotional facial expressions during speech in synthetic talking heads. In:Proceedings of the 8th international conference on Multimodal interfaces, pp 380–387
Mass Multimedia (2011) Mass multimedia, Inc. http://www.touchscreens.com. Accessed by 15 June 2011
McDonald (2011). McDonald’s pilots RFID self-ordering system in Korea, http://www.rfidupdate.com/articles/index.php?id=1444. Accessed by 15 June 2011
Mistry P, Maes P, Chang L (2009) WUW—wear Ur world: a wearable gestural interface. In: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pp 4111–4116
Murugesan S (2007) Understanding Web 2.0. IT Professional 9:34–41
Nate Anderson AT (2011) Tweeting tyrants out of tunisia: global internet at its best, http://www.wired.com/threatlevel/2011/01/tunisia/. Accessed 15 June 2011
Neumann G, Erol S (2009) From a social wiki to a social workflow system. In: Proceedings of business process management workshops, pp 698–708
NTTDoCoMo (2011) i-mode Felica, http://www.nttdocomo.co.jp/english/service/imode/make/content/felica/index.html. Accessed by 15 June 2011
O’Toole AJ, Price T, Vetter T, Bartlett J, Blanz V (1999) 3D shape and 2D surface textures of human faces: the role of “average” in attractiveness and age. Image Vis Comput 18(1):9–19
Oikonomopoulos A, Pantic M, Patras I (2008) B-spline polynomial descriptors for human activity recognition. In: Proceedings of IEEE conference on computer vision and pattern recognition
Ozer L, Wolf W (2002) Real-time posture and activity recognition. In: Proceedings of workshop on motion and video computing, pp 133–138
Pantic M, Rothkrantz L (2003) Toward an affect-sensitive multimodal human-computer interaction. Proc IEEE 91(9):1370–1390
Pantic M, Pentland A, Nijholt A, Huang T (2008) Human-centred intelligent human-computer interaction (HCI2): how far are we from attaining it? Int J Auton Adapt Commun Syst 1(2):168–187
Parameswaran M (2007) Social computing: an overview. Commun Assoc Inform Syst 19:762–780
Pentland A (2007) Automatic mapping and modeling of human networks. Physics A 378:59–67
Pope R (2007) Vision-based human motion analysis: an overview. Comput Vis Image Underst 108(1–2):4–18
Rabiner LR, Juang B (1993) Fundamentals of speech recognition. Prentice-Hall, Inc., Englewood Cliffs (Chapter 4)
Reilly D, Rodgers M, Argue R, Nunes M, Inkpen K (2006) Marked-up maps: combining paper maps and electronic information resources. Pers Ubiquitous Comput 10(4):215–226
Román M, Hess C, Cerqueira R, Ranganathan A, Campbell RH, Nahrstedt K (2002) Gaia: a middleware platform for active spaces. SIGMOBILE Mob Comput Commun Rev 6:65–67
Savidis A, Zidianakis M, Kazepis N, Dubulakis S, Gramenos D, Stephanidis C (2008) An integrated platform for the management of mobile location-aware information systems. In: Pervasive ‘08: proceedings of the 6th international conference on pervasive computing, pp 128–145
Schmidt A (2002) Ubiquitous computing –computing in context. Dissertation, Lancaster University
Schuler D (1994) Social computing. Comm ACM 37(1):28–29
Scott J (2010) Overview of social computing in sharepoint 2010, http://jornata.com/Presentations/Jamison-Overview%20of%20Social%20Computing%20in%20SharePoint%202010.Pptx, Accessed 15 June 2011
SMART Board (2011) Smart technologies SMART board. http://www.smarttech.com/SmartBoard. Accessed by 15 June 2011
Smith M, Barash V, Getoor L, Lauw HW (2008) Leveraging social context for searching social media. In: Proceeding of the 2008 ACM workshop on Search in social media, pp 91–94
Social_computing (2011) http://en.wikipedia.org/wiki/Social_computing
Speech_recognition (2011) Speech_recognition, http://en.wikipedia.org/wiki/Speech_recognition#cite_note-2. Accessed by 15 June 2011
Sumi Y, Mase K (2000) Supporting awareness of shared interests and experiences in community. SIGGROUP Bull 21:35–42
Tabatabaei SG, Kadir WM, Ibrahim S (2008) A comparative evaluation of state-of-the-art approaches for web service composition, pp 488–493
TabletPC (2011) Microsoft Corporation. http://www.microsoft.com/windowsxp/tabletpc/. Accessed by 15 June 2011
Toivanen J, Vayrynen E, Seppanen T (2004) Automatic recognition of emotion from spoken Finnish: a preliminary study. Lang Speech 47:383–412
Tong Y, Liao W, Ji Q (2007) Facial action unit recognition by exploiting their dynamic and semantic relationships. IEEE Trans Pattern Anal Mach Intell 29(10):1683–1699
Touchpad (2011) Synaptics Inc. http://www.synaptics.com/products/touchpad.cfm. Accessed by 15 June 2011
Tran MH, Han J, Colman A (2009) Social context: supporting interaction awareness in ubiquitous environments. In: 6th Annual international mobile and ubiquitous systems: networking & services, pp 1–10
Truong K, van Leeuwen D (2007) Automatic discrimination between laughter and speech. Speech Commun 49(2):144–158
Valstar M, Gunes H, Pantic M (2007) How to distinguish posed from spontaneous smiles using geometric features. In: Proceedings of the international conference on multimodal interfaces, pp 38–45
Vinciarelli A, Pantic M, Bourlard H, Pentland A (2008) Social signal processing: state-of-the-art and future perspectives of an emerging domain. In: Proceeding of the 16th ACM international conference on Multimedia, MM ‘08, pp 1061–1070
Wang SJ, Middleton B, Prosser LA, Bardon CG, Spurr CD, Carchidi PJ, Kittler AF, Goldszer RC, Fairchild DG, Sussman AJ, Kuperman GJ, Bates DW (2003) A cost-benefit analysis of electronic medical records in primary care. Am J Med 114:397
Wang F, Carley KM, Zeng D, Mao W (2007) Social computing: from social informatics to social intelligence. Intell Syst IEEE 22:79–83
Want R, Fishkin K, Gujar A, Harrison B (1999) Bridging physical and virtual worlds with electronic tags. In: Proceedings of CHI 1999, pp 370–377
Weiser M (1991) The computer for the 21st century. Sci Am 265:94–104
Zeng Z, Pantic M, Roisman G, Huang T (2008) A survey of affect recognition methods: Audio, visual and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31(1):39–58
Zeng D, Hsinchun Chen, Lusch R, Shu-Hsing Li (2010) Social media analytics and intelligence. Intell Syst IEEE 25:13–16
Zhao QA, Stasko JT (2002) What’s happening?: promoting community awareness through opportunistic, peripheral interfaces. In: Proceedings of the working conference on advanced visual interfaces, pp 69–74
Zhou J, Gilman E, Palola J, Riekki J, Ylianttila M, Sun J (2011) Context-aware pervasive service composition and its implementation. Pers Ubiquit Comput 15(3):291–303
Acknowledgments
This work was carried out in the Pervasive Service Computing project, funded in the Ubiquitous Computing and Diversity of Communication (MOTIVE) program by the Academy of Finland. The first author would like to thank Prof. Hans Arno Jacobsen from Electrical and Computer Engineering Department, University of Toronto for hosting him for carrying on this study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, J., Sun, J., Athukorala, K. et al. Pervasive Social Computing: augmenting five facets of human intelligence. J Ambient Intell Human Comput 3, 153–166 (2012). https://doi.org/10.1007/s12652-011-0081-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-011-0081-z