Skip to main content
SpringerLink
Log in

Activity Recognition: Approaches, Practices and Trends

  • Chapter
  • First Online:
Activity Recognition in Pervasive Intelligent Environments

Part of the book series: Atlantis Ambient and Pervasive Intelligence ((ATLANTISAPI,volume 4))

Abstract

Activity recognition has attracted increasing attention as a number of related research areas such as pervasive computing, intelligent environments and robotics converge on this critical issue. It is also driven by growing real-world application needs in such areas as ambient assisted living and security surveillance. This chapter aims to provide an overview on existing approaches, current practices and future trends on activity recognition. It is intended to provide the necessary material to inform relevant research communities of the latest developments in this field in addition to providing a reference for researchers and system developers who are working towards the design and development of activity-based context aware applications. The chapter first reviews the existing approaches and algorithms that have been used for activity recognition in a number of related areas. It then describes the practice and lifecycle of the ontology-based approach to activity recognition that has recently been under vigorous investigation. Finally the chapter presents emerging research on activity recognition by outlining various issues and directions the field will take.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Weiser M., (1991), The computer for the twenty-first century, Scientific American, Vol. 265, No. 3, pp. 94-104.

    Google Scholar 

  • Nugent C.D., (2008), Experiences in the Development of a Smart Lab, The International Journal of Biomedical Engineering and Technology, Vol. 2, No. 4, pp. 319-331

    Google Scholar 

  • Ivano Y. and Bobick A., (2000), Recognition of Visual Activities and Interactions by Stochastic Parsing, IEEE Trans Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 852-872.

    Google Scholar 

  • Stauffer C. and Grimson W.E., (2000), Learning Patterns of Activity Using Real-Time Tracking IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 747-757.

    Google Scholar 

  • Bodor R., Jackson B., and Papanikolopoulos N., (2003), Vision based human tracking and activity recognition, In Proceedings of the 11th Mediterranean Conference on Control and Automation.

    Google Scholar 

  • Fiore L., Fehr D., Bodor R., Drenner A., Somasundaram G., and Papanikolopoulos N., (2008), Multi-Camera Human Activity Monitoring, Journal of Intelligent and Robotic Systems, Vol. 52, No. 1, pp. 5-43.

    Google Scholar 

  • Bao L. and Intille S., (2004), Activity recognition from userannotated acceleration data, In Proc. Pervasive, LNCS3001, pp. 1-17.

    Google Scholar 

  • Huynh D.T.G., (2008), Human Activity Recognition with Wearable Sensors, PhD thesis, TU Darmstadt.

    Google Scholar 

  • Patterson DJ., Fox D., Kautz H., and Philipose M., (2005), Fine-grained activity recognition by aggregating abstract object usage, In Proc. of IEEE International Symposium on Wearable Computers, pp. 44-51.

    Google Scholar 

  • Lee SW. and Mase K., (2002), Activity and location recognition using wearable sensors, IEEE Pervasive Computing, Vol. 1, No. 3, pp. 24-32.

    Google Scholar 

  • Parkka J., Ermes M., Korpipaa P., Mantyjarvi J., Peltola J., and Korhonen I., (2006), Activity classification using realistic data from wearable sensors, IEEE Transactions on Information Technology in Biomedicine, Vol. 10, No. 1, pp. 119-128.

    Google Scholar 

  • Philipose M., Fishkin K.P., Perkowitz M., Patterson D.J., Hahnel D., Fox D., and Kautz H., (2004), Inferring Activities from Interactions with Objects, IEEE Pervasive Computing: Mobile and Ubiquitous Systems, Vol. 3, No. 4, pp. 50-57.

    Google Scholar 

  • Chan M., Estéve D., Escriba C., and Campo E., (2008), A review of smart homes-Present state and future challenges, Computer Methods and Programs in Biomedicine, Vol. 91, No. 1, pp. 55-81.

    Google Scholar 

  • Helal S., Mann W., El-Zabadani H., King J., Kaddoura Y., and Jansen E., (2005), The gator tech smart house: a programmable pervasive space, IEEE Computer, Vol. 38, No. 3, pp. 64-74.

    Google Scholar 

  • Ward J.A., Lukowicz, Troter P., and Starner T.G., (2006), Activity recognition of assembly tasks using body-worn microphones and accelerometers, IEEE Trans.Pattern Analysis and Machine Intelligence, Vol. 28, No. 10, pp. 1553-1567.

    Google Scholar 

  • Boger J., Poupart P., Hoey J., Boutilier C., and Mihailidis A., (2005), A Decision-Theoretic Approach to Task Assistance for Persons with Dementia, In Proc. of the International Joint Conference on Artificial Intelligence (IJCAI’05), pp. 1293-1299.

    Google Scholar 

  • Wang S., Pentney W., Popescu A.M., Choudhury T., and Philipose M., (2007), Common Sense Based Joint Training of Human Activity Recognizers, In Proc. International Joint Conference on Artificial Intelligence.

    Google Scholar 

  • Albrecht D.W. and Zukerman I., (1998), Bayesian Models for Keyhole Plan Recognition in an Adventure Game, User Modelling and User-Adapted Interaction, Vol. 8, pp. 5-47.

    Google Scholar 

  • Tapia E.M. and Intille, S., (2007), Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor, In International Symposium on Wearable Computers (ISWC).

    Google Scholar 

  • Huynh T. and Schiele B., (2006), Unsupervised Discovery of Structure in Activity Data using Multiple Eigenspaces, In 2nd International Workshop on Location- and Context-Awareness (LoCA), LNCS Vol. 3987.

    Google Scholar 

  • Liao L., Fox D., and Kautz H., Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields. The International Journalof Robotics Research, 26(1):119, 2007.

    Google Scholar 

  • Kautz H., (1991), A Formal Theory of Plan Recognition and its Implementation, Reasoning About Plans, Allen J., Pelavin R. and Tenenberg J. eds., Morgan Kaufmann, San Mateo, C.A., pp. 69-125.

    Google Scholar 

  • Wobke W., (2002), Two Logical Theories of Plan Recognition, Journal of Logic Computation, Vol. 12, No. 3, pp. 371-412.

    Google Scholar 

  • Bouchard B. and Giroux S., (2006), A Smart Home Agent for Plan Recognition of Cognitivelyimpaired Patients, Journal of Computers, Vol. 1, No. 5, pp. 53-62.

    Google Scholar 

  • Chen L., Nugent C., Mulvenna M., Finlay D., Hong X., Poland, M., (2008), A Logical Framework for Behaviour Reasoning and Assistance in a Smart Home, International Journal of Assistive Robotics and Mechatronics, Vol. 9, No. 4, pp. 20-34.

    Google Scholar 

  • Chen D., Yang J., and Wactlar, H.D., (2004), Towards automatic analysis of social interaction patterns in a nursing home environment from video, in Proc. 6th ACM SIGMM Int. Workshop Multimedia Inf. Retrieval, pp. 283-290.

    Google Scholar 

  • Hakeem A. and Shah, M., (2004), Ontology and Taxonomy Collaborated Framework for Meeting Classification, In Proc. Int. Conf. Pattern Recognition, pp. 219-222.

    Google Scholar 

  • Georis B., Maziere M., Bremond F., and Thonnat M., (2004), A video interpretation platform applied to bank agency monitoring, in Proc. 2nd Workshop Intell. Distributed Surveillance System, pp. 46-50.

    Google Scholar 

  • Hobbs J., Nevatia R., and Bolles B., (2004), An Ontology for Video Event Representation, In IEEE Workshop on Event Detection and Recognition.

    Google Scholar 

  • Francois A.R.J., Nevatia R., Hobbs J., and Bolles R.C., (2005), VERL: An Ontology Framework for Representing and Annotating Video Events, IEEE MultiMedia, Vol. 12, No. 4, pp. 76-86.

    Google Scholar 

  • Akdemir U., Turaga P., Chellappa, R., (2008), An ontology based approach for activity recognition from video, Proceeding of the 16th ACM international conference on Multimedia, pp. 709-712.

    Google Scholar 

  • Yamada N., Sakamoto K., Kunito G., Isoda Y., Yamazaki K., and Tanaka S., (2007), Applying Ontology and Probabilistic Model to Human Activity Recognition from Surrounding Things, IPSJ Digital Courier, Vol. 3, pp. 506-517.

    Google Scholar 

  • Latfi F., Lefebvre B., and Descheneaux C., (2007), Ontology-Based Management of the Telehealth Smart Home, Dedicated to Elderly in Loss of Cognitive Autonomy, CEUR Workshop Proceedings, Vol. 258, (online) available: http://ftp.informatik.rwthaachen. de/Publications/CEUR-WS/Vol-258/paper42.pdf.

  • Michael K., Schmidt A., and Lauer R., (2007), Ontology-Centred Design of an Ambient Middleware for Assisted Living: The Case of SOPRANO, In Proc. of the 30th Annual German Conference on Artificial Intelligence.

    Google Scholar 

  • Chen L., Nugent C.D., Mulvenna M., Finlay D., and Hong X., (2009), Semantic Smart Homes: Towards Knowledge Rich Assisted Living Environments, Studies in Computational Intelligence, Vol. 189, pp. 279-296.

    Google Scholar 

  • James A.B., (2008), Activities of daily living and instrumental activities of daily living, In: Crepeau EB, Cohn ES, Schell BB, editors. Willard and Spackman’s Occupational Therapy. Philadelphia: Lippincott, Williams and Wilkins, pp. 538-578.

    Google Scholar 

  • WHO, World Health Organization, International classification of functioning, disability and health (ICF), http://www.who.int/classifications/icf/en/

  • Wyatt D., Philipose, M., and Choudhury T., (2005), Unsupervised activity recognition using automatically mined common sense, in: Proc. of AAAI 2005.

    Google Scholar 

  • Tapia M.E., Choudhury T., and Philipose M., (2006), Building Reliable Activity Models using Hierarchical Shrinkage and Mined Ontology, Proceedings of the 4th International Conference on Pervasive Computing, pp. 17-32.

    Google Scholar 

  • OWL and RDF specifications, http://www.w3.org/

  • Horrocks I., Sattler U., and Tobies S., (1999), Practical reasoning for expressive description logics, Lecture Notes in Artificial Intelligence, No. 1705, pp. 161-180.

    Google Scholar 

  • Wu T.Y., Lian C.C., and Hsu J.Y., Joint recognition of multiple concurrent activities using factorial conditional random fields, in: Proc. AAAIWorkshop Plan, Activity, and Intent Recognition, California, 2007.

    Google Scholar 

  • Hu D.H. and Yang Q., Cigar: concurrent and interleaving goal and activity recognition, in: Proc. AAAI, Chicago, Illinois, USA, 2008.

    Google Scholar 

  • Modayil J., Bai T., Kautz H., Improving the recognition of interleaved activities, Proceedings of the 10th international conference on Ubiquitous computing, UbiComp; Vol. 344, pp. 40-43, 2008.

    Google Scholar 

  • Gu T.,Wu Z., Tao X.P., Pung H.K., and Lu J., epSICAR: An Emerging Patterns based Approach to Sequential, Interleaved and Concurrent Activity Recognition. In Proc. of the 7th Annual IEEE International Conference on Pervasive Computing and Communications (Percom ‘09), pp. 1-9, 2009.

    Google Scholar 

  • Gong S. and Xiang T., Recognition of group activities using dynamic probabilistic networks, in: Proc.of ICCV 2003, Nice, France, 2003, pp. 742–749.

    Google Scholar 

  • Nguyen N., Bui H., and Venkatesh S., Recognising behaviour of multpile people with hierarchical probabilistic and statistical data association, in: Proc of the 17th British Machine Vision Conference (BMVC 2006), Edinburgh, Scotland, 2006.

    Google Scholar 

  • Oliver N., Rosario B., and Pentland A., A bayesian computer vision system for modeling human interactions, in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, 2000, pp. 831–843.

    Google Scholar 

  • Choudhury T. and Basu S., Modeling conversational dynamics as a mixedmemory markov process, in: Advances in Neural Information Processing Systems 17, MIT Press, Cambridge, MA, 2005, pp. 281–288.

    Google Scholar 

  • Oliver N., Gargb A., and Horvitz E., Layered representations for learning and inferring office activity from multiple sensory channels, in: Computer Vision and Image Understanding, November 2004, pp. 163–180.

    Google Scholar 

  • Du Y., Chen F., Xu W., and Li Y., Recognizing interaction activities using dynamic bayesian network, in: Proc. of ICPR 2006, Hong Kong, China, 2006.

    Google Scholar 

  • Wyatt D., Choudhury T., Bilmes J., and Kautz H., A privacy sensitive approach to modeling multi-person conversations, in: Proc. IJCAI, India, 2007.

    Google Scholar 

  • Lian, C. and Hsu, J., Chatting activity recognition in social occasions using factorial conditional random fields with iterative classification, in: Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (2008), Chicago, Illinois, 2008.

    Google Scholar 

  • Lin Z. and Fu L., Multi-user preference model and service provision in a smart home environment, in: Proc. of IEEE International Conference on Automation Science and Engineering (CASE 2007), 2007.

    Google Scholar 

  • Wang L., Gu T., Tao X., and Lu J., Sensor-Based Human Activity Recognition in a Multi-user Scenario, AmI 2009, LNCS 5859, pp. 78–87, 2009.

    Google Scholar 

  • Singla G., Cook D., and Schmitter-Edgecombe M., Recognizing independent and joint activities among multiple residents in smart environments. Ambient Intelligence and Humanized Computing Journal, 1(1):57–63, 2010.

    Google Scholar 

  • Nugent C.D., Finlay D.D., Davies R., Wang H.Y., Zheng H., Hallberg J., Synnes K., and Mulvenna M.D., homeML - An open standard for the exchange of data within smart environments, Proceedings of 5th International Conference on Smart homes and health Telematics, Lecture Notes in Computer Science (Vol. 4541), pp. 121–129, 2007.

    Google Scholar 

  • Chen L. and Nugent C.D., (2009), Semantic Data Management for Situation-aware Assistance in Ambient Assisted Living, the proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services (iiWAS2009), ACM ISBN 978-1- 60558-660-1, pp. 296–303.

    Google Scholar 

  • Biswas, J., Tolstikov, A., Phyo Wai, A., Baumgarten, M., Nugent, C., Chen, L., Donnelly, M., Replicating Sensor Environments for Ambient Assisted Living: A Step Towards Scaled Deployment, accepted for International Conference on Smart homes and health Telematics (ICOST2010), 2010.

    Google Scholar 

  • Chen L., Nugent C.D., (2009), Ontology-based activity recognition in intelligent pervasive environments, International Journal of Web Information Systems, Vol. 5, No. 4, pp. 410–430.

    Google Scholar 

  • Patel S., Lorincz K., Hughes R., Huggins N., Bonato, Monitoring Motor Fluctuations in Patients With Parkinson’s Disease Using Wearable Sensors, IEEE Transaction on Information Technologies in Biomedicine, Vol. 13, No. 6, Nov. 2009.

    Google Scholar 

  • Patel S.N., Reynolds M.S., and Abowd G.D., Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing. Proc. of the 6th International Conference on Pervasive Computing (Pervasive 2008), pp. 1–18, Sydney, Australia, 2008.

    Google Scholar 

  • Fogarty J., Au C., and Hudson S.E., Sensing from the Basement: A Feasibility Study of Unobtrusive and Low-Cost Home Activity Recognition, UIST’06, 91–100.

    Google Scholar 

  • Yin J., Yang Q., and Pan J., Sensor-based abnormal human-activity detection. IEEE Trans. Knowl. Data Eng., 20(8):1082–1090, 2008.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computing and Mathematics, University of Ulster, Northern Ireland, BT37 0QB, UK

    Liming Chen

  2. Institute of Telecooperation, Johannes Kepler University Linz, Altenberger Strasse 69, A-4040, Linz, Austria

    Ismail Khalil

Authors
  1. Liming Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ismail Khalil
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Liming Chen .

Editor information

Editors and Affiliations

  1. , School of Computing and Mathematics, University of Ulster, Shore Road, County Antrim, BT37 0QB, United Kingdom

    Liming Chen

  2. School of Computing & Mathematics, University of Ulster, Shore Road, Newtownabbey, BT37 0 QB, United Kingdom

    Chris D. Nugent

  3. , Networking Protocols Department, Institute of Infocomm Research, Singapore, Singapore

    Jit Biswas

  4. , School of Computer Science, University of Waterloo, University Avenue West 200, Waterloo, N2L 3G1, Ontario, Canada

    Jesse Hoey

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Atlantis Press

About this chapter

Cite this chapter

Chen, L., Khalil, I. (2011). Activity Recognition: Approaches, Practices and Trends. In: Chen, L., Nugent, C., Biswas, J., Hoey, J. (eds) Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, vol 4. Atlantis Press. https://doi.org/10.2991/978-94-91216-05-3_1

Download citation

  • DOI: https://doi.org/10.2991/978-94-91216-05-3_1

  • Published:

  • Publisher Name: Atlantis Press

  • Print ISBN: 978-90-78677-42-0

  • Online ISBN: 978-94-91216-05-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation