Abstract
Not receiving help in the case of an emergency is one of the most common fears of older adults that live independently at home. Falls are a particularly frequent occurrence and often the cause of serious injuries. In the last years, various ICT solutions for supporting older adults at home have been developed. Based on sensors and services in a smart environment they provide a wide range of services. In this work we have designed and evaluated safety-related services, based on a single Microsoft Kinect that is installed in a user’s home. We created two services to investigate the benefits and limitations of these solutions. The first is a fall detection service that registers falls in real-time, using a novel combination of static and dynamic skeleton tracking. The second is a fall prevention service that detects potentially dangerous objects in the walking path, based on scene analysis in a depth image. We conducted technical and user evaluations for both services, in order to get feedback on the feasibility, limitations, and potential future improvements.
Similar content being viewed by others
Notes
http://cordis.europa.eu/project/rcn/110902_en.html (Accessed 27-07-2017).
References
Alwan M, Rajendran PJ, Kell S, Mack D, Dalal S, Wolfe M, Felder R (2006) A smart and passive floor-vibration based fall detector for elderly. In: Information and communication technologies, ICTTA'06, 2nd, vol 1. IEEE, pp 1003–1007
Braun A, Heggen H, Wichert R (2012) Capfloor—a flexible capacitive indoor localization system. In: Chessa S, Knauth S (eds) Evaluating AAL systems through competitive benchmarking. Indoor localization and tracking: international competition, EvAAL 2011, competition in valencia, Spain, July 25–29, 2011, and Final Workshop in Lecce, Italy, September 26, 2011. Springer, Berlin, pp 26–35 (Revised Selected Papers)
Braun A, Wichert R, Kuijper A, Fellner DW (2015) Capacitive proximity sensing in smart environments. J Ambient Intell Smart Environ 7(4):483–510
Campbell AJ, Reinken J, Allan BC, Martinez GS (1981) Falls in old age: a study of frequency and related clinical factors. Age Ageing 10(4):264–270
Chen L, Wei H, Ferryman J (2013) A survey of human motion analysis using depth imagery. Pattern Recognit Lett 34(15):1995–2006 (Smart Approaches for Human Action Recognition)
Chen J, Kwong K, Chang D, Luk J, Bajcsy R (2006) Wearable sensors for reliable fall detection. In: 27th Annual international conference of the Engineering in Medicine and Biology Society. IEEE-EMBS 2005. IEEE, pp 3551–3554
Delahoz YS, Labrador MA (2014) Survey on fall detection and fall prevention using wearable and external sensors. Sensors 14(10):19806–19842
Demiris G, Rantz MJ, Aud MA, Marek KD, Tyrer HW, Skubic M, Hussam AA (2004) Older adults’ attitudes towards and perceptions of ‘smart home’technologies: a pilot study. Med Inform Internet Med 29(2):87–94
Depth Sensor Shootout (2017). http://stimulant.com/depth-sensor-shootout-2/. Accessed 23 May 2018
Di P, Huang J, Sekiyama K, Fukuda T (2011) A novel fall prevention scheme for intelligent cane robot by using a motor driven universal joint. In: 2011 International symposium on micro-nanomechatronics and human science (MHS). IEEE, pp 391–396
Dissanayake MWMG, Newman P, Clark S, Durrant-Whyte HF, Csorba M (2001) A solution to the simultaneous localization and map building (slam) problem. IEEE Trans Robot Autom 17(3):229–241
Fryar CD, Gu Q, Ogden CL (2012) Anthropometric reference data for children and adults: United States, 2007–2010. Vital Health Stat Ser 11 Data Natl Health Surv 252:1–48
Gasparrini S, Cippitelli E, Spinsante S, Gambi E (2014) A depth-based fall detection system using a kinect\(\textregistered \) sensor. Sensors 14(2):2756
Georgiadis D, Andreou P, Konstantinidis A, Christophorou C, Sandner E, Hanke S, Tsiourti C, Aristogenis Fanourakis M, Mettel MR (2015) Design and specification of ICT-based services and safety services. Tech Rep. Public Deliverable D4.1b Miraculous Life project, pp 42–45
Hamm J, Money AG, Atwal A, Paraskevopoulos I (2016) Fall prevention intervention technologies: a conceptual framework and survey of the state of the art. J Biomed Inform 59:319–345
Hanke S, Sandner E, Stainer-Hochgatterer A, Tsiourti C, Braun A (2015) The technical specification and architecture of a virtual support partner. In: AmI (Workshops/Posters)
Henry P, Krainin M, Herbst E, Ren X, Fox D (2012) RGB-D mapping: using kinect-style depth cameras for dense 3D modeling of indoor environments. Int J Robt Res 31(5):647–663
Joly C, Düne C, Gorce P, Rives P (2013) Füße und Beine verfolgen mit einem intelligenten Rollator mit Kinect. In: Zusammenarbeit mit IEEE / RSJ Int. Conf. auf Int. Rob. und Sys. (IROS) Workshop zum Thema “Assistenz und Servicerobotik in einer menschlichen Umgebung”, Tokyo, Japan
Kawatsu C, Li J, Chung CJ (2013) Robot intelligence technology and applications 2012: an edition of the presented papers from the 1st international conference on robot intelligence technology and applications. Springer, Berlin, pp 623–630
Kepski M, Kwolek B (2013) Human fall detection using Kinect sensor. In: Proceedings of the 8th international conference on computer recognition systems CORES 2013. Springer, Heidelberg, pp 743–752
Kepski M, Kwolek B (2014) Fall detection using ceiling-mounted 3d depth camera. In: 2014 International conference on computer vision theory and applications (VISAPP), vol 2. IEEE, pp 640–647
Kinect for Windows SDK v1.8-Skeletal Tracking (2018). https://msdn.microsoft.com/en-us/library/hh973074.aspx. Accessed 23 May 2018
Kinect for Windows SDK-Features (2018). http://msdn.microsoft.com/de-de/library/dn782025.aspx. Accessed 23 May 2018
Kinect for Windows SDK-Kinect API Overview (2018). http://msdn.microsoft.com/de-de/library/dn782033.aspx. Accessed 23 May 2018
Kirchbuchner F, Grosse-Puppendahl T, Hastall MR, Distler M, Kuijper A (2015) Ambient intelligence from senior citizens’ perspectives: understanding privacy concerns, technology acceptance, and expectations. In: European conference on ambient intelligence. Springer, Cham, pp 48–59
Lange B, Chang CY, Suma E, Newman B, Rizzo AS, Bolas M (2011) Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. In: 2011 annual international conference of the IEEE Engineering in Medicine and Biology Society, EMBC. IEEE, pp 1831–1834
Lu F, Milios E (1997) Globally consistent range scan alignment for environment mapping. Auton Robots 4(4):333–349
Majumder AJA, Zerin I, Uddin M, Ahamed SI, Smith RO (2013) SmartPrediction: a real-time smartphone-based fall risk prediction and prevention system. In: Proceedings of the 2013 research in adaptive and convergent systems. ACM, pp 434–439
Mettel MR, Alekseew M, Stocklöw C, Braun A (2017) Safety services in smart environments using depth cameras. In: European conference on ambient intelligence. Springer, Cham, pp 80–93
Prediger M, Braun A, Marinc A, Kuijper A (2014) Robot-supported pointing interaction for intelligent environments. In: Streitz N, Markopoulos P (eds) Proceedings of distributed, ambient, and pervasive interactions: second international conference, DAPI 2014, held as part of HCI international 2014, Heraklion, Crete, Greece. Springer International Publishing, Cham, pp 172–183
Rajendran P, Corcoran A, Kinosian B, Alwan M (2008) Falls, fall prevention, and fall detection technologies. In: Eldercare technology for clinical practitioners. Humana Press, pp 187–202
Rougier C, Meunier J, St-Arnaud A, Rousseau J (2007) Fall detection from human shape and motion history using video surveillance. In: 21st International conference on advanced information networking and applications workshops, AINAW'07, vol 2. IEEE, pp 875–880
Rusu RB, Cousins S (2011) 3d is here: Point cloud library (pcl). In: 2011 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1–4
Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A (2013) Real-time human pose recognition in parts from single depth images. Commun ACM 56(1):116–124
Su BY, Ho KC, Rantz MJ, Skubic M (2015) Doppler radar fall activity detection using the wavelet transform. IEEE Trans Biomed Eng 62(3):865–875
Tsiourti C, Joly E, Wings C, Moussa MB, Wac K (2014) Virtual assistive companions for older adults: qualitative field study and design implications. In: Proceedings of the 8th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 57–64
Webster D, Celik O (2014) Systematic review of kinect applications in elderly care and stroke rehabilitation. J Neuroeng Rehabilit 11(1):108
Acknowledgements
We would like to thank all volunteers that participated in our study and provided valuable feedback. This work was partially funded by EC Grant agreement no. 611421.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mettel, M.R., Alekseew, M., Stocklöw, C. et al. Designing and evaluating safety services using depth cameras. J Ambient Intell Human Comput 10, 747–759 (2019). https://doi.org/10.1007/s12652-018-0898-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-018-0898-9