Abstract
Weiser and Brown made it clear when they predicted the advent of ubiquitous computing: the most important and challenging aspect of developing the all-encompassing technology of the early 21st Century is the need for computers that can accept and produce information in a manner based on the natural human ways of communicating. In our first steps towards a new paradigm for calm interaction, we propose a multimodal trigger for getting the attention of a passive smart home system, and we implement a gesture recognition application on a smart phone to demonstrate three key concepts: 1) the possibility that a common gesture of human communication could be used as part of that trigger, and; 2) that some commonly understood gestures exist and can be used immediately, and; 3) that the message communicated to the system can be extracted from secondary features of a deliberate human action. Demonstrating the concept, but not the final hardware or mounting strategy, 16 individuals performed a double clap with a smart phone mounted on their upper arm. The gesture was successfully recognized in 88% of our trials. Furthermore, when asked to try and deceive the system by performing any other action that might be similar, 75% of the participants were unable to register a false positive.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Weiser, M., Brown, J.S.: The Coming Age of Calm Technology. In: Denning, P.J., Metcalfe, R.M. (eds.) Beyond Calculation: The Next Fifty Years of Computing, pp. 75–85. Copernicus, New York (1997)
Koskela, T., Väänänen-Vainio-Mattila, K.: Evolution towards smart home environments: empirical evaluation of three user interfaces. Personal and Ubiquitous Computing (8), 234–240 (2004)
Weiser, M.: The Computer for the Twenty-First Century. Scientific American 265(3), 94–104 (1991)
Cohn, G., Morris, D., Patel, S.N., Tan, D.S.: Your noise is my command: Sensing gestures using the body as an antenna. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems, pp. 791–800. ACM (2011)
Streitz, N., Nixon, P.: The disappearing computer. Communications of the ACM 48(3), 32–35 (2005)
Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 234–241. ACM, New York (1997)
Riedl, R., Kindermann, H., Auinger, A., Javor, A.: Technostress from a Neurobiological Perspective. Business & Information Systems Engineering, 1–9 (2012)
Chan, M., Estève, D., Escriba, C., Campo, E.: A review of smart homes - Present state and future challenges. Computer Methods and Programs in Biomedicine 9(I), 55–81 (2008)
McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press, Chicago (1992)
Brown, J.N.A., Kaufmann, B., Bacher, F., Sourisse, C., Hitz, M.: “Oh I Say, Jeeves¡‘: A Calm Approach to Smart Home Input (under review)
Kühnel, C., Westermann, T., Hemmert, F., Kratz, S., Müller, A., Möller, S.: I’m home: Defining and evaluating a gesture set for smart home control. International Journal of Human-Computer Studies 69(11), 693–704 (2011)
Prekopcsák, Z.: Accelerometer based real-time gesture recognition. In: Proceedings of International Student Conference on Electrical Engineering, Prague, pp. 1–5 (2008)
Joselli, M., Clua, E.: gRmobile: A framework for touch and accelerometer gesture recognition for mobile games. In: Proceedings of Brazilian Symposium on Games and Digital Entertainment, Rio de Janeiro, pp. 141–150 (2009)
Akl, A., Valaee, S.: Accelerometer-based gesture recognition via dynamic-time warping, affinity propagation, & compressive sensing. In: IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), Dallas, pp. 2270–2273 (2010)
Kratz, S., Rohs, M.: A $3 gesture recognizer: simple gesture recognition for devices equipped with 3D acceleration sensors. In: Proceedings of the 15th International Conference on Intelligent User Interfaces, IUI 2010, pp. 341–344. ACM, New York (2010)
Holzinger, A., Searle, G., Wernbacher, M.: The effect of Previous Exposure to Technology (PET) on Acceptance and its importance in Usability and Accessibility Engineering. Springer Universal Access in the Information Society International Journal 10(3), 245–260 (2011)
Raso, I., Hervas, R., Bravo, J.: m-Physio: Personalized Accelerometer-based Physical Rehabilitation Platform. In: Proceedings of UBICOMM 2010, Florence, pp. 416–421 (2010)
Kühnel, C., Westermann, T., Weiss, B., Möller, S.: Evaluating multimodal systems: a comparison of established questionnaires and interaction parameters. In: Proceedings of NordiCHI 2010, pp. 286–294. ACM, New York (2010)
Sousa Santos, B., Dias, P., Pimentel, A., Baggerman, J.-W., Ferreira, C., Silva, S., Madeira, J.: Head Mounted Display versus desktop for 3D Navigation in Virtual Reality: A User Study. Multimedia Tools and Applications 41, 161–181 (2008)
Brown, J.N.A., Albert, W.J., Croll, J.: A new input device: comparison to three commercially available mouses. Ergonomics 50(2), 208–227 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brown, J.N.A., Kaufmann, B., Huber, F.J., Pirolt, KH., Hitz, M. (2013). “…Language in Their Very Gesture” First Steps towards Calm Smart Home Input. In: Holzinger, A., Pasi, G. (eds) Human-Computer Interaction and Knowledge Discovery in Complex, Unstructured, Big Data. HCI-KDD 2013. Lecture Notes in Computer Science, vol 7947. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39146-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-39146-0_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39145-3
Online ISBN: 978-3-642-39146-0
eBook Packages: Computer ScienceComputer Science (R0)