Abstract
Eye movements can be consciously controlled by humans to the extent of performing sequences of predefined movement patterns, or ’gaze gestures’. Gaze gestures can be tracked non-invasively employing a video-based eye tracking system. Gaze gestures hold great potential in the context of Human Computer Interaction as low-cost gaze trackers become more ubiquitous. In this work, we build an original set of 50 gaze gestures and evaluate the recognition performance of a Bayesian inference algorithm known as Hierarchical Temporal Memory, HTM. HTM uses a neocortically inspired hierarchical architecture and spatio-temporal coding to perform inference on multi-dimensional time series. Here, we show how an appropiate temporal codification is critical for good inference results. Our results highlight the potential of gaze gestures for the fields of accessibility and interaction with smartphones, projected displays and desktop computers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rozado, D., Rodriguez, F., Varona, P.: Optimizing hierarchical temporal memory for multivariable time series. In: Diamantaras, K., Duch, W., Iliadis, L.S. (eds.) ICANN 2010. LNCS, vol. 6353, pp. 506–518. Springer, Heidelberg (2010)
Mollenbach, E., Hansen, J.P., Lillholm, M., Gale, A.G.: Single stroke gaze gestures. In: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, CHI 2009, pp. 4555–4560. ACM, New York (2009), http://doi.acm.org/10.1145/1520340.1520699
Drewes, H., Schmidt, A.: Interacting with the computer using gaze gestures. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4663, pp. 475–488. Springer, Heidelberg (2007)
San Agustin, J., Skovsgaard, H., Mollenbach, E., Barret, M., Tall, M., Hansen, D.W., Hansen, J.P.: Evaluation of a low-cost open-source gaze tracker. In: ETRA 2010: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pp. 77–80. ACM, New York (2010)
George, D., Hawkins, J.: Towards a mathematical theory of cortical micro-circuits. PLoS Comput. Biol. 5(10), e1000532 (2009), http://dx.doi.org/10.1371 (online)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rozado, D., Rodriguez, F.B., Varona, P. (2011). Gaze Gesture Recognition with Hierarchical Temporal Memory Networks. In: Cabestany, J., Rojas, I., Joya, G. (eds) Advances in Computational Intelligence. IWANN 2011. Lecture Notes in Computer Science, vol 6691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21501-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-21501-8_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21500-1
Online ISBN: 978-3-642-21501-8
eBook Packages: Computer ScienceComputer Science (R0)