Abstract
This research proposes 3D graphical agents in the role of virtual presenters with a new type of functionality – the capability to process and respond to visual attention of users communicated by their eye movements. Eye gaze is an excellent clue to users’ attention, visual interest, and visual preference. Using state-of-the-art non-contact eye tracking technology, eye movements can be assessed in a unobtrusive way. By analyzing and interpreting eye behavior in real-time, our proposed system can adapt to the current (visual) interest state of the user, and thus provide a more personalized, context-aware, and ‘attentive’ experience of the presentation. The system implements a virtual presentation room, where research content of our institute is presented by a team of two highly realistic 3D agents in a dynamic and interactive way. A small preliminary study was conducted to investigate users’ gaze behavior with a non-interactive version of the system. A demo video based on our system was awarded as the best application of life-like agents at the GALA event in 2006.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)
Barakonyi, I., Prendinger, H., Schmalstieg, D., Ishizuka, M.: Cascading hand and eye movement for augmented reality videoconferencing. In: Proceedings 2nd IEEE Symposium on 3D User Interfaces 2007 (3DUI-07), pp. 71–78. IEEE Computer Society Press, Los Alamitos (2007)
Bates, J.: The role of emotion in believable agents. Communications of the ACM 37(7), 122–125 (1994)
Bee, N., Prendinger, H., Nakasone, A., André, E., Ishizuka, M.: AutoSelect: What You Want Is What You Get. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Weber, M. (eds.) PIT 2006. LNCS (LNAI), vol. 4021, pp. 40–52. Springer, Heidelberg (2006)
Duchowski, A.T.: Eye Tracking Methodology: Theory and Practice. Springer, London, UK (2003)
Garau, M., Slater, M., Bee, S., Sasse, M.A.: The impact of eye gaze on communication using humanoid avatars. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI-01), pp. 309–316. ACM Press, New York (2001)
Hansen, J.P., Engell.-Nielson, T., Glenstrup, A.J.: Eye-gaze interaction: A new media – not just a fast mouse. In: The Second Swedish Symposium on Multimodal Communication (1998)
Heylen, D.: Head gestures, gaze and the principles of conversational structure. International Journal of Humanoid Robotics 3(3), 241–267 (2006)
Jacob, R.J.K.: The use of eye movements in human-computer interaction techniques: What You Look At is What You Get. ACM Transactions on Information Systems 9(3) 152–169 (1991)
Kendon, A.: Some functions of gaze-direction in social interaction. Acta Psychologica 26, 22–63 (1967)
Kipp, M.: Gesture Generation by Immitation – From Human Behavior to Computer Character Animation. PhD thesis, Saarland University, Disseration.com, Boca Raton, Florida (2004)
Nischt, M., Prendinger, H., André, E., Ishizuka, M.: Creating three-dimensional animated characters: An experience report and recommendations of good practice. Upgrade. The European Journal for the Informatics Professional VII(2), 36–41 (2006)
Nischt, M., Prendinger, H., André, E., Ishizuka, M.: MPML3D: a reactive framework for the Multimodal Presentation Markup Language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 218–229. Springer, Heidelberg (2006)
Prendinger, H., Ishizuka, M.: Life-Like Characters. Tools, Affective Functions, and Applications. In: Cognitive Technologies, Springer, Heidelberg (2004)
Prendinger, H., Ma, C., Ishizuka, M.: Eye movements as indices for the utility of life-like interface agents: A pilot study. Interacting with Computers 19(2), 281–292 (2007)
Qvarfordt, P., Zhai, S.: Conversing with the user based on eye-gaze patterns. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI-05), pp. 221–230. ACM Press, New York (2005)
Rehm, M., André, E.: Where do they look? Gaze behaviors of multiple users interacting with an embodied conversational agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 241–252. Springer, Heidelberg (2005)
Rist, T., André, E., Baldes, S., Gebhard, P., Klesen, M., Kipp, M., Rist, P.,Schmitt, M.: A review of the development of embodied presentation agents and their appication fields. In: Prendinger, Ishizuka, vol. 14, pp. 377–404
Selker, T.: Visual attentive interfaces. BT Technology Journal 22(4), 146–150 (2004)
Shimojo, S., Simion, C., Shimojo, E., Scheier, C.: Gaze bias both reflects and influences preference. Nature Neuroscience 6(12), 1317–1322 (2003)
Starker, I., Bolt, R.A.: A gaze-responsive self-disclosing display. In: Proceedings CHI-90, pp. 3–9. ACM Press, New York (1990)
Vertegaal, R., Slagter, R., van der Veer, G., Nijholt, A.: Eye gaze patterns in conversations: There is more to conversational agents than meets the eyes. In: Proceedings of CHI-01, pp. 301–308. ACM Press, New York (2001)
Zhai, S.: What’s in the eyes for attentive input. Communications of the ACM 46(3), 34–39 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hoekstra, A., Prendinger, H., Bee, N., Heylen, D., Ishizuka, M. (2007). Highly Realistic 3D Presentation Agents with Visual Attention Capability. In: Butz, A., Fisher, B., Krüger, A., Olivier, P., Owada, S. (eds) Smart Graphics. SG 2007. Lecture Notes in Computer Science, vol 4569. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73214-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-73214-3_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73213-6
Online ISBN: 978-3-540-73214-3
eBook Packages: Computer ScienceComputer Science (R0)