Abstract
Augmented realities, which are partially real and partially virtual, open up new ways for humans to interact with Embodied Conversational Agents (ECAs) since they allow users to meet ECAs in the physical space. Nevertheless, attempts to integrate ECAs as digital overlays in a physical space have been rare. Obvious reasons are the high demands such an integration puts to the animation of ECAs as virtual augmentations of the physical space, their capabilities to perceive not only the virtual, but also the physical world as well as reactive behavior control. In this paper, we describe our technical contributions towards solving these challenges. To illustrate our ideas, we present the virtual anatomy assistant Ritchie that monitors the user’s actions in a physical space and dynamically responds to them.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6, 355–385 (1997)
Shelton, B.E., Hedley, N.R.: Exploring a cognitive basis for learning spatial relationships with augmented reality. Technology, Instruction, Cognition and Learning 1, 323–357, 154 (2002)
van Mulken, S., André, E., Müller, J.: The persona effect: How substantial is it? In: Proceedings of the Thirteenth Conference of the British Computer Society Human Computer Interaction Specialist Group - People and Computers XIII, Sheffield, pp. 53–66 (1998)
Cassell, J., Ananny, M., Basu, A., Bickmore, T., Chong, P., Mellis, D., Ryokai, K., Smith, J., Vilhjálmsson, H., Yan, H.: Shared reality: physical collaboration with a virtual peer. In: CHI 2000 extended abstracts on Human factors in computing systems, pp. 259–260. ACM Press, New York, USA (2000)
Kruppa, M., Spassova, M., Schmitz, M.: The virtual room inhabitant - intuitive interaction with intelligent environments. In: Zhang, S., Jarvis, R. (eds.) AI 2005. LNCS (LNAI), vol. 3809, Springer, Heidelberg (2005)
Barakonyi, I., Schmalstieg, D.: Ubiquitous animated agents for augmented reality. In: ISMAR 2006. Proceedings of IEEE and ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society Press, Los Alamitos (2006)
Dorfmüller-Ulhaas, K., André, E.: The synthetic character ritchie: First steps towards a virtual companion for mixed reality. In: ISMAR 2005. Proceedings of IEEE International Symposium on Mixed and Augmented Reality, IEEE Computer Society Press, Los Alamitos (2005)
Maes, P., Darrell, T., Blumberg, B., Pentland, A.: The alive system: full-body interaction with autonomous agents. Computer Animation, 11 (1995)
Psik, T., Matković, K., Sainitzer, R., Petta, P., Szalavari, Z.: The invisible person: advanced interaction using an embedded interface. In: EGVE 2003. Proceedings of the workshop on Virtual environments, pp. 29–37. ACM Press, New York, USA (2003)
Cavazza, M., Charles, F., Mead, S.J., Martin, O., Marichal, X., Nandi, A.: Multimodal acting in mixed reality interactive storytelling. IEEE-Multimedia 11, 30–39 (2004)
Wagner, D., Schmalstieg, D.: ARToolKitPlus for pose tracking on mobile devices. In: CVWW 2007. Proceedings of 12th Computer Vision Winter Workshop (2007)
Dorfmüller-Ulhaas, K.: Optical Tracking - From User Motion To 3D Interaction. PhD thesis, Institut 186 für Computergraphik und Algorithmen, Vienna (2002)
Nakano, Y.I., Reinstein, G., Stocky, T., Cassell, J.: Towards a model of face-to-face grounding. In: Dignum, F.P.M. (ed.) ACL 2003. LNCS (LNAI), vol. 2922, pp. 553–561. Springer, Heidelberg (2004)
Kopp, S., Jung, B., Leßmann, N., Wachsmuth, I.: Max - a multimodal assistant in virtual reality construction. Künstliche Intelligenz 17, 11–17 (2003)
Kipp, M., Kipp, K.H., Ndiaye, A., Gebhard, P.: Evaluating the tangible interface and virtual characters in the interactive cohibit exhibit. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 434–444. Springer, Heidelberg (2006)
Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Authoring scenes for adaptive, interactive performances. In: AAMAS 2003. Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 725–732. ACM Press, New York, USA (2003)
Erdmann, D., Dorfmüller-Ulhaas, K., André, E.: Integrating VR-authoring and context sensing: Towards the creation of context-aware stories. In: Göbel, S., Malkewitz, R., Iurgel, I. (eds.) TIDSE 2006. LNCS, vol. 4326, pp. 151–162. Springer, Heidelberg (2006)
Ierusalimschy, R., de Figueiredo, L.H., Filho, W.C.: LUA — an extensible extension language. Software Practice and Experience 26, 635–652 (1996)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wiendl, V., Dorfmüller-Ulhaas, K., Schulz, N., André, E. (2007). Integrating a Virtual Agent into the Real World: The Virtual Anatomy Assistant Ritchie. In: Pelachaud, C., Martin, JC., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds) Intelligent Virtual Agents. IVA 2007. Lecture Notes in Computer Science(), vol 4722. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74997-4_20
Download citation
DOI: https://doi.org/10.1007/978-3-540-74997-4_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74996-7
Online ISBN: 978-3-540-74997-4
eBook Packages: Computer ScienceComputer Science (R0)