Abstract
We are studying the realization of natural human-like response of an animate 3-dimensional face robot in communicative interaction with human. The face robot can produce realistic human-like facial expressions and can recognize human facial expressions using facial image data obtained by a CCD camera mounted inside the left eyeball. We developed the real time machine recognition of facial expression by using a layered neural network and achieved the high correct recognition ratio of 85 % with respect to 6 typical facial expressions. And we also developed the new small size pneumatic actuator for display of dynamic facial expressions on the face robot and the same speed in dynamic facial expressions as in human was accomplished even in the swift expression of “surprise”. For facial interactive communication between the face robot and human, we integrate these two technologies and the face robot can generate by itself the preferable facial expression to the human partner through the reinforcement learning. This implies a high technological potential for the animate face robot to undertake interactive communication with human when an artificial mind is self-organized through the interactive reinforcement learning.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
V. Bruce, “ Recognising Faces (translated into Japanese)”, Science Pub. Co., 1990.
A. Mehrabian, “Communication without Words”, Psychology Today, Vol. 12, No.2, 1968
Y. Moses et al,“ Determining Facial Expressions in Real Time”, Proc.of International Conf. on Computer Vision, 1995, pp.296–301
I. A. Essa and A. Pentland, “ Facial Expression Recognition using a Dynamic Model and Motion Energy”, Proc. of International Conf. on Computer Vision, 1995, pp.
Y. Yacoob and L. Davis, “ Computing Spatio-Temporal Representation of Human faces”, IEEE Trans. On Pattern Analysis and Machine Intelligence, 18(6), 1994, pp. 636–642
M.J. Black and Y. Yacoob, “ Tracking and Recognizing Rigid and Non-rigid Facial Motions using Local Parametric Models of Image Motion”, Proc.of International Conf. on Computer Vision, 1995, pp.374–381
H. Kobayashi and F. Hara, “ The Recognition of Basic Facia Expressions by Neural Network ”, Proc. of Joint International Conf. on Neural Network, 1991, pp.460–466
A. Takeuchi and K. Nagao, “ Communicative Facial Display as a New Conversational Modality”, Proc. ACM/IFIPINTERCHI, 1993, pp. 187–193
S. Seto, Y. Nagata, Y. Yamashita and Y. Takebayashi, “ Multimodal Response of a Real Time Speech Dialogue System”, Proc. 8″′ Human Interface Symposium, 1992, pp. 693–698 (in Japanese)
F. Hara, “ A New Paradigm for Robot and Human Communication”, JSME Proc. Robotics and mechatronics, No. 940-21, 1994, pp. 1–9 (in Japanese)
H. kobayashi, F. Hara, G. Uchida and M. Ohno, “ Study of face Robot for Active Human Interface”, Journal of the Robotic Society of Japan, 12–I, 1994, pp. 155–163 (in Japanese)
P. Ekman and W.V. Friesen, “ Facial Action Coding System”, Consulting Psychologists Press, Palo Sal to, CA. 1977
M. Nagao, “ Some Problem in Communication between Human and Machine”, J. Artificial Intelligence, 8–6, 1993, pp. 705–708
M.A. Arbib, “Neural Networks and Brain (translated into Japanese)”, Science Pub. Co., 1992,pp. 1–507.
H. Kobayashi, A. Tange, and F. Hara, “ Real Time Recognition of 6 Basic Facial Expressions”, Proc. IEEE International Workshop on Robot and Human Communication, 1995, pp. 179–186
J.N. Bassilli, “Emotion Recognition; The Role of Facial Movement and the Relative Importance of Upper and Lower Areas of Face”, Personality and Social Psychology, 37–11, 1979, pp. 2049–2058
Y. Suzumori, “Flexible Microactuator (in Japanese)”, Trans. ofJSME(C), 55–518, 1989, pp. 2547–2552
H. Kobayashi and F. Hara, “Real Time Dynamic Control of 6 Basic Facial Expressions on Face Robot”, Journal of Robotic Society of Japan, 14-5. 1996, pp.677–685
H. Kobayashi and F. Hara, “ Facial interaction between Animated 3d face Robot and human Beings”, Proc. IEEE Internationa Conf on Systems, Man and Cybernetics, 1997, pp. 3732–3737
R. S. Sutton and A. G. Bato, “Reinforcement Learning”, MIT Press, 1998, p.322
D. B. Fogel, “ Evolutionary Computation”, IEEE Press, 1995
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag/Wien
About this paper
Cite this paper
Hara, F., Kobayashi, H., Iida, F. (1998). An interactive face robot able to create virtual communication with human. In: Göbel, M., Landauer, J., Lang, U., Wapler, M. (eds) Virtual Environments ’98. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-7519-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-7091-7519-4_18
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83233-2
Online ISBN: 978-3-7091-7519-4
eBook Packages: Springer Book Archive