Skip to main content

Affective Avatar Interactions: Towards Recognizing Emotions in Verbal Interaction

  • Conference paper
  • First Online:
Ubiquitous Computing and Ambient Intelligence (UCAmI 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10586))

  • 2374 Accesses

Abstract

In current times, virtual agents, also known as avatars, are being used for many different tasks, from helping guide a user experience, to aiding in the diagnosis and treatment of different health issues, both physical and mental. In past work, we have explored the use of an affective avatar that responds to tactile interaction with a pc–tablet, the response from the users and the possible uses for aiding the diagnosis and treatment of Social Communications Disorders. In this paper, we present our proposal as a work in progress, based on our previous work with an affective avatar, but adding verbal interaction. We will also discuss what future work we have thought of doing with this particular interaction of the model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nasoz, F., Lisetti, C.L.: MAUI avatars: mirroring the user’s sensed emotions via expressive multi-ethnic facial avatars. J. Vis. Lang. Comput. 17(5), 430–444 (2006)

    Article  Google Scholar 

  2. Lisetti, C., Yasavur, U., De Leon, C., Amini, R., Rishe, N., Visser, U.: Building an on-demand avatar-based health intervention for behavior change. In: Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference, FLAIRS-25, Marco Island, 23–25 May, pp. 175–180 (2012)

    Google Scholar 

  3. Li, M., Kavakli, M., Rudra, T.: eCounsellor: an avatar for student exam stress management. In: Erkan, T.E. (ed.) Proceedings of the 3rd International Conference on Information Management and Evaluation: Atilim University Performance Management and Applications Research Centre, Ankara, Turkey, 16–17 April 2012, pp. 185–193. Academic Publishing International, Nr Reading (2012)

    Google Scholar 

  4. Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C.M., Kazemzadeh, A., Lee, S., Neumann, U., Narayanan, S.: Analysis of emotion recognition using facial expressions, speech and multimodal information. In: Proceedings of the 6th International Conference on Multimodal Interfaces, pp. 205–211. ACM, New York (2004)

    Google Scholar 

  5. Vogt, Thurid, André, Elisabeth, Bee, Nikolaus: EmoVoice — A Framework for Online Recognition of Emotions from Voice. In: André, Elisabeth, Dybkjær, Laila, Minker, Wolfgang, Neumann, Heiko, Pieraccini, Roberto, Weber, Michael (eds.) PIT 2008. LNCS, vol. 5078, pp. 188–199. Springer, Heidelberg (2008). doi:10.1007/978-3-540-69369-7_21

    Chapter  Google Scholar 

  6. Wang, K., An, N., Li, B.N., Zhang, Y., Li, L.: Speech emotion recognition using Fourier parameters. IEEE Trans. Affect. Comput. 6(1), 69–75 (2015)

    Article  Google Scholar 

  7. Johnson, E., Hervás, R., de la Gutiérrez-López Franca, C., Mondéjar, T., Ochoa, S.F., Favela, J.: Assessing empathy and managing emotions through interactions with an affective avatar. Health Inf. J. (2016). doi:10.1177/1460458216661864

    Google Scholar 

  8. Johnson, E., Hervás, R., Gutiérrez-López-Franca, C., Mondéjar, T., Bravo, J.: Analyzing and predicting empathy in neurotypical and non-neurotypical users with an affective avatar. Mob. Inf. Syst. (2017). doi:10.1155/2017/7932529

    Google Scholar 

  9. de la Franca, C.G.L., Hervás, R., Johnson, E., Mondéjar, T., Bravo, J.: Extended body-angles algorithm to recognize activities within intelligent environments. J. Ambient Intell. Hum. Comput. (2017). doi:10.1007/s12652-017-0463-y

    Google Scholar 

  10. Mondéjar, T., Hervás, R., Johnson, E., Gutierrez, C., Latorre, J.M.: Correlation between videogame mechanics and executive functions through EEG analysis. J. Biomed. Inf. 63, 131–140 (2016). doi:10.1016/j.jbi.2016.08.006

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Esperanza Johnson or Ramón Hervás .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Johnson, E., Hervás, R., Gutiérrez-López-Franca, C., Mondéjar, T., Bravo, J. (2017). Affective Avatar Interactions: Towards Recognizing Emotions in Verbal Interaction. In: Ochoa, S., Singh, P., Bravo, J. (eds) Ubiquitous Computing and Ambient Intelligence. UCAmI 2017. Lecture Notes in Computer Science(), vol 10586. Springer, Cham. https://doi.org/10.1007/978-3-319-67585-5_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67585-5_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67584-8

  • Online ISBN: 978-3-319-67585-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics