Skip to main content
SpringerLink
Log in

Storytelling Agents with Personality and Adaptivity

  • Conference paper
  • First Online:
Intelligent Virtual Agents (IVA 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9238))

Included in the following conference series:

Abstract

We explore the expression of personality and adaptivity through the gestures of virtual agents in a storytelling task. We conduct two experiments using four different dialogic stories. We manipulate agent personality on the extraversion scale, whether the agents adapt to one another in their gestural performance and agent gender. Our results show that subjects are able to perceive the intended variation in extraversion between different virtual agents, independently of the story they are telling and the gender of the agent. A second study shows that subjects also prefer adaptive to nonadaptive virtual agents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nisbett, R.E.: The trait construct in lay and professional psychology. In: Retrospections on Social Psychology, pp. 109–130 (1980)

    Google Scholar 

  2. Mehl, M.R., Gosling, S.D., Pennebaker, J.W.: Personality in its natural habitat: manifestations and implicit folk theories of personality in daily life. J. Pers. Soc. Psychol. 90, 862–877 (2006)

    Article  Google Scholar 

  3. Norman, W.T.: Toward an adequate taxonomy of personality attributes: replicated factor structure in peer nomination personality rating. J. Abnorm. Soc. Psychol. 66, 574–583 (1963)

    Article  Google Scholar 

  4. Bickmore, T., Schulman, D.: The comforting presence of relational agents. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 550–555. ACM (2006)

    Google Scholar 

  5. Hartmann, B., Mancini, M., Pelachaud, C.: Implementing expressive gesture synthesis for embodied conversational agents. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 188–199. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  6. Kopp, S., Wachsmuth, I.: Synthesizing multimodal utterances for conversational agents. Comput. Anim. Virtual Worlds 15, 39–52 (2004)

    Article  Google Scholar 

  7. Thiebaux, M., Marshall, A., Marsella, S., Kallman, M.: Smartbody: behavior realization for embodied conversational agents. In: Proceedings of 7th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008), pp. 151–158 (2008)

    Google Scholar 

  8. Heloir, A., Kipp, M.: EMBR – a realtime animation engine for interactive embodied agents. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 393–404. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  9. André, E., Klesen, M., Gebhard, P., Allen, S., Rist, T.: Integrating models of personality and emotions into lifelike characters. In: Paiva, A.C.R. (ed.) IWAI 1999. LNCS, vol. 1814, pp. 150–165. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  10. Ruttkay, Z., Dormann, C., Noot, H.: Embodied conversational agents on a common ground. In: From Brows to Trust: Evaluating Embodied Conversational Agents, chap. 2, pp. 27–66. Kluwer Academic Publishers, Norwell (2004)

    Google Scholar 

  11. Moon, Y., Nass, C.: How “real” are computer personalities?: Psychological responses to personality types in human-computer interaction. Commun. Res. 23(6), 651–674 (1996)

    Article  Google Scholar 

  12. Endraß, B., André, E., Rehm, M., Nakano, Y.I.: Investigating culture-related aspects of behavior for virtual characters. Auton. Agent. Multi-Agent Syst. 27(2), 277–304 (2013)

    Article  Google Scholar 

  13. Noma, T., Badler, N.I., Zhao, L.: Design of a virtual human presenter. Center for Human Modeling and Simulation, p. 75 (2000)

    Google Scholar 

  14. Tapus, A., Tapus, C., Mataric, M.J.: User robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intel. Serv. Robot. 1(2), 169–183 (2008)

    Article  Google Scholar 

  15. Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., Collins, H.: The politeness effect: pedagogical agents and learning gains. Front. Artif. Intell. Appl. 125, 686–693 (2005)

    Google Scholar 

  16. Mairesse, F., Walker, M.A.: Controlling user perceptions of linguistic style: trainable generation of personality traits. Comput. Linguist. 37(3), 455–488 (2011)

    Article  Google Scholar 

  17. Neff, M., Wang, Y., Abbott, R., Walker, M.: Evaluating the effect of gesture and language on personality perception in conversational agents. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 222–235. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  18. Bee, N., Pollock, C., André, E., Walker, M.: Bossy or wimpy: expressing social dominance by combining gaze and linguistic behaviors. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 265–271. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  19. Neff, M., Toothman, N., Bowmani, R., Fox Tree, J.E., Walker, M.A.: Don’t scratch! self-adaptors reflect emotional stability. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS, vol. 6895, pp. 398–411. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  20. Fox Tree, J.E.: Listening in on monologues and dialogues. Discourse Process. 27, 35–53 (1999)

    Article  Google Scholar 

  21. Parrill, F., Kimbara, I.: Seeing and hearing double: the influence of mimicry in speech and gesture on observers. J. Nonverbal Behav. 30, 157–166 (2006)

    Article  Google Scholar 

  22. Bailenson, J.N., Yee, N.: Digital chameleons: automatic assimilation of nonverbal gestures in immersive virtual environments. Psychol. Sci. 16(10), 814–819 (2005)

    Article  Google Scholar 

  23. Tolins, J., Fox Tree, J.E.: Addressee backchannels steer narrative development. J. Pragmat. 70, 152–164 (2014)

    Article  Google Scholar 

  24. Thorne, A., Korobov, N., Morgan, E.M.: Channeling identity: a study of storytelling in conversations between introverted and extraverted friends. J. Res. Pers. 41(5), 1008–1031 (2007)

    Article  Google Scholar 

  25. Gordon, A., Swanson, R.: Identifying personal stories in millions of weblog entries. In: 3rd International Conference on Weblogs and Social Media, Data Challenge Workshop, San Jose, CA (2009)

    Google Scholar 

  26. Kita, S., van Gijn, I., van der Hulst, H.: Movement phases in signs and co-speech gestures, and their transcription by human coders. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, p. 23. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  27. Wang, Y., Neff, M.: The influence of prosody on the requirements for gesture-text alignment. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, pp. 180–188. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  28. Tolins, J., Liu, K., Wang, Y., Tree, J.E.F., Walker, M., Neff, M.: Gestural adaptation in extravert-introvert pairs and implications for IVAs. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, p. 484. Springer, Heidelberg (2013)

    Google Scholar 

  29. Luo, P., Kipp, M., Neff, M.: Augmenting gesture animation with motion capture data to provide full-body engagement. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 405–417. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  30. Gosling, S.D., Rentfrow, P.J., Swann, W.B.: A very brief measure of the big five personality domains. J. Res. Pers. 37, 504–528 (2003)

    Article  Google Scholar 

  31. Liu, K., Tolins, J., Tree, J.E.F., Walker, M., Neff, M.: Judging IVA personality using an open-ended question. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, pp. 396–405. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  32. Buschmeier, H., Bergmann, K., Kopp, S.: An alignment-capable microplanner for natural language generation. In: Proceedings of the 12th European Workshop on Natural Language Generation, pp. 82–89. ACL (2009)

    Google Scholar 

  33. Hu, Z., Halberg, G., Jimenez, C., Walker, M.: Entrainment in pedestrian direction giving: how many kinds of entrainment? In: IWSDS (2014)

    Google Scholar 

  34. Bergmann, K., Kopp, S.: Increasing the expressiveness of virtual agents: autonomous generation of speech and gesture for spatial description tasks. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 361–368 (2009)

    Google Scholar 

  35. André, E., Müller, J., Rist, T.: WiP/PPP: automatic generation of personalized multimedia presentations. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 407–408. ACM (1997)

    Google Scholar 

  36. Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: Beat: the behavior expression animation toolkit. In: Prendinger, H., Ishizuka, M. (eds.) Life-Like Characters. Cognitive Technologies, pp. 163–185. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  37. Neff, M., Kipp, M., Albrecht, I., Seidel, H.P.: Gesture modeling and animation based on a probabilistic re-creation of speaker style. ACM Trans. Graph. 27(1), 5:1–5:24 (2008). ACM

    Article  Google Scholar 

  38. Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating rapport with virtual agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 125–138. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of California, Santa Cruz, USA

    Chao Hu, Marilyn A. Walker & Jean E. Fox Tree

  2. University of California, Davis, USA

    Michael Neff

Authors
  1. Chao Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marilyn A. Walker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Neff
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jean E. Fox Tree
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao Hu .

Editor information

Editors and Affiliations

  1. Delft University of Technology, Delft, The Netherlands

    Willem-Paul Brinkman

  2. Delft University of Technology, Delft, The Netherlands

    Joost Broekens

  3. University of Twente, Enschede, The Netherlands

    Dirk Heylen

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Hu, C., Walker, M.A., Neff, M., Fox Tree, J.E. (2015). Storytelling Agents with Personality and Adaptivity. In: Brinkman, WP., Broekens, J., Heylen, D. (eds) Intelligent Virtual Agents. IVA 2015. Lecture Notes in Computer Science(), vol 9238. Springer, Cham. https://doi.org/10.1007/978-3-319-21996-7_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-21996-7_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-21995-0

  • Online ISBN: 978-3-319-21996-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation