Skip to main content
SpringerLink
Log in

User Interaction for Interactive Storytelling

  • Living reference work entry
  • First Online:
Handbook of Digital Games and Entertainment Technologies

Abstract

User interaction is a central component of Interactive Storytelling, yet it has often been neglected, as precedence is often granted to the pursuit of narrative generation techniques. This chapter presents several paradigms of interaction using examples drawn from fully implemented Interactive Storytelling systems and proposes an empirical classification of modes of interaction based on the nature of user involvement. First is provided a context for the need for multimodal interaction with the story world and the influence of the user’s intervention onto the dynamics of story generation. Then, the requirements of affective interaction within the context of Interactive Storytelling are covered and illustrated through traditional multimodal interaction, as well as physiological interfaces. Finally, the potential of Brain-Computer Interfaces (BCI) to support Interactive Storytelling is discussed, in particular through the unification of user experience, user input, and affective filmic theories.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Recommended Reading

  • G. Aranyi, F. Charles, M. Cavazza. Anger-based BCI using fNIRS neurofeedback. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, pp. 511–521 (2015). http://dx.doi.org/10.1145/2807442.2807447

  • B.-C. Bae, R.M. Young, A use of flashback and foreshadowing for surprise arousal in narrative using a plan-based approach, in Proceedings 1st Joint International Conference on Interactive Digital Storytelling (ICIDS), Springer-Verlag, Berlin, Heidelberg, pp. 156–167 (2008)

    Google Scholar 

  • R. Barthes. Introduction Á L’analyse Structurale Des Récits. In: L’analyse structurale du récit, Communications, Paris, Seuil, 8, 7–33 (1966) (in French)

    Google Scholar 

  • M. Cavazza, F. Charles, S.J. Mead, Characters in search of an author: AI-based virtual storytelling, in Proceedings 1st International Conference on Virtual Storytelling (ICVS), Springer-Verlag, Berlin, Heidelberg, pp. 145–154 (2001)

    Google Scholar 

  • M. Cavazza, F. Charles, S. Mead. Interacting with virtual characters in interactive storytelling, in Proceedings 1st International Joint Conference on Autonomous Agents and MultiAgent Systems (AAMAS), IFAAMAS, Bologna, Italy, pp. 318–325 (2002)

    Google Scholar 

  • M. Cavazza, O. Martin, F. Charles, S.J. Mead, X. Marichal, Interacting with virtual agents in mixed reality interactive storytelling, in Proceedings of the 4th International Workshop, IVA 2003, Kloster Irsee, Germany, 15–17 Sept, pp. 231–235 (2003)

    Google Scholar 

  • M. Cavazza, F. Charles, S. Mead, Multi-modal acting in mixed reality interactive storytelling. IEEE Multimedia 11(3), 30–39 (2004)

    Article  Google Scholar 

  • M. Cavazza, G. Aranyi, F. Charles, J. Porteous, S. Gilroy, I. Klovatch, G. Jackont, E. Soreq, N.J. Keynan, A. Cohen, G. Raz, T. Hendler, Towards empathic neurofeedback for interactive storytelling, in Proceedings of 2014 Workshop on Computational Models of Narrative (CMN 2014), 31 July –2 Aug, Quebec City (2014)

    Google Scholar 

  • Y.G. Cheong, R.M. Young, Narrative generation for suspense: modeling and evaluation, in Interactive storytelling (Springer, Berlin/Heidelberg, 2008), pp. 144–155

    Chapter  Google Scholar 

  • R. Damiano, V. Lombardo, A unified approach for reconciling characters and story in the realm of agency, in Proceedings 1st International Conference on Agents and Artificial Intelligence (ICAART), Porto, Portugal, pp. 430–437 (2009)

    Google Scholar 

  • R.J. Davidson, Anterior cerebral asymmetry and the nature of emotion. Brain Cogn. 20(1), 125–151 (1992)

    Article  Google Scholar 

  • S.H. Fairclough, Fundamentals of physiological computing. Interact. Comput. 21(1), 133–145 (2009)

    Article  Google Scholar 

  • S.W. Gilroy, J. Porteous, F. Charles, M. Cavazza, Exploring passive user interaction for adaptive narratives, in Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces (IUI 2012) (ACM, New York, 2012), pp. 119–128

    Google Scholar 

  • S.W. Gilroy, J. Porteous, F. Charles, M. Cavazza, E. Soreq, G. Raz, L. Ikar, A. Or-Borichov, U. Ben-Arie, I. Klovatch, T. Hendler, A brain-computer interface to a plan-based narrative, in Proceedings of the Twenty-Third international joint conference on Artificial Intelligence (IJCAI ‘13), ed. by F. Rossi. (AAAI Press, Palo Alto, 1997–2005, 2013)

    Google Scholar 

  • J. Gratch, Why you should buy an emotional planner, in Proceedings 3rd International Conference on Autonomous Agents. Workshop on Emotion-Based Agent Architectures (EBAA), ACM, New York (1999)

    Google Scholar 

  • S.N. Light, J.A. Coan, C. Zahn-Waxler, C. Frye, H.H. Goldsmith, R.J. Davidson, Empathy is associated with dynamic change in prefrontal brain electrical activity during positive emotion in children. Child Dev. 80(4), 1210–1231 (2009)

    Article  Google Scholar 

  • J.-L. Lugrin, M. Cavazza, D. Pizzi, T. Vogt, E. André, Exploring the usability of immersive interactive storytelling, in Proceedings 7th ACM Symposium on Virtual Reality Software and Technology (VRST), ACM, New York, pp. 103–110 (2010)

    Google Scholar 

  • M. Mateas, A. Stern, A behavior language for story-based believable agents. IEEE Intell. Syst. 17(4), 39–47 (2002)

    Article  Google Scholar 

  • A. Mettinger, Aspects of Semantic Opposition in English (Oxford University Press, Oxford, 1994)

    Google Scholar 

  • D. Pizzi, M. Cavazza, Affective storytelling based on characters’ feelings, in Proceedings Intelligent Narrative Technologies: Papers from the AAAI Fall Symposium, AAAI Press, Palo Alto (2007)

    Google Scholar 

  • D. Pizzi, F. Charles, J.-L. Lugrin, M. Cavazza, Interactive storytelling with literary feelings, in Proceedings 2nd International Conference on Affective Computing and Intelligent Interaction (ACII), Springer-Verlag, Berlin, Heidelberg, pp. 630–641 (2007)

    Google Scholar 

  • G. Raz, Y. Winetraub, Y. Jacob, S. Kinreich, A. Maron-Katz, G. Shaham, I. Podlipsky, G. Gilam, E. Soreq, T. Hendler, Portraying emotions at their unfolding: a multilayered approach for probing dynamics of neural networks. Neuroimage 60(2), 1448–1461 (2012)

    Article  Google Scholar 

  • J. Rickel, S. Marsella, J. Gratch, R. Hill, D.R. Traum, W.R. Swartout, Toward a new generation of virtual humans for interactive experiences. IEEE Intell. Syst. 17(4), 32–38 (2002)

    Article  Google Scholar 

  • G.M. Smith, Film Structure and the Emotion System (Cambridge University Press, Cambridge, 2003)

    Book  Google Scholar 

  • T.J. Smith, D.T. Levin, J. Cutting, A window on reality: perceiving edited moving images. Curr. Dir. Psychol. Sci. 21, 107–113 (2012)

    Article  Google Scholar 

  • S.K. Sutton, R.J. Davidson, Prefrontal brain asymmetry: a biological substrate of the behavioral approach and inhibition systems. Psychol. Sci. 8(3), 204–210 (1997)

    Article  Google Scholar 

  • W. Swartout, J. Gratch, J.R. Hill, E. Hovy, S. Marsella, J. Rickel et al., Toward virtual humans. AI Magazine 27(2), 96 (2006)

    Google Scholar 

  • E.S. Tan, Emotion and the structure of narrative film: Film as an emotion machine (L. Erlbaum Associates, Mahwah, 1996)

    Google Scholar 

  • T. Vogt, E. André, N. Bee. EmoVoice – a framework for online recognition of emotions from voice, in Proceedings 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems, Springer-Verlag, Berlin, Heidelberg, pp. 188–199 (2008)

    Google Scholar 

  • N. Zagalo, A. Torres, V. Branco. Passive interactivity, an answer to interactive emotion, in Entertainment Computing (ICEC), Springer-Verlag, Berlin, Heidelberg, pp. 43–52 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electronics and Digital Arts, University of Kent, Kent, UK

    Marc Cavazza

  2. School of Computing, Teesside University, Borough Road, TS1 3BA, Middlesbrough, UK

    Fred Charles

Authors
  1. Marc Cavazza
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fred Charles
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marc Cavazza .

Editor information

Editors and Affiliations

  1. Interactive & Digital Media Institute, National University of Singapore, Singapore, Singapore

    Ryohei Nakatsu

  2. Industrial Design, Eindhoven University of Technology, Eindhoven, The Netherlands

    Matthias Rauterberg

  3. Scienze dell'Informazione, University of Bologna, Bologna, Italy

    Paolo Ciancarini

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this entry

Cite this entry

Cavazza, M., Charles, F. (2016). User Interaction for Interactive Storytelling. In: Nakatsu, R., Rauterberg, M., Ciancarini, P. (eds) Handbook of Digital Games and Entertainment Technologies. Springer, Singapore. https://doi.org/10.1007/978-981-4560-52-8_57-1

Download citation

  • DOI: https://doi.org/10.1007/978-981-4560-52-8_57-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Singapore

  • Online ISBN: 978-981-4560-52-8

  • eBook Packages: Springer Reference EngineeringReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Search

Navigation