Abstract
In this research, the author descripted new narrative media known as Immersive Augmented Reality Environment (IARE) with HoloLens. Aarseth’s narrative model [17] and all available input design in IARE were reviewed and summarised. Based on these findings, The AR Journey, a HoloLens app aiming at interactive narrative for moral education purpose, was developed and assessed. Qualitative methods of interview and observation were used and the results were analysed. In general, narrative in IARE were proved to be valid for moral education purpose, and findings including valid narrative structure, input model, design guidelines were revealed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Kindertransport was the title for historical events that British government made efforts to bring Jewish children out of Nazi Germany, occupied Austria and Czechoslovakia before the outbreak of World War II. During a nine-month period, 10,000 Jewish children aged between 1 and 17 were transported to the UK.
- 2.
Chartman claimed a kernel is the key event that makes people recognise the story and satellites refer to the constitutive and supplementary events; take away the kernel and the story is no longer the same while satellites are what can be replaced or removed while still keeping the story recognizable.
- 3.
A film terminology refers to the temporary acceptance as believable of events or characters that would ordinarily be seen as incredible. This is usually to allow an audience to appreciate works of literature or drama that are exploring unusual ideas.
- 4.
The motion controllers are hardware accessories developed by Microsoft that extend the user's physical capabilities by providing precise 6DoF tracking, several buttons and tactile feedback while using one or both hands. They are compatible with all mixed reality headset with Bluetooth.
- 5.
The HoloLens Clicker (clicker for short) is the peripheral device built specifically for HoloLens 1 & 2. It is a miniature controller that lets the user click on whatever he or she is looking at and there is a motion sensor inside to check the clicker’s up, down, left, and right.
References
Ryan, M.-L.: Narrative Across Media: The Languages of Storytelling. U of Nebraska Press (2004)
Hammady, R., Ma, M., Strathern, C., Mohamad, M.: Design and development of a spatial mixed reality touring guide to the Egyptian Museum. Multimedia Tools Appl., 1–30 (2019)
Hanna, M.G., Ahmed, I., Nine, J., Prajapati, S., Pantanowitz, L.: Augmented reality technology using microsoft HoloLens in anatomic pathology. Arch. Pathol. Lab. Med. 142(5), 638–644 (2017)
Dow, S., Mehta, M., Macintyre, B., Mateas, M.: AR façade: an augmented reality interactive drama. In: Proceedings of the 2007 ACM Symposium on Virtual Reality Software and Technology, pp. 215–216 (2007)
Busselle, R., Bilandzic, H.: Measuring narrative engagement. Media Psychol. 12(4), 321–347 (2009)
Hoffman, M.L.: Interaction of affect and cognition in empathy. Emot. Cogn. Behav., 103–131 (1984)
Saarni, C., Crowley, M.: The development of emotion regulation: effects on emotional state and expression. In: Emotions and the Family: for Better or for Worse, pp. 53–73(1990)
Obama, B., Biden, J.: Remarks by the president and the vice president on gun violence. In: The White House Office of the Press Secretary, 16 January 2013
Nikonanou, N., Bounia, A.: Digital applications in museums: an analysis from a museum education perspective. In: Karagiannidis, C., Politis, P., Karasavvidis, I. (eds.) Research on e-Learning and ICT in Education, pp. 179–194. Springer, New York (2014). https://doi.org/10.1007/978-1-4614-6501-0_13
Best, K.: Making museum tours better: understanding what a guided tour really is and what a tour guide really does. Mus. Manag. Curatorship 27(1), 35–52 (2012)
Hololens 1 Hardware Specification page. https://docs.microsoft.com/en-us/hololens/hololens1-hardware. Accessed 31 Jan 2020
Magic Leap One Homepage. https://www.magicleap.com/magic-leap-1. Accessed 31 Jan 2020
Hololens 2 Hardware Specification. https://docs.microsoft.com/en-us/hololens/hololens1-hardware. Accessed 31 Jan 2020
Microsoft’s Documentation of The Mixed Reality Toolkit (MRTK). https://microsoft.github.io/MixedRealityToolkit-Unity/README.html. Accessed 3 Jan 2020
Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)
Newton, K., Soukup, K.: The Storyteller’s Guide to the Virtual Reality Audience. The Stanford D School (2016)
Aylett, R., Louchart, S.: Towards a narrative theory of virtual reality. Virtual Reality 7(1), 2–9 (2003)
Aarseth, E.: A narrative theory of games. In: Proceedings of the International Conference on the Foundations of Digital Games, pp. 129–133. ACM (2012)
Austin, T.R., Chatman, S.: Story and Discourse: Narrative Structure in Fiction and Film. Cornell University Press, New York (1980)
Microsoft’s Documentation of Direct Manipulation with Hands. https://docs.microsoft.com/en-us/windows/mixed-reality/direct-manipulation. Accessed 31 Jan 2020
Microsoft’s Documentation of Motion Controllers. https://docs.microsoft.com/en-us/windows/mixed-reality/motion-controllers. Accessed 31 Jan 2020
Microsoft’s Documentation of Hand Gestures. https://docs.microsoft.com/en-us/windows/mixed-reality/gaze-and-commit#composite-gestures. Accessed 31 Jan 2020
Microsoft’s Documentation of Voice Input. https://docs.microsoft.com/en-us/windows/mixed-reality/voice-input. Accessed 31 Jan 2020
Microsoft’s Documentation of Eye-gaze-based Interaction. https://docs.microsoft.com/en-us/windows/mixed-reality/eye-gaze-interaction. Accessed 31 Jan 2020
Mixed Reality Interaction Models Documentation from Microsoft. https://docs.microsoft.com/en-us/windows/mixed-reality/interaction-fundamentals. Accessed 31 Jan 2020
O’Brien, D., Lawless, K.A., Schrader, P.: A taxonomy of educational games. In: Gaming for Classroom-Based Learning: Digital Role Playing as a Motivator of Study, pp. 1–23 (2010)
Ferguson, C.J.: Violent video games and the Supreme Court: lessons for the scientific community in the wake of brown v. entertainment merchants association. Am. Psychol. 68(2), 57 (2013)
Lemola, S., Brand, S., Vogler, N., Perkinson-Gloor, N., Allemand, M., Grob, A.: Habitual computer game playing at night is related to depressive symptoms. Pers. Individ. Differ. 51(2), 117–122 (2011)
Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995)
McAuley, E., Duncan, T., Tammen, V.V.: Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: a confirmatory factor analysis. Res. Q. Exerc. Sport 60(1), 48–58 (1989)
Saldaña, J.: The Coding Manual for Qualitative Researchers. Sage, Thousand Oaks (2015)
Acknowledgement
This work was jointly funded by the National Key Research and Development Program of China (2018 YFB1004903) and Staffordshire University in the UK. We would also like to acknowledge the support from Jake Lynch for script development and the support from Elinor Rosa Williams, Zhang Nan, Zhang Zian, Yu Guodong for motion capture.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Jin, Y., Ma, M., Liu, Y. (2020). Interactive Narrative in Augmented Reality: An Extended Reality of the Holocaust. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications. HCII 2020. Lecture Notes in Computer Science(), vol 12191. Springer, Cham. https://doi.org/10.1007/978-3-030-49698-2_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-49698-2_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49697-5
Online ISBN: 978-3-030-49698-2
eBook Packages: Computer ScienceComputer Science (R0)