Abstract
In this article, we explain how to process and interpret stage directions in order to support actors’ performances. To this end, we specify the function of coverbal gesture and movement as an additional statement by an actor. We introduce a classification of communicative gestures by individuals and groups based on a description with typical body triangles and their sensor-detectable vertices moving in time. We claim that with the help of a speech and gesture recognition system, the occurrence of semantic isotopies to characterize a scene with speech and accompanying metaphoric gestures described in the stage directions can be detected and encoded in a feature vector. As a proof of concept, we highlight the ritual theater play Orphée d’Afrique, which was written as a second part of a homonymous chant novel and presents an implementation of a gesture- and voice-detection cuing system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cosnier, J., Vaysse, J.: Semiotics of communicative gestures. New Semiot. Acts 52, 7–28 (1997)
Eco, U.: Two problems in textual interpretation. Poet. Today 2(1a), 145–161 (1980). Roman Jakobson: Language and Poetry
Gallèpe, Th.: Joindre le corps à la parole: Quelle place pour le corps dans les textes de théâtre? Université Michel de Montaigne, Bordeaux, Cahier du C.I.E.L. Paris (1998–1999)
Gibbon, D., Gut, U., Hell, B., Looks, K., Thies, A., Trippel, Th.: A computational model of arm gestures in conversation. In: Proceedings of Eurospeech, Geneva, pp. 813–816 (2003)
Greimas, A.J.: Sens, Semiotic Essays. Seuil, Paris (1970)
Hourantier, M.-J.(Manuma ma Njock): Orphée d’Afrique: théâtre-rituel d’initiation, Paris, L’Harmattan (1981). Together with Liking W.: Orphée Dafric, chant novel
Jessop, E.A.: A gestural media framework: tools for expressive gesture recognition and mapping in rehearsal and performance. B.A., Amherst College (2008)
Lascarides, A., Stone, M.: A Formal semantic analysis of gesture. J. Semant. 26(4), 393–449 (2009)
Lüngen, H., Sperberg-McQueen, C.M.: A TEI P5 document grammar for the IDS text model. J. Text Encoding Initiat. 3 (2012). http://journals.openedition.org/jtei/508
Luther, A.C.: Werewere Liking – Ritual und Schreiben: A Critical Debate in Africa and Latin America. Peter Lang (2017). (in German)
McIntosh, J., Marzo, A., Fraser, M., Phillips, C.: EchoFlex: hand gesture recognition using ultrasound imaging. In: Proceedings of CHI 2017, CHI Conference on Human Factors in Computing Systems, pp. 1923–1934. ACM, New York (2017)
Ronfard, R., Encelle, B., Sauret, N., Champin, P.-A., Steiner, Th., et al.: Capturing and indexing rehearsals: the design and usage of a digital archive of performing arts. In: Digital Heritage, Grenade, Spain, September 2015, pp. 533–540. IEEE (2015)
Sasaki, K., Inoue, T.: Coordinating real-time serial cooperative work by cuing the order in the case of theatrical performance practice. Mob. Inf. Syst. 2019 (2019). Article ID 4545917, 10 pages
Shimada, M., Takano, T., Shigeno, H., Okada, K.: Supporting theatrical performance practice by collaborating real and virtual space. In: Yoshino, T., Chen, G.-D., Zurita, G., Yuizono, T., Inoue, T., Baloian, N. (eds.) CollabTech 2016. CCIS, vol. 647, pp. 17–30. Springer, Singapore (2016). https://doi.org/10.1007/978-981-10-2618-8_2
Takatsu, R., Katayama, N., Inoue, T., Shigeno, H., Okada, K.: A wearable action cueing system for theatrical performance practice. In: Yoshino, T., Chen, G.-D., Zurita, G., Yuizono, T., Inoue, T., Baloian, N. (eds.) CollabTech 2016. CCIS, vol. 647, pp. 130–145. Springer, Singapore (2016). https://doi.org/10.1007/978-981-10-2618-8_11
TEI P 5 Release, TEI P5: Guidelines for Electronic Text Encoding and Interchange. http://www.tei-c.org/guidelines/p5/
Trippel, Th., et al.: CoGesT: a formal transcription system for conversational gesture. In: Proceedings of IRES, pp. 2215–2218 (2004)
Ubersfeld, A.: Lire le théâtre I, Belin Lettres Sup. (1996). 240p. English version Reading theatre. Toronto Press (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Sasaki, K., Luther, AC., Inoue, T., Luther, W. (2019). An Automated Structural Approach to Support Theatrical Performances by Introducing Gesture Recognition to a Cuing System. In: Nakanishi, H., Egi, H., Chounta, IA., Takada, H., Ichimura, S., Hoppe, U. (eds) Collaboration Technologies and Social Computing. CRIWG+CollabTech 2019. Lecture Notes in Computer Science(), vol 11677. Springer, Cham. https://doi.org/10.1007/978-3-030-28011-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-28011-6_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-28010-9
Online ISBN: 978-3-030-28011-6
eBook Packages: Computer ScienceComputer Science (R0)