Abstract
This paper describes the TKB project (A Transmedia Knowledge-Base for the performing arts), an international research project running in Portugal since 2009 at the New University of Lisbon. While focusing on the development of a digital note-book for video annotation in real-time, designated as Creation-Tool we will describe two original software applications developed in the framework of this project: a video annotator designed as a digital note-book for real time composition processes; and an archival platform towards an open and collaborative Knowledge-Base for the documentation of performing arts.
We will also explain the collaboration process between choreographers, linguists and software programmers during the iterative design and test phases of the annotation-tool.
By trying to converge methodologies from Cognitive Linguistics, New Media and performance studies, thus attempting to achieve a rich interdisciplinary dialogue, we show how video annotation practices, using both verbal language, and touch-pen drawings or customizable marks over the videos, contribute significantly to analytical processes of performing arts creations and to their documentation and transmission.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cabral, D., Valente, J., Aragão, U., Fernandes, C., Correia, N.: Evaluation of a multimodal video annotator for contemporary dance. In: Proceedings of International Conference of Advanced Visual Interfaces (AVI 2012), pp. 572–579. ACM Digital Library, New York (2012)
Cabral, D., Valente, J., Silva, J., Aragão, U., Fernandes, C., Correia, N.: A creation-tool for contemporary dance using multimodal video annotation. In: Proceedings of 19th ACM Int. Conference on Multimedia (MM 2011), pp. 905–908. ACM Digital Library, Scottsdale (2012)
Cabral, D., Carvalho, U., Silva, J., Valente, J., Fernandes, C., Correia, N.: Multimodal video annotation for contemporary dance creation. In: Proceedings of Annual Conference on Human Factors in Computing Systems (CHI EA 2011), pp. 2293–2298. ACM Digital Library, Vancouver (2011)
Calbris, G.: Elements of Meaning in Gesture. John Benjamins, Amsterdam (2011)
Cienki, et al. (eds.): Metaphor and Gesture. John Benjamins, Amsterdam (2008)
DeLahunta, S.: Choreographic Resources: agents, archives, scores and installations. Performance Research. On Choreography 13(1), 131–133 (2010)
Fernandes, C., Jürgens, S.: Transdisciplinary research bridging cognitive linguistics and digital performance: from multimodal corpora to choreographic knowledge-bases. In: Performing Technology: User Content and the New Digital Media, pp. 19–33. Cambridge Scholars Publishing, Newcastle upon Tyne (2010)
Fernandes, C., Costa, R.: Looking for the linguistic knowledge behind the curtains of contemporary dance: the case of Rui Horta’s creative process. Art, Brain and Language. Special Issue of International Journal of Arts and Technology 3(2/3), 235–250 (2010)
Forceville, C., Urios-Aparisi, E. (eds.): Multimodal Metaphor. Mouton de Gruyter, Berlin (2009)
Forceville, C.: Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. In: Kristiansen, G., et al. (eds.) Cognitive Linguistics: Current Applications and Future Perspectives, pp. 379–402. Mouton de Gruyter, Berlin (2006)
Hall, E.: The Hidden Dimension. Doubleday, New York (1966)
Haviland, J.: Pointing, gesture spaces and mental maps. In: McNeill, D. (ed.) Language and Gesture, pp. 13–46. CUP, Cambridge (2000)
Jürgens, S.: A Methodology for Bi-directional Transfer Between Contemporary Dance and New Media Technologies. Faculdade de MotricidadeHumana. Lisbon, Universidade Técnica de Lisboa. PhD thesis (2011)
Kendon, A.: Conducting Interaction. CUP, Cambridge (1990)
Lakoff, G.: The contemporary theory of metaphor. In: Ortony, A. (ed.) Metaphor and Thought, 2nd edn., pp. 202–251. Cambridge University Press, Cambridge (1993)
Lycouris, S.: Choreographic Environments: new technologies and movement-related artistic work. In: Butterworth, J., Wildschut, L. (eds.) Contemporary Choreography: A Critical Reader, pp. 346–361. Taylor & Francis Ltd., London (2009)
Müller, C., Chienki, A.: Words, gestures and beyond: Forms of multimodal metaphor in the use of spoken language. In: Forceville, C., Urios-Aparisi, E. (eds.) Multimodal Metaphor, pp. 297–328. Mouton de Gruyter, Berlin (2009)
Müller, C., Cienki, A., Fricke, E., Ladewig, S.H., McNeill, D., Teßendorf, S. (eds.): Body, Language, and Communication: Handbücher zur Sprach- und Kommunikationswissenschaft/Handbooks of Linguistics and Communication Science. Mouton de Gruyter, Berlin and New York (2012)
Nigten, A.: Processpatching - Defining New Methods in aRT&D. Ph.D. thesis, London, SMARTlab Programme in Performative New Media Arts, University of the Arts (2006)
Özyürek, A.: ‘Do speakers design their co-speech gestures for their addressees? Journal of Memory and Language 46(4), 688–704 (2002)
Sweetser, E., Sizemore, M.: Personal and interpersonal gesture spaces. In: Tyler, A., Kim, Y., Takada, M. (eds.) Language in the Context of Use, pp. 31–58. Mouton de Gruyter, Berlin (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernandes, C. (2013). The TKB Project: Creative Technologies for Performance Composition, Analysis and Documentation. In: Nesi, P., Santucci, R. (eds) Information Technologies for Performing Arts, Media Access, and Entertainment. ECLAP 2013. Lecture Notes in Computer Science, vol 7990. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40050-6_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-40050-6_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40049-0
Online ISBN: 978-3-642-40050-6
eBook Packages: Computer ScienceComputer Science (R0)