Abstract
This exploratory research has taken a set of theoretical concepts as the basis for testing a visualisation of body-centric gesture space: 1). Kendon’s transactional segments, 2). the manubrium as a central anatomical marker for bodily movement, and 3). physical reach space. Using these, a 3D model of gesture space has been designed in order to be applied to empirical data from architects design meetings, articulating the role of gesture space overlaps within the interaction.
Multi-dimensional drawing techniques have resulted in detailed visualisations of these overlaps. Illustrations show that the dialogue contributions can be mapped to distinct locations in the changing shared spaces, creating a spatial framework for the analysis and visualisation of the multi-dimensional topology of the interaction. This paper discusses a Case Study where this type of modelling can be applied empirically, indexing speech and gesture to the drawing subspaces of a group of architects.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Battersby, S.A.: Moving Together: The organisation of non-verbal cues during multiparty conversation. PhD Thesis, Queen Mary, London (2011)
Battersby, S.A., Healey, P.G.T.: Inhabiting 3D Interaction Spaces, at Language Communication and Cognition, Brighton (2008)
Healey, P.G.T., Peters, C.R.: The Conversational Organisation of Drawing. In: First International Workshop on Pen-Based Learning Technologies - Enabling Advanced Graphical, Multimodal and Mobile Learning Interactions (PLT 2007). IEEE, Italy (2007)
Healey, P.G.T., Battersby, S.A.: The Interactional Geometry of a Three-way Conversation. In: Proceedings of the 31st Annual Conference of the Cognitive Science Society, pp. 785–790 (2009)
Clark, H.H., Krych, M.A.: Speaking while monitoring addressees for understanding. Journal of Memory and Language 50(1), 62–81 (2004)
Goodwin, C.: The interactive construction of a sentence in natural conversation. In: Psathas, G. (ed.) Everyday language: Studies in Ethnomethodology, pp. 97–121. Irvington Publishers (1979)
Heath, C., Luff, P.: Collaboration and control: crisis management and multimedia technology in London Underground control room. Computer Supported Cooperative Work 1, 69–94 (1992)
Kendon, A.: Movement coordination in social interaction: Some examples described. Acta Psychologica 32, 100–125 (1970)
Murphy, K.M.: Collaborative Imagining: the interactive use of gestures, talk, and graphical representation in architectural practice. Semiotica 2005, 113–145 (2005)
McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press (1992)
McNeill, D., Pedelty, L.L.: Right brain and gesture. Language, gesture, and space (1995)
McNeill, D.: Language and Gesture. Cambridge University Press (2000)
Haviland, J.B.: Pointing, gesture spaces, and mental maps. In: McNeill, D. (ed.) Language and Gesture, p. 13. Cambridge University Press, Cambridge (2000)
Haviland, J.B.: How to point in Zinacantan, in Pointing: Where language, cognition and culture meet. Lawrence Erlbaum Associates (2003)
Klima, E.S., Bellugi, U.: From gesture to sign: deixis in a visual-gestural language. John Wiley and Sons, Ltd. (1982)
Pfeiffer, T.: Understanding Multimodal Deixis with Gaze and Gesture in Conversational Interfaces. PhD Thesis, Bielefeld University (2010)
Pfeiffer, T., Mattar, N.: Benefits of Locating Overt Visual Attention in Space Using Binocular Eye Tracking for Mixed Reality Applications. In: Virtual Reality Conference, VR 2008, Logos Berlin, pp. 1–3. IEEE (2009)
Streeck, J.: Gesturecraft: The manufacture of meaning. The University of Texas, Austin [Gesture Studies, 2] (2009)
Bressem, J., Ladewig, S.H.: Rethinking gesture phases: Articulatory features of gestural movement? Semiotic 184(1/4), 53–91 (2011)
Ladewig, S.H.: Putting the cyclic gesture on a cognitive basis. Accessed 27-6-2011, at cognitextes.revues.org (2011)
Bressem, J.: Notating gestures: Proposal for a form based notation system of coverbal gestures (2008) (unpublished manuscript), http://www.janabressem.de (August 23, 2011)
Narasimhan, K.P.: Towards modelling spatial cognition for intelligent agents. In: ECCE 2011 Proceedings of the 29th Annual European Conference on Cognitive Ergonomics (2011)
Nguyen, N., Wachsmuth, I.: From Body Space to Interaction Space-Modeling Spatial Cooperation for Virtual Humans. In: Tumer, Yolum, Sonenberg, Stone (eds.) Proc. of 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), Taipei, Taiwan, May 2-6, pp. 1047–1054. Nhung Nguyen and Ipke Wachsmuth (2011)
Berti, A., Frassinetti, F.: When far becomes near: remapping of space by tool use. Journal of Cognitive Neuroscience 12(3), 415–420 (2000)
Holmes, N.P., Spence, C.: The body schema and the multisensory representation(s) of peripersonal space. Cognitive Processes 5(2), 94–105 (2004)
Cortlett, E.N., Clark, T.S.: The Ergonomics of Workspaces and Machines: A Design Manual. CRC Press, Florida (1995)
Efron, D.: Gesture, Race, and Culture. King’s Crown Press, New York (1941)
Murphy, K.M.: Building Meaning in Interaction: Rethinking Gesture Classifications. Crossroads of Language, Interaction, and Culture 5, 29–47 (2003)
Fricke, E.: Origo, pointing, and conceptualization: what gestures reveal about the nature of the origo in face-to-face interaction. In: Lenz, F. (ed.) Deictic Conceptualisation of Space, Time, and Person (2003)
Kendon, A.: Gesture: Visible Actions as Utterance. Cambridge University Press (2004)
Goodwin, C.: Gesture, aphasia, and interaction. In: McNeill, D. (ed.) Language and Gesture, pp. 84–98. Cambridge University Press (2000)
Goodwin, C., et al.: Pointing: where language, culture, and cognition meet, Mahwah, New Jersey (2003)
Murphy, K.M.: Building Meaning in Interaction: Rethinking Gesture Classifications. Crossroads of Language, Interaction, and Culture 5, 29–47 (2003)
Gill, S.P.: Engagement Space: The Body in Parallel and Sequential Time and Space. Submitted to the website of, Gesture the Living Medium, Austin, Texas (undated)
Ozyurek, A.: The influence of addressee location on spatial language and representational gestures of direction. In: Language and Gesture. Cambridge University Press (2000)
Ozyurek, A.: Do Speakers Design Their Co-speech Gestures for Their Addressees? The Effects of Addressee Location on Representational Gestures. Journal of Memory and Language 46, 688–704 (2002)
Furuyama, N.: Gestural interaction between the instructor and the learner in origami instruction. In: McNeill, D. (ed.) Language and Gesture, pp. 99–117. Cambridge University Press, Cambridge (2000)
Furuyama, N.: The Semiotic Making of Speech and Gesture and How It Contributes to the Structuring of Discourse. Cognitive Studies 7(1), 71–77 (2000)
Furuyama, N.: Prolegomena of a theory of between-person coordination of speech and gesture. International Journal of Human-Computer Studies 57, 347–374 (2002)
Latour, B.: Visualisation and Cognition: Drawing things together (1983), http://www.bruno-latour.fr (retrieved July 30, 2010)
Heath C.P.R.: 3D Paper. In: Explorations in Spatiality: Spatiality in Design, University of Leeds, Department of Computing (2006)
Willis, K.D.D., Lin, J., Mitani, J., Igarashi, T.: Spatial Sketch: Bridging Between Movement & Fabrication. In: TEI 2010, Cambridge, Massachusetts, January 24-27 (2010)
Duncan, S.: Annotative Practice (Under Perpetual Revision) Due to Susan Duncan (Revision of D. McNeill, Gesture & Thought, Appendix) (2005)
Duncan, S.: Coding Manual: McNeill Lab coding methods, mcneilllab.uchicago.edu (accessed August 6, 2011)
Kendon, A.: Spatial organisation of social encounters: the F-formation system. In: Conducting Interaction; Patterns of Behaviour in Focussed Encounters, CUP (1990)
McNeill, D.: Growth Points and Modeling, University of Chicago (powerpoint, undated, post 2005)
Healey, P.G.T., Heath, C.P.R.: Arranging Conversations in Space: Topologies for Interaction. IPrA, Birmingham (2011)
Rodrigues, I.G.: Gesture Space and Gesture Choreography in European Portuguese and African Portuguese Interactions: A Pilot Study of Two Cases. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS, vol. 5934, pp. 23–33. Springer, Heidelberg (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Heath, C.P.R., Healey, P.G.T. (2012). Making Space for Interaction: Architects Design Dialogues. In: Efthimiou, E., Kouroupetroglou, G., Fotinea, SE. (eds) Gesture and Sign Language in Human-Computer Interaction and Embodied Communication. GW 2011. Lecture Notes in Computer Science(), vol 7206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34182-3_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-34182-3_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34181-6
Online ISBN: 978-3-642-34182-3
eBook Packages: Computer ScienceComputer Science (R0)