Abstract
This paper presents a study of iconic gestures as attested in a corpus of Greek face-to-face television interviews. The communicative significance of the iconic gestures situated in an interactional context is examined with regards to their semantics as well as the syntactic properties of the accompanying speech. Iconic gestures are classified according to their semantic equivalents, and are further linked to the phrasal units of the words co-occurring with them, in order to provide evidence about the actual syntactic structures that induce them. The findings support the communicative power of iconic gestures and suggest a framework for their interpretation based on the interplay of semantic and syntactic cues.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ekman, P., Friesen, W.V.: The Repertoire of Nonverbal Behaviour: Categories, Origins,Usage and Coding. Semiotica 1, 49–98 (1969)
Kendon, A.: Gesture: Visible Action as Utterance. Cambridge University Press (2004)
McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)
Özyürek, A.: The Role of Iconic Gestures in Production and Comprehension of Language: Evidence from Brain and Behavior. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS, vol. 5934, pp. 1–10. Springer, Heidelberg (2010)
Holler, J., Beattie, G.: A micro-analytic investigation of how iconic gesture and speech represent core semantic features in talk. Semiotica 142, 31–69 (2002)
Kita, S., Özyürek, A.: What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language 48, 16–32 (2003)
Beattie, G., Shovelton, H.: Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology 18, 438–462 (1999b)
Beattie, G., Shovelton, H.: An experimental investigation of the role of different types of iconic gesture in communication: A semantic feature approach. Gesture 1, 129–149 (2001)
Holler, J., Beattie, G.: The Interaction of Iconic Gesture and Speech in Talk. In: Camurri, A., Volpe, G., et al. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 63–69. Springer, Heidelberg (2004)
Holler, J., Shovelton, H., Beattie, G.: Do iconic hand gestures really contribute to the communication of semantic information in a face-to-face context? Journal of Nonverbal Behavior 33, 73–88 (2009)
Koutsombogera, M., Papageorgiou, H.: Multimodality Issues in Conversation Analysis of Greek TV Interviews. In: Esposito, A., Hussain, A., Marinaro, M., Martone, R. (eds.) Multimodal Signals. LNCS (LNAI), vol. 5398, pp. 40–46. Springer, Heidelberg (2009)
Holler, J., Beattie, G.: The Interaction of Iconic Gesture and Speech in Talk. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 63–69. Springer, Heidelberg (2004)
Beattie, G., Shovelton, H.: An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology 93, 179–192 (2002)
Beattie, G., Shovelton, H.: What properties of talk are associated with the generation of spontaneous iconic hand gestures? British Journal of Social Psychology 41(3), 403–417 (2002)
Holler, J., Beattie, G.: Pragmatic aspects of representational gestures: Do speakers use them to clarify verbal ambiguity for the listener? Gesture 3, 127–154 (2003)
Heritage, J.: Conversation Analysis and Institutional Talk. In: Sanders, R., Fitch, K. (eds.) Handbook of Language and Social Interaction, pp. 103–146. Lawrence Erlbaum, New Jersey (2005)
Ilie, C.: Semi-institutional Discourse: The Case of Talk Shows. Journal of Pragmatics 33, 209–254 (2001)
Bunt, H., Alexandersson, J., Carletta, J., Choe, J.-W., Fang, A.C., Hasida, K., Lee, K., Petukhova, V., Popescu-Belis, A., Romary, L., Soria, C., Traum, D.R.: Towards an ISO Standard for Dialogue Act Annotation. In: Language Resources and Evaluation Conference, LREC 2010-ELRA (2010)
W3C Incubator Group: Emotion Markup Language – Working Draft (2009), http://www.w3.org/TR/2009/WD-emotionml-20091029/
Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The MUMIN Coding Scheme for the Annotation of Feedback, Turn Management and Sequencing Phenomena. Multimodal Corpora for Modeling Human Multimodal Behaviour. Journal on Language Resources and Evaluation 41(3-4), 273–287 (2007)
Poggi, I., Magno Caldognetto, E.: A Score for the Analysis of Gestures in Multimodal Communication. In: Messing, L.S. (ed.) Proceedings of the Workshop on the Integration of Gesture and Language in Speech, Applied Science and Engineering Laboratories, pp. 235–244. Newark and Wilmington, Delaware (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Koutsombogera, M., Papageorgiou, H. (2012). Iconic Gestures in Face-to-Face TV Interviews. In: Efthimiou, E., Kouroupetroglou, G., Fotinea, SE. (eds) Gesture and Sign Language in Human-Computer Interaction and Embodied Communication. GW 2011. Lecture Notes in Computer Science(), vol 7206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34182-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-34182-3_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34181-6
Online ISBN: 978-3-642-34182-3
eBook Packages: Computer ScienceComputer Science (R0)