Skip to main content

Attention Allocation with Overlapping Sound, Image, and Text

  • Chapter
Eye Movements and Visual Cognition

Part of the book series: Springer Series in Neuropsychology ((SSNEUROPSYCHOL))

Abstract

In daily life people are often confronted with more than one source of information at a time, as, for example, when watching television. A television program has at least two channels of information: a visual one (the image) and an auditory one (the sound). In some countries most of the television programs are imported from abroad and subtitled in the native language. The subtitles, then, are a third source of information. Characteristically, each of these three sources of information are partly redundant: they do not contradict but rather supplement one another, or express the same content in a different form.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Baker, R.G. (1981). Guidelines for the subtitling of television programmes for the deaf and hard of hearing. Southampton, UK: Southampton University.

    Google Scholar 

  • Broadbent, D.E. (1958). Perception and communication. Oxford: Pergamon Press.

    Book  Google Scholar 

  • Craik, F.I.M., & Rabinowitz, J.C. (1984). Age differences in the use and acquisition of visual information: A tutorial review. In H. Bouma & D.G. Bouwhuis (Eds.), Attention and performance. Vol. X: Control of language processes (pp. 471–499). London: Erlbaum.

    Google Scholar 

  • D’Ydewalle, G., Praet, C., Verfaillie, K., & Van Rensbergen, J. (1991). Choosing between redundant information channels: Speech and text. Communication Research, 18, 650–666.

    Article  Google Scholar 

  • D’Ydewalle, G., & Van Rensbergen, J. (1989). Developmental studies of text-picture interaction in the perception of animated cartoons with text. In H. Mandl & J.R. Levin (Eds.), Knowledge acquisition from text and pictures (pp. 223–248). Amsterdam: Elsevier Science Publishers B.V. (North-Holland).

    Google Scholar 

  • D’Ydewalle, G., Van Rensbergen, J., & Pollet, J. (1987). Reading a message when the same message is available auditorily in another language: The case of subtitling. In J.K. O’Regan & A. Lévy-Schoen (Eds.), Eye movements: From physiology to cognition (pp. 313–321). Amsterdam: Elsevier Science Publishers B.V. (North-Holland).

    Google Scholar 

  • D’Ydewalle, G., Warlop, L., & Van Rensbergen, J. (1989). Differences between young and older adults in the division of attention over different sources of TV information. Medienpsychologie: Zeitschrift für Individual- und Massenkommunikation, 1, 42–57.

    Google Scholar 

  • Gielen, I. (1988). Het verwerken van ondertitels in functie van de taalkennis van de klankband en typen van informatie in het beeld [The processing of subtitles in function of the knowledge of the language used in the soundtrack and types of information on the screen]. Unpublished thesis, University of Leuven, Leuven.

    Google Scholar 

  • Gielen, M. (1988). Perceptie en ondertitels: De parafoveale en perifere informatieverwerking van ondertitels [Perception and subtitles: Parafoveal and peripheral processing of subtitles]. Unpublished thesis, University of Leuven, Leuven.

    Google Scholar 

  • McConkie, G.W., & Rayner, K. (1975). The span of effective stimulus during a fixation in reading. Perception & Psychophysics, 17, 578–586.

    Article  Google Scholar 

  • Muylaert, W., Nootens, J., Poesmans, D., & Pugh, A.K. (1983). Design and utilisation of subtitles on foreign language television programmes. In P.H. Neide (Ed.), Theorie, Methoden und Modelle der Kontaktlinguistik (pp. 201–214). Bonn: Dummler.

    Google Scholar 

  • Nederlandse Omroep Stichting (1977). De behoeften van doven en slechthorenden aan ondertiteling van Nederlandstalige televisieprogramma’s [The need of deaf and hard of hearing people for subtitled Dutch television programs]. (Research Rep. No. R77.194). Hilversum, the Netherlands.

    Google Scholar 

  • Praet, C, Verfaillie, K., De Graef, P., Van Rensbergen, J., & d’Ydewalle, G. (1990). A one line text is not half a two line text. In R. Groner, G. d’Ydewalle, & R. Parham (Eds.), From eye to mind: Information acquisition in perception, search, and reading (pp. 205–213). Amsterdam: Elsevier Science Publishers B.V. (North-Holland).

    Google Scholar 

  • Rayner, K., & Pollatsek, A. (1989). The psychology of reading. Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • Sohl, G. (1989). Het verwerken van de vreemdtalige gesproken tekst in een ondertiteld TV-programma [Processing a foreign spoken text in a subtitled television program]. Unpublished thesis, University of Leuven, Leuven.

    Google Scholar 

  • Tonla Briquet, G. (1979). Investigation into the subtitling of film and TV. Unpublished thesis, Brussels: Higher Governments Institute for translators and interpreters.

    Google Scholar 

  • Treisman, A. (1968). Strategies and models of selective attention. Psychological Review, 84, 127–190.

    Google Scholar 

  • Verfaillie, K., & d’Ydewalle, G. (1987). Modality preference and message comprehension in deaf youngsters watching TV. (Psychological Reports No. 70). Leuven: University of Leuven, Laboratory of Experimental Psychology.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer-Verlag New York Inc.

About this chapter

Cite this chapter

d’Ydewalle, G., Gielen, I. (1992). Attention Allocation with Overlapping Sound, Image, and Text. In: Rayner, K. (eds) Eye Movements and Visual Cognition. Springer Series in Neuropsychology. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-2852-3_25

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-2852-3_25

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4612-7696-8

  • Online ISBN: 978-1-4612-2852-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics