Skip to main content

Eye-Tracking and the Visual World Paradigm

  • Chapter
  • First Online:
Designing Research on Bilingual Development

Abstract

This chapter will focus on the use of eye-tracking in the visual world paradigm. This method can be employed to investigate a number of language comprehension issues, and we will begin with a brief overview of the history of the method and some of the applications. More centrally, we will discuss how it can be used to assess the impact of cross-linguistic interference, proficiency levels, and age of onset in L2 acquisition and L1 attrition, with an introduction to the issues that are involved in designing a study using this technique. As a case in point, we present and discuss the specific experiment employed within the multi-task, multi-language and multi-lab study on which this book is based, with special attention to the issues for analysis that arise when data from multiple systems must be combined.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Targets will be presented in italics throughout.

  2. 2.

    Irrespective of the frequency of the chosen items, it is highly advisable to ensure that all participants know all of the words, see Sect. 5.3.3.

  3. 3.

    Recall that our audio files were standardized with respect to the length of the fragment that precedes the target.

  4. 4.

    Since each trial was preceded by a fixation cross, participants tended to fixate the center of the screen in the beginning of a trial.

Suggestions for Further Reading

  • Dussias, P.E., J.V. Kroff, and C. Gerfen. 2013a. Visual world eye-tracking. In Research methods in second language psycholinguistics, ed. J. Jegerski, and B. van Patten, 93–126. New York: Routledge.

    Google Scholar 

  • Ferreira, F., M. Tanenhaus. 2008. Language-vision interaction [Special issue]. Journal of Memory and Language, 57(4).

    Google Scholar 

  • Huettig, F., J. Rommers, and A.S. Meyer. 2011a. Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica 137: 151–171.

    Article  Google Scholar 

References

  • Allopenna, P.D., J.S. Magnuson, and M.K. Tanenhaus. 1998. Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language 38: 419–439.

    Article  Google Scholar 

  • Altmann, G.T.M. 2011. The mediation of eye movements by spoken language. In The oxford handbook of eye movements, ed. S.P. Liversedge, I.D. Gilchrist, and S. Everling, 979–1004. Oxford: Oxford University Press.

    Google Scholar 

  • Altmann, G.T.M., and Y. Kamide. 1999. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73: 247–264.

    Article  Google Scholar 

  • Barr, D.J. 2008. Analyzing ‘visual world’ eyetracking data using multilevel logistic regression. Journal of Memory and Language 59: 457–474.

    Article  Google Scholar 

  • Boersma, P., D. Weenink. 2012. Praat: Doing phonetics by computer (Version 5.3.08) [Computer software]. http://www.praat.org/.

  • Clifton, C., A. Staub, and K. Rayner. 2007. Eye movements in reading words and sentences. In Eye movements: A window on mind and brain, ed. R.P.G. van Gompel, M.H. Fischer, W.S. Murray, and R.L. Hill, 341–372. Amsterdam: Elsevier.

    Chapter  Google Scholar 

  • Cooper, R.M. 1974. The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology 6: 84–107.

    Article  Google Scholar 

  • Dahan, D., J.S. Magnuson, and M.K. Tanenhaus. 2001. Time course of frequency effects in spoken word recognition: Evidence from eye movements. Cognitive Psychology 42: 317–367.

    Article  Google Scholar 

  • Dahan, D., D. Swingley, M.K. Tanenhaus, and J.S. Magnuson. 2000. Linguistic gender and spoken-word recognition in French. Journal of Memory and Language 42: 465–480.

    Article  Google Scholar 

  • Duchowski, A.T. 2002. A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers 34(4): 455–470.

    Article  Google Scholar 

  • Dussias, P.E., J.V. Kroff, and C. Gerfen. 2013a. Visual world eye-tracking. In Research methods in second language psycholinguistics, ed. J. Jegerski, and B. VanPatten, 93–126. New York: Routledge.

    Google Scholar 

  • Dussias, P.E., J.R. Valdés Kroff, R.E. Guzzardo Tamargo, and C. Gerfen. 2013b. When gender and looking go hand in hand: Grammatical gender processing in L2 Spanish. Studies in Second Language Acquisition 35: 353–387.

    Article  Google Scholar 

  • Ferreira, F., A. Foucart, and P.E. Engelhardt. 2013. Language processing in the visual world: Effects of preview, visual complexity, and prediction. Journal of Memory and Language, 69(3), 165−182.

    Google Scholar 

  • Grüter, T., C. Lew-Williams, and A. Fernald. 2012. Grammatical gender in L2: A production or a real-time processing problem? Second Language Research 28: 191–215.

    Article  Google Scholar 

  • Henderson, J.M., and F. Ferreira. 2004. Scene perception for psycholinguists. In The interface of language, vision, and action, ed. J.M. Henderson, and F. Ferreira, 1–58. New York: Psychology Press.

    Google Scholar 

  • Hopp, H. 2013. Grammatical gender in adult L2 acquisition: Relations between lexical and syntactic variability. Second Language Research 29(1): 33–56.

    Article  Google Scholar 

  • Huettig, F., and J.M. McQueen. 2007. The tug of war between phonological, semantic and shape information in language-mediated visual search. Journal of Memory and Language 57(4): 460–482.

    Article  Google Scholar 

  • Huettig, F., J. Rommers, and A.S. Meyer. 2011b. Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica 137: 151–171.

    Article  Google Scholar 

  • Lew-Williams, C., and A. Fernald. 2007. Young children learning Spanish make rapid use of grammatical gender in spoken word recognition. Psychological Science 33: 193–198.

    Article  Google Scholar 

  • Lew-Williams, C., and A. Fernald. 2010. Real-time processing of gender-marked articles by native and non-native Spanish speakers. Journal of Memory and Language 63: 447–464.

    Article  Google Scholar 

  • Loerts, H., M. Wieling, and M.S. Schmid. 2013. Neuter is not common in Dutch: Eye movements reveal asymmetrical gender processing. Journal of Psycholinguistic Research 42(6): 551–570.

    Article  Google Scholar 

  • Matin, E., K.C. Shao, and K.R. Boff. 1993. Saccadic overhead: Information-processing time with and without saccades. Perception and Psychophysics 53: 372–380.

    Article  Google Scholar 

  • Mirman, D., J.A. Dixon, and J.S. Magnuson. 2008. Statistical and computational models of the visual world paradigm: Growth curves and individual differences. Journal of Memory and Language 59: 475–494.

    Article  Google Scholar 

  • McQueen, J.M., and M.C. Viebahn. 2007. Tracking recognition of spoken words by tracking looks to printed words. Quarterly Journal of Experimental Psychology 60: 661–671.

    Article  Google Scholar 

  • Oehler, H., and O.S. Gerretsen. 1973. Duitse woordenschat—Alfabetische basisvocabulaire met systematische uitbreiding. Groningen: Wolters Noordhoff.

    Google Scholar 

  • Oostdijk, N. 2000. The spoken Dutch corpus. Overview and first evaluation. In Gavralidou, M., G. Carayannis, S. Markantonatou, S. Piperidis, G. Stainhaouer (eds.), Proceedings of the second international conference on language resources and evaluation, 887−893. Paris: ELRA.

    Google Scholar 

  • Paris, G., A. Weber, and M.W. Crocker. 2006. German morphosyntactic gender and lexical access. Poster presented at the 12th annual conference on architectures and mechanisms for language processing (AMLaP 2006), Nijmegen, Netherlands.

    Google Scholar 

  • Schneider, W., A. Eschman, and A. Zuccolotto. 2002. E-Prime user’s guide. Pittsburgh: Psychology Software Tools Inc.

    Google Scholar 

  • Snodgrass, J.G., and M. Vanderwart. 1980. A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity and visual complexity. Journal of Experimental Psychology: Human Learning and Memory 6: 174–215.

    Google Scholar 

  • Spivey, M.J., and V. Marian. 1999. Cross talk between native and second languages: Partial activation of an irrelevant lexicon. Psychological Science 10: 281–284.

    Article  Google Scholar 

  • Tanenhaus, M.K., and J.C. Trueswell. 2006. Eye movements and spoken language comprehension. In Handbook of psycholinguistics, 2nd ed, ed. M. Traxler, and M. Gernsbacher, 86–900. Amsterdam: Elsevier.

    Google Scholar 

  • Tanenhaus, M.K., M.J. Spivey-Knowlton, K.M. Eberhard, and J.C. Sedivy. 1995. Integration of visual and linguistic information in spoken language comprehension. Science 268: 1632–1634.

    Article  Google Scholar 

  • Weber, A., G. Paris. 2004. The origin of the linguistic gender effect in spoken-word recognition: Evidence from non-native listening. Poster presented at the 26th Annual Meeting of the Cognitive Science Society (CogSci 2004), Chicago, IL.

    Google Scholar 

  • Wood, S. 2006. Generalized additive models: An introduction with R. Boca Raton: Chapman & Hall/CRC Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sanne M. Berends .

5.1 Electronic Supplementary Material

Below is the link to the electronic supplementary material.

Eyetracking (ZIP 1380 kb)

Rights and permissions

Reprints and permissions

Copyright information

© 2016 The Author(s)

About this chapter

Cite this chapter

Berends, S.M., Brouwer, S.M., Sprenger, S.A. (2016). Eye-Tracking and the Visual World Paradigm. In: Designing Research on Bilingual Development. SpringerBriefs in Linguistics. Springer, Cham. https://doi.org/10.1007/978-3-319-11529-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11529-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11528-3

  • Online ISBN: 978-3-319-11529-0

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics