Skip to main content
SpringerLink
Log in

Assessment of Immigrant Students’ Listening Comprehension in Their First Languages (L1) Russian and Turkish in Grade 9: Test Construction and Validation

  • Chapter
  • First Online:
Methodological Issues of Longitudinal Surveys

Abstract

In large-scale studies, immigrant students’ first-language (L1) proficiency is typically measured with subjective instruments, such as self-reports, rather than with objective tests. The National Educational Panel Study (NEPS) addresses this methodological limitation by testing the L1 proficiency of the two largest immigrant groups in Germany, namely students whose families have immigrated to Germany from the area of the Former Soviet Union or Turkey. Listening comprehension tests in Russian and Turkish were developed for this purpose. The current paper describes the general framework and requirements for testing first-language proficiency within the NEPS and describes the construction of the L1 tests for 9th-Grade students. Subsequently, the paper reports on analyses of measurement equivalence indicating that the Russian and Turkish tests assess the same construct (configural equivalence). The ability scores and their correlations with other variables are, however, not directly comparable. Analyses of construct validity confirm the unidimensional structure expected for the test. In addition, the L1 test scores correlate with other indicators of L1 proficiency as well as with factors regarded as crucial for L1 acquisition, such as exposure to L1, in the expected way (convergent validity), and they are not substantially related to measures of general cognitive abilities (discriminant validity). We conclude that the listening comprehension tests developed in the NEPS are valid measures of L1 proficiency.

The content of this article significantly overlaps with the following publication; parts of the text have been incorporated verbatim without any further indication: Edele, A., Schotte, K., & Stanat P. (2015). Listening comprehension tests of immigrant students’ first languages (L1) Russian and Turkish in grade 9: Extended report of test construction and validation. (NEPS Working Paper No. 57). Bamberg: University of Bamberg, National Educational Panel Study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adesope, O. O., Lavin, T., Thompson, T., & Ungerleider, C. (2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80, 207-249. doi: 10.3102/0034654310368803

    Google Scholar 

  • Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716 – 722.

    Google Scholar 

  • Anderson, J. R. (1995). Cognitive psychology and its implications. New York: Freeman.

    Google Scholar 

  • Aßmann, C., Steinhauer, H. W., Kiesl, H., Koch, S., Schönberger, B., Müller-Kuller, A., … Blossfeld, H.-P. (2011). Sampling designs of the National Educational Panel Study: Challenges and solutions. In H.-P. Blossfeld, H.-G. Roßbach, & J. von Maurice (Eds.), Zeitschrift für Erziehungswissenschaft, 14. Education as a lifelong process: The German National Educational Panel Study (NEPS) (pp. 1 – 65). Wiesbaden: VS Verlag für Sozialwissenschaften.

    Google Scholar 

  • Berry, J. W., Phinney, J. S., Sam, D. L., & Vedder, P. (2006). Immigrant youth: Acculturation, identity, and adaptation. Applied Psychology: An international review, 55, 303–332. doi: 10.1111/j.1464-0597.2006.00256.x

    Google Scholar 

  • Bialystok, E. (2007). Cognitive effects of bilingualism: How linguistic experience leads to cognitive change. The International Journal of Bilingual Education and Bilingualism, 10(3), 210 – 223.

    Google Scholar 

  • Blossfeld, H.-P., Roßbach, H.-G., & von Maurice, J. (Eds.). (2011). Education as a lifelong process: The German National Educational Panel Study (NEPS) [Special issue]. Zeitschrift für Erziehungswissenschaft, 14. Wiesbaden: VS Verlag für Sozialwissenschaften.

    Google Scholar 

  • Blossfeld, H.-P., von Maurice, J., & Schneider, T. (2011). The National Educational Panel Study: Need, main features, and research potential. In H.-P. Blossfeld, H.-G. Roßbach, & J. von Maurice (Eds.), Zeitschrift für Erziehungswissenschaft, 14. Education as a lifelong process: The German National Educational Panel Study (NEPS) (pp. 5 – 17). Wiesbaden: VS Verlag für Sozialwissenschaften.

    Google Scholar 

  • Bortz, J., & Döring, N. (2002). Forschungsmethoden und Evaluation: Für Human- und Sozialwissenschaftler. Heidelberg: Springer.

    Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the Multitrait-Multimethod-Matrix. Psychological Bulletin, 56(2), 81–105.

    Google Scholar 

  • Chiswick, B. R., & Miller, P. W. (2001). A model of destination language acquisition: Application to male immigrants in Canada. Journal of Political Economy, 38(3), 391–409.

    Google Scholar 

  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281 – 302.

    Google Scholar 

  • Cummins, J. (2000). Language, power and pedagogy: Bilingual children in the crossfire (Books Opinion Papers No. ED446442). Clevedeon: Multilingual Matters Ltd., UTP.

    Google Scholar 

  • Dollmann, J., & Kristen, C. (2010). Herkunftssprache als Ressource für den Schulerfolg ?—Das Beispiel türkischer Grundschulkinder. In C. Allemann-Ghionda, P. Stanat, K. Göbel, & C. Röhner (Eds.), Zeitschrift für Pädagogik, Beiheft, 55, 123–146.

    Google Scholar 

  • Duursma, E., Romero-Contreras, S., Szuber, A., Proctor, P., Snow, C., August, D., & Calderón, M. (2007). The role of home literacy and language environment on bilinguals’ English and Spanish vocabulary development. Applied Psycholinguistics, 28, 171–190. doi: 10.1017/S0142716406070093

    Google Scholar 

  • Edele, A., Schotte, K., Hecht, M., & Stanat, P. (2012). Listening comprehension tests of immigrant students’ first languages (L1) Russian and Turkish in grade 9: Scaling procedure and results. (NEPS Working Paper No. 13). Bamberg: University of Bamberg, National Educational Panel Study.

    Google Scholar 

  • Edele, A., Schotte, K., & Stanat P. (2015). Listening comprehension tests of immigrant students’ first languages (L1) Russian and Turkish in grade 9: Extended report of test construction and validation. (NEPS Working Paper No. 57). Bamberg: University of Bamberg, National Educational Panel Study.

    Google Scholar 

  • Edele, A., Seuring, J., Kristen, C., & Stanat, P. (2015). Why bother with testing ? The validity of immigrants’ self-assessed language proficiency, Social Science Research, 52, 99–123. doi:10.1016/j.ssresearch.2014.12.017

    Google Scholar 

  • Edele, A., & Stanat, P. (2015). The role of first-language listening comprehension in second-language reading comprehension. Journal of Educational Psychology. Advance Online Publication. doi:10.1037/edu0000060

    Google Scholar 

  • Edele, A., Stanat, P., Radmann, S., & Segeritz, M. (2013). Kulturelle Identität und Lesekompetenz von Jugendlichen aus eingewanderten Familien. In N. Jude, & E. Klieme (Eds.), Zeitschrift für Pädagogik, Beiheft, 59, 84 – 110.

    Google Scholar 

  • Esser, H. (2006). Sprache und Integration: Die sozialen Bedingungen und Folgen des Spracherwerbs von Migranten. Frankfurt am Main: Campus Verlag.

    Google Scholar 

  • Finnie, R., & Meng, R. (2005). Literacy and labour market income: self-assessment versus test score measures. Applied Economics 37(17), 1935–1951.

    Google Scholar 

  • Flowerdew, J., & Miller, L. (2005). Second language listening: Theory and practice. Cambridge: Cambridge University Press.

    Google Scholar 

  • Frahm, S., Goy, M., Kowalski, K., Sixt, M., Strietholt, R., Blatt, I., … Kanders, M. (2011). Transition and development from lower secondary to upper secondary school. In H.-P. Blossfeld, H.-G. Roßbach, & J. von Maurice (Eds.), Zeitschrift für Erziehungswissenschaft, 14. Education as a lifelong process: The German National Educational Panel Study (NEPS) (pp. 217 – 232). Wiesbaden: VS Verlag für Sozialwissenschaften.

    Google Scholar 

  • Grotjahn, R. (2005). Testen und Bewerten des Hörverstehens. In M. Ó. Dúill, R. Zahn, & K. D. C. Höppner (Eds.), Zusammenarbeiten: Eine Festschrift für Bernd Voss (pp. 115–144). Bochum: AKS-Verlag.

    Google Scholar 

  • Harris, D. P. (1969). Testing English as a second language. New York: McGraw-Hill.

    Google Scholar 

  • Hesse, H.-G., Göbel, K., & Hartig, J. (2008). Sprachliche Kompetenzen von mehrsprachigen Jugendlichen und Jugendlichen nicht-deutscher Erstsprache. In DESI-Konsortium (Ed.), Unterricht und Kompetenzerwerb in Deutsch und Englisch: Ergebnisse der DESI-Studie (pp. 208 – 201). Weinheim: Beltz.

    Google Scholar 

  • Lado, R. (1961). Language testing: The construction and the use of foreign language tests. London: Longman.

    Google Scholar 

  • Lang, F. R., Kamin, S., Rohr, M., Stünkel, C., & Williger, B. (2014). Erfassung der fluiden kognitiven Leistungsfähigkeit über die Lebensspanne im Rahmen des Nationalen Bildungspanels: Abschlussbericht zu einer NEPS-Ergänzungsstudie. (NEPS Working Paper No. 43). Bamberg: University of Bamberg, National Educational Panel Study.

    Google Scholar 

  • Lockl, K. (2013). Assessment of procedural metacognition: Scientific Use File 2013. Bamberg: University of Bamberg, National Educational Panel Study.

    Google Scholar 

  • Mouw, T., & Xie, Y. (1999). Bilingualism and the academic achievement of first- and second- generation Asian Americans: Accommodation with or without assimilation ? American Sociological Review, 64(2), 232 – 252.

    Google Scholar 

  • Muñoz-Sandoval, A. F., Cummins, J., Alvarado, C. G., & Ruef, M. L. (1998). Bilingual Verbal Ability Tests, Comprehensive Manual. Chicago: Riverside Publishing.

    Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (2009). Mplus (Version 6.1) [Computer software]. Los Angeles, CA: Muthén & Muthén.

    Google Scholar 

  • Portes, A., & Rumbaut, R. G. (2012). Children of Immigrants Longitudinal Study (CILS), 1991–2006 (ICPSR20520-v2) [Codebook]. Retrieved from http://doi.org/10.3886/ICP10.3886/ICPSR20520.v2

  • Rauch, D., Jurecka, A., & Hesse, H.-G. (2010). Für den Drittspracherwerb zählt auch die Lesekompetenz in der Herkunftssprache. In C. Allemann-Ghionda, P. Stanat, K. Göbel, & C. Röhner (Eds.), Zeitschrift für Pädagogik, Beiheft, 55, 78–100.

    Google Scholar 

  • Raven, J. C. (1977). Standard Progressive Matrices: Sets A, B, C, D & E. San Antonio, TX: Harcourt.

    Google Scholar 

  • Rumbaut, A. G. (2004). Ages, life stages, and generational cohorts: Decomposing the immigrant first and second generations in the United States. International Migration Review, 38(3), 1160 – 1205.

    Google Scholar 

  • Rumbaut, R. G., Massey, D. S., & Bean, F. D. (2006). Linguistic life expectancies: Immigrant language retention in southern Calicornia. Population and Development Review, 32(2), 447 – 460.

    Google Scholar 

  • Scheele, A. F., Leseman, P. M., & Mayo, A. Y. (2010). The home language environment of monolingual and bilingual children and their language proficiency. Applied Psycholinguistics, 31, 117 – 140. doi: 10.1017/S0142716409990191

    Google Scholar 

  • Schroeders, U., & Wilhelm, O. (2011). Equivalence of reading and listening comprehension across test media. Educational and Psychological Measurement, 71, 849–869. doi: 10.1177/0013164410391468

    Google Scholar 

  • Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6(2), 461–464.

    Google Scholar 

  • Shohamy, E., & Inbar, O. (1991). Validation of listening comprehension tests: The effect of text and question type. Language Testing, 8(1), 23–40.

    Google Scholar 

  • Spolsky, B. (1989). Conditions for second language learning: Introduction to a general theory. Oxford: Oxford University Press.

    Google Scholar 

  • Stanat, P., Rauch, D., & Segeritz, M. (2010). Schülerinnen und Schüler mit Migrationshintergrund. In E. Klieme, C. Artelt, J. Hartig, N. Jude, O. Köller, M. Prenzel, … P. Stanat (Eds.), PISA 2009: Bilanz nach einem Jahrzehnt (pp. 200–230). Münster: Waxmann.

    Google Scholar 

  • Steffensen, M., Joag-Dev, C., & Anderson, R. (1979). A cross-cultural perspective on reading comprehension. Reading Research Quarterly, 15(1), 10–29.

    Google Scholar 

  • Strobel, B., & Kristen, C. (2015): Erhalt der Herkunftssprache?—Muster des Sprachgebrauchs in Migrantenfamilien. Zeitschrift für Erziehungswissenschaft, 18, 125–142. doi: 10.1007/s11618-014-0607-1

    Google Scholar 

  • Verhoeven, L. T. (2007). Early bilingualism, language transfer and phonological awareness. Applied Psycholinguistics, 28, 425 – 429. doi: 10.1017.S0142716407070233

    Google Scholar 

  • von Maurice, J., Sixt, M., & Blossfeld, H.-P. (2011). The German National Educational Panel Study: Surveying a cohort of 9th graders in Germany. (NEPS Working Paper No. 3). Bamberg: University of Bamberg, National Educational Panel Study.

    Google Scholar 

  • Wu, M. L., Adams, R. J., Wilson, M. R., & Haldane, S. A. (2007). ACER ConQuest version 2.0: Generalised item response modelling software. Camberwell, Victoria.

    Google Scholar 

  • Yu, C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Doctoral dissertation, University of California). Retrieved from http://www.statmodel.com/download/Yudissertation.pdf

Download references

Author information

Authors and Affiliations

  1. Berlin, Deutschland

    Aileen Edele, Kristin Schotte & Petra Stanat

Authors
  1. Aileen Edele
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kristin Schotte
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Petra Stanat
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Aileen Edele .

Editor information

Editors and Affiliations

  1. Political and Social Sciences, European University Institute, Florence, Italy

    Hans-Peter Blossfeld

  2. Direktorium, Leibniz Inst of Edu courses (LIfBi), Bamberg, Germany

    Jutta von Maurice

  3. LIfBi, Bamberg, Germany

    Michael Bayer

  4. SPS, European University Institute, Florence, Italy

    Jan Skopek

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Fachmedien Wiesbaden

About this chapter

Cite this chapter

Edele, A., Schotte, K., Stanat, P. (2016). Assessment of Immigrant Students’ Listening Comprehension in Their First Languages (L1) Russian and Turkish in Grade 9: Test Construction and Validation. In: Blossfeld, HP., von Maurice, J., Bayer, M., Skopek, J. (eds) Methodological Issues of Longitudinal Surveys. Springer VS, Wiesbaden. https://doi.org/10.1007/978-3-658-11994-2_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-658-11994-2_25

  • Published:

  • Publisher Name: Springer VS, Wiesbaden

  • Print ISBN: 978-3-658-11992-8

  • Online ISBN: 978-3-658-11994-2

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation