Abstract
Large-scale surveys experience nonresponse that might result in biases in the results. In educational surveys, nonresponse can occur at three levels, i.e. the school, the student and the item. Traditionally, large-scale surveys in education have compensated for unit nonresponse, both at the school and at the student level, by applying survey weight adjustments.
IEA TIMSS and PIRLS surveys, for example, apply a school nonresponse adjustment calculated within the explicit stratum level and a student nonresponse adjustment calculated within each school. Since its first data collection, PISA has implemented the school nonresponse adjustment at a lower level than the explicit stratum, using combinations of the implicit stratification variables. The student nonresponse adjustment procedures have continuously evolved since the first data collection to better reflect differential response rates. In PISA 2006, the student nonresponse adjustment was computed by creating, per school nonresponse adjustment cell, four student nonresponse adjustment cells based on relative grade level, and gender.
This study compares the efficiency of the 2003 and the 2006 procedures for reducing potential bias due to differential student response rates. The comparison highlights the potential of the 2006 method for reducing bias due to differential response rates according to gender and grade.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brick, J. M., & Kalton, G. (1996). Handling missing data in survey research. Statistical Methods in Medical Research, 5, 215–238.
Kalton, G. (1983). Compensating for missing survey data. Ann Arbor, MI: Institute for Social Research, University of Michigan.
Kalton, G., & Flores-Cervantes, I. (2003). Weighting methods. Journal of Official Statistics, 19, 81–97.
Kish, L. (1992). Weighting for unequal Pi. Journal of Official Statistics, 8, 183–200.
Little, R. (1986). Survey nonresponse adjustments for estimates of means. International Statistical Review, 54, 139–157.
Organisation for Economic Co-operation and Development. (2002). PISA 2000 Technical Report. Paris: OECD.
Organisation for Economic Co-operation and Development. (2005). PISA 2003 Technical Report. Paris: OECD.
Organisation for Economic Co-operation and Development. (2009). PISA 2006 Technical Report. Paris: OECD.
Pfeffermann, D. (1996). The use of sampling weights for survey data analysis. Statistical Methods in Medical Research, 5, 239–261.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Rust, K., Krawchuk, S., Monseur, C. (2013). PISA Student Nonresponse Adjustment Procedures. In: Prenzel, M., Kobarg, M., Schöps, K., Rönnebeck, S. (eds) Research on PISA. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4458-5_6
Download citation
DOI: https://doi.org/10.1007/978-94-007-4458-5_6
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-4457-8
Online ISBN: 978-94-007-4458-5
eBook Packages: Humanities, Social Sciences and LawEducation (R0)