Skip to main content
Log in

Social Desirability Bias in Child-Report Social Well-Being: Evaluation of the Children’s Social Desirability Short Scale Using Item Response Theory and Examination of Its Impact on Self-Report Family and Peer Relationships

  • Published:
Child Indicators Research Aims and scope Submit manuscript

Abstract

Research on child well-being largely relies on children’s self-report data, potentially biased by social desirability (SD). In this study, we aim to (1) evaluate the psychometric properties of the Children’s Social Desirability Short (CSD-S) scale, and (2) examine if and, if so, how SD systematically biases child-report family and peer relationships as indicators of social well-being. In spring 2015, 843 elementary school children (aged 10) and their parents were surveyed on well-being indicators and SD measured with the 14-items Children’s Social Desirability Short (CSD-S) scale. The CSD-S was evaluated using nonparametric Item Response Theory (NIRT). Linear mixed-effects regression models based on multiple imputations of multilevel missing data were run to examine the role of SD in self-report social well-being in addition to socio-demographic characteristics, accounting for the nested structure of the data (students were sampled at class level). Applying NIRT, we identified a 13-items subset of the CSD-S with double monotonicity. Cronbach’s alpha was .82. When controlling for children’s socio-demographic characteristics, SD significantly positively predicted subjective evaluations of family relationships (B = 0.04, t(49272) = 7.45, p < .001), whereas it significantly negatively predicted self-report deviant behavior performed towards peers (B = −0.03, t(39927) = −14.40, p < .001) and experienced from peers (B= −.0.01, t(39028) = −2.86, p = .002). SD bias explained additional 22 percent of variance in self-report deviant behavior performed towards peers. Since SD impacts the validity of self-report well-being, child indicators research should include age-specific SD scales, e.g., the CSD-S, and control for the bias in statistical analyses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Acock, A. C. (2005). Working with missing values. Journal of Marriage and Family, 67(4), 1012–1028. doi:10.1111/j.1741-3737.2005.00191.x.

    Article  Google Scholar 

  • Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48 arXiv:1406.5823.

    Article  Google Scholar 

  • Baxter, S. D., Smith, A. F., Litaker, M. S., Baglio, M. L., Guinn, C. H., & Shaffer, N. M. (2004). Children’s social desirability and dietary reports. Journal of Nutrition Education and Behavior, 36(2), 84–89. doi:10.1016/S1499-4046(06)60138-3.

    Article  Google Scholar 

  • Bradshaw, J., Hoelscher, P., & Richardson, D. (2006). An index of child well-being in the European Union. Social Indicators Research, 80(1), 133–177. doi:10.1007/s11205-006-9024-z.

    Article  Google Scholar 

  • Brajsa-Zganec, A., Ivanovic, D., & Lipovcan, L. K. (2011). Personality traits and social desirability as predictors of subjective well-being. Psychological Topics, 20(2), 261–276.

    Google Scholar 

  • Brown, B. B., & Larson, J. (2009). Peer relationships in adolescence. In R. M. Lerner & L. Steinberg (Eds.), Handbook of adolescent psychology: volume 2 contextual influences on adolescent development (3rd ed., pp. 74–103). Hoboken: John Wiley & Sons, Inc.

    Google Scholar 

  • Carifio, J. (1992). Parallel short forms of the Crandall social desirability test for children: shortening instruments for research purposes. Paper Presented at the Annual Conference of the Eastern Educational Research Association, Hilton Head, So. Carolina, March 5–9, 1992. Retrieved from http://eric.ed.gov.ezp.lib.rochester.edu/?id=ED343915.

  • Coleman, J. S. (1961). The adolescent society: the social life of the teenager and its impact on education. New York: Free Press on Glencoe.

    Google Scholar 

  • Crandall, V. C., Crandall, V. J., & Katkovsky, W. (1965). A children’s social desirability questionnaire. Journal of Consulting Psychology, 29(1), 27–36. doi:10.1037/h0020966.

    Article  Google Scholar 

  • Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349–354. doi:10.1037/h0047358.

    Article  Google Scholar 

  • Earls, F., & Carlson, M. (2001). The social ecology of child health and well-being. Annual Review of Public Health, 22(1), 143–166. doi:10.1146/annurev.publhealth.22.1.143.

    Article  Google Scholar 

  • Edwards, A. L. (1957). The social desirability variable in personality assessment and research. New York: Dryden Press.

    Google Scholar 

  • Embretson, S. E., & Reise, S. P. (2013). Item response theory. Hove: Psychology Press.

    Google Scholar 

  • Fisher, R., & Katz, J. E. (2000). Social-desirability bias and the validity of self-reported values. Psychology & Marketing, 17(2), 105–120. doi:10.1002/(SICI)1520-6793(200002)17:2<105::AID-MAR3>3.0.CO;2-9.

    Article  Google Scholar 

  • Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286–299. doi:10.1037/1040-3590.7.3.286.

    Article  Google Scholar 

  • Ford, L. H., & Rubin, B. M. (1970). A social desirability questionnaire for young children. Journal of Consulting and Clinical Psychology, 35(2), 195–204. doi:10.1037/h0030042.

    Article  Google Scholar 

  • Gove, W. R. (1985). The effect of age and gender on deviant behavior: a biopsychosocial perspective. In A. S. Rossi (Ed.), Gender and the life course (pp. 115–144). Hawthorne: Aldine de Gruyter.

    Google Scholar 

  • Grund, S., Lüdtke, O., & Robitzsch, A. (2016). Multiple imputation of multilevel missing data: an introduction to the R package pan. SAGE Open, 6(4), 1–17. doi:10.1177/2158244016668220.

    Article  Google Scholar 

  • Grusec, J. E., & Kuczynski, L. E. (1997). Parenting and children’s internalization of values: a handbook of contemporary theory. Hoboken NJ: John Wiley & Sons Inc.

  • Guinn, C. H., Baxter, S. D., Royer, J. A., Hardin, J. W., Mackelprang, A. J., & Smith, A. F. (2010). Fourth-grade children’s dietary recall accuracy for energy intake at school meals differs by social desirability and body mass index percentile in a study concerning retention interval. Journal of Health Psychology, 15(4), 505–514. doi:10.1177/1359105309353814.

    Article  Google Scholar 

  • Hauser, R. M., Brown, B. V., & Prosser, W. R. (1997). Indicators of children’s well-being. New York: Russell Sage Foundation.

    Google Scholar 

  • Joinson, A. (1999). Social desirability, anonymity, and internet-based questionnaires. Behavior Research Methods, Instruments, & Computers, 31(3), 433–438. doi:10.3758/BF03200723.

    Article  Google Scholar 

  • Keyes, C. L. M. (1998). Social well-being. Social Psychology Quarterly, 61(2), 121–140. doi:10.2307/2787065.

    Article  Google Scholar 

  • Klein, E. B., Gould, L. J., & Corey, M. (1969). Social desirability in children: an extension and replication. Journal of Consulting and Clinical Psychology, 33(1), 128–128. doi:10.1037/h0027339.

  • Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: a literature review. Quality and Quantity, 47(4), 2025–2047. doi:10.1007/s11135-011-9640-9.

    Article  Google Scholar 

  • Ligtvoet, R., van der Ark, L. A., te Marvelde, J. M., & Sijtsma, K. (2010). Investigating an invariant item ordering for polytomously scored items. Educational and Psychological Measurement, 70(4), 578–595. doi:10.1177/0013164409355697.

    Article  Google Scholar 

  • Marlowe, D., & Crowne, D. P. (1961). Social desirability and response to perceived situational demands. Journal of Consulting Psychology, 25(2), 109–115. doi:10.1037/h0041627.

    Article  Google Scholar 

  • Marmet, S., Archimi, A., Windlin, B., & Delgrande Jordan, M. (2015). Substance use among pupils in Switzerland in 2014 and trends since 1986 – results of the “health behaviour in school-aged children” (HBSC) study. Lausanne: Addiction Switzerland Retrieved from http://www.addictionsuisse.ch/fileadmin/user_upload/DocUpload/Summary-HBSC-2014.pdf.

    Google Scholar 

  • Messina, A., Fogliani, A. M., & Paradiso, S. (2010). Association between alexithymia, neuroticism, and social desirability scores among Italian graduate students. Psychological Reports, 107(1), 185–192. doi:10.2466/02.07.13.15.PR0.107.4.185-192.

    Article  Google Scholar 

  • Miller, P. H., Baxter, S. D., Hitchcock, D. B., Royer, J. A., Smith, A. F., & Guinn, C. H. (2014). Test-retest reliability of a short form of the children’s social desirability scale for nutrition and health-related research. Journal of Nutrition Education and Behavior, 46(5), 423–428. doi:10.1016/j.jneb.2013.11.002.

    Article  Google Scholar 

  • Miller, P. H., Baxter, S. D., Royer, J. A., Hitchcock, D. B., Smith, A. F., Collins, K. L., & Finney, C. J. (2015). Children’s social desirability: effects of test assessment mode. Personality and Individual Differences, 83, 85–90. doi:10.1016/j.paid.2015.03.039.

    Article  Google Scholar 

  • Mishna, F., & Alaggia, R. (2005). Weighing the risks: a child’s decision to disclose peer victimization. Children & Schools, 27(4), 217–226. doi:10.1093/cs/27.4.217.

    Article  Google Scholar 

  • Mokken, R. J. (1971). A theory and procedure of scale analysis: with applications in political research. Berlin: Walter de Gruyter.

    Book  Google Scholar 

  • Morrow, V. (1999). Conceptualising social capital in relation to the well-being of children and young people: a critical review. The Sociological Review, 47(4), 744–765. doi:10.1111/1467-954X.00194.

    Article  Google Scholar 

  • Mößle, T. (2012). “Dick, dumm, abhängig, gewalttätig?” Problematische Mediennutzungsmuster und ihre Folgen im Kindesalter. Ergebnisse des Berliner Längsschnitt Medien (Vol. 42). Baden-Baden: Nomos.

    Google Scholar 

  • Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing. Principles and applications (6th ed.). New Jersey: Prentice Hall.

    Google Scholar 

  • Myers, T. A. (2011). Goodbye, listwise deletion: presenting hot deck imputation as an easy and effective tool for handling missing data. Communication Methods and Measures, 5(4), 297–310. doi:10.1080/19312458.2011.624490.

    Article  Google Scholar 

  • Nederhof, A. J. (1985). Methods of coping with social desirability bias: a review. European Journal of Social Psychology, 15(3), 263–280. doi:10.1002/ejsp.2420150303.

    Article  Google Scholar 

  • Novick, M. R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3(1), 1–18. doi:10.1016/0022-2496(66)90002-2.

    Article  Google Scholar 

  • Nunnally, J. (1978). Psychometric methods. New York: McGraw-Hill.

    Google Scholar 

  • Pollard, E. L., & Lee, P. D. (2003). Child well-being: a systematic review of the literature. Social Indicators Research, 61(1), 59–78. doi:10.1023/A:1021284215801.

    Article  Google Scholar 

  • Putnam, R. D., Leonardi, R., & Nanetti, R. Y. (1994). Making democracy work: civic traditions in modern Italy. Princeton: Princeton University Press.

    Google Scholar 

  • R Core Team. (2015). R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/.

    Google Scholar 

  • Rasch, G. (1993). Probabilistic models for some intelligence and attainment tests. Chicago: MESA Press.

    Google Scholar 

  • Revelle, W. (2016). Psych: procedures for personality and psychological research. Evanston: Northwestern University. https://CRAN.R-project.org/package=psych, Version= 1.5. 8.

  • Scholte, R. H. J., & van Aken, M. (2006). Peer relations in adolescence. In S. Jackson & L. Goossens (Eds.), Handbook of adolescent development (pp. 175–199). New York: Psychology Press.

    Google Scholar 

  • Sijtsma, K., & Hemker, B. T. (1998). Nonparametric polytomous IRT models for invariant item ordering, with results for parametric models. Psychometrika, 63(2), 183–200. doi:10.1007/BF02294774.

    Article  Google Scholar 

  • Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory (5th ed.). Thousand Oaks: Sage.

    Book  Google Scholar 

  • Van der Ark, L. A. (2007). Mokken scale analysis in R. Journal of Statistical Software, 20(11), 1–19. doi:10.18637/jss.v020.i11.

    Google Scholar 

  • Van der Ark, L. A. (2012). New developments in Mokken scale analysis in R. Journal of Statistical Software, 48(5), 1–27. doi:10.18637/jss.v048.i05.

    Google Scholar 

  • van Schuur, W. H. (2003). Mokken scale analysis: between the Guttman scale and parametric item response theory. Political Analysis, 11(2), 139–163. doi:10.1093/pan/mpg002.

    Article  Google Scholar 

  • Venkatraman, S., Dishion, T. J., Kiesner, J., & Poulin, F. (2010). Cross-cultural analysis of parental monitoring and adolescent problem behavior: theoretical challenges and model replication when east meets west. In V. Guilamo-Ramos, J. Jaccard, & P. Dittus (Eds.), Parental monitoring of adolescents: current perspectives for researchers and practitioners. New York: Columbia University Press.

    Google Scholar 

  • Young, R., & Sweeting, H. (2004). Adolescent bullying, relationships, psychological well-being, and gender-atypical behavior: a gender diagnosticity approach. Sex Roles, 50(7–8), 525–537. doi:10.1023/B:SERS.0000023072.53886.86.

    Article  Google Scholar 

Download references

Acknowledgements

We wish to thank the regional education administration of Ticino and the participating schools for their collaboration during data collection. We also thank Dr. A.L. Dima for her constructive feedback on Item Response Theory analysis.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne-Linda Camerini.

Ethics declarations

Conflict of Interest

None declared.

Funding

Internal funding.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Camerini, AL., Schulz, P.J. Social Desirability Bias in Child-Report Social Well-Being: Evaluation of the Children’s Social Desirability Short Scale Using Item Response Theory and Examination of Its Impact on Self-Report Family and Peer Relationships. Child Ind Res 11, 1159–1174 (2018). https://doi.org/10.1007/s12187-017-9472-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12187-017-9472-9

Keywords

Navigation