Abstract
Research on child well-being largely relies on children’s self-report data, potentially biased by social desirability (SD). In this study, we aim to (1) evaluate the psychometric properties of the Children’s Social Desirability Short (CSD-S) scale, and (2) examine if and, if so, how SD systematically biases child-report family and peer relationships as indicators of social well-being. In spring 2015, 843 elementary school children (aged 10) and their parents were surveyed on well-being indicators and SD measured with the 14-items Children’s Social Desirability Short (CSD-S) scale. The CSD-S was evaluated using nonparametric Item Response Theory (NIRT). Linear mixed-effects regression models based on multiple imputations of multilevel missing data were run to examine the role of SD in self-report social well-being in addition to socio-demographic characteristics, accounting for the nested structure of the data (students were sampled at class level). Applying NIRT, we identified a 13-items subset of the CSD-S with double monotonicity. Cronbach’s alpha was .82. When controlling for children’s socio-demographic characteristics, SD significantly positively predicted subjective evaluations of family relationships (B = 0.04, t(49272) = 7.45, p < .001), whereas it significantly negatively predicted self-report deviant behavior performed towards peers (B = −0.03, t(39927) = −14.40, p < .001) and experienced from peers (B= −.0.01, t(39028) = −2.86, p = .002). SD bias explained additional 22 percent of variance in self-report deviant behavior performed towards peers. Since SD impacts the validity of self-report well-being, child indicators research should include age-specific SD scales, e.g., the CSD-S, and control for the bias in statistical analyses.
Similar content being viewed by others
References
Acock, A. C. (2005). Working with missing values. Journal of Marriage and Family, 67(4), 1012–1028. doi:10.1111/j.1741-3737.2005.00191.x.
Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48 arXiv:1406.5823.
Baxter, S. D., Smith, A. F., Litaker, M. S., Baglio, M. L., Guinn, C. H., & Shaffer, N. M. (2004). Children’s social desirability and dietary reports. Journal of Nutrition Education and Behavior, 36(2), 84–89. doi:10.1016/S1499-4046(06)60138-3.
Bradshaw, J., Hoelscher, P., & Richardson, D. (2006). An index of child well-being in the European Union. Social Indicators Research, 80(1), 133–177. doi:10.1007/s11205-006-9024-z.
Brajsa-Zganec, A., Ivanovic, D., & Lipovcan, L. K. (2011). Personality traits and social desirability as predictors of subjective well-being. Psychological Topics, 20(2), 261–276.
Brown, B. B., & Larson, J. (2009). Peer relationships in adolescence. In R. M. Lerner & L. Steinberg (Eds.), Handbook of adolescent psychology: volume 2 contextual influences on adolescent development (3rd ed., pp. 74–103). Hoboken: John Wiley & Sons, Inc.
Carifio, J. (1992). Parallel short forms of the Crandall social desirability test for children: shortening instruments for research purposes. Paper Presented at the Annual Conference of the Eastern Educational Research Association, Hilton Head, So. Carolina, March 5–9, 1992. Retrieved from http://eric.ed.gov.ezp.lib.rochester.edu/?id=ED343915.
Coleman, J. S. (1961). The adolescent society: the social life of the teenager and its impact on education. New York: Free Press on Glencoe.
Crandall, V. C., Crandall, V. J., & Katkovsky, W. (1965). A children’s social desirability questionnaire. Journal of Consulting Psychology, 29(1), 27–36. doi:10.1037/h0020966.
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349–354. doi:10.1037/h0047358.
Earls, F., & Carlson, M. (2001). The social ecology of child health and well-being. Annual Review of Public Health, 22(1), 143–166. doi:10.1146/annurev.publhealth.22.1.143.
Edwards, A. L. (1957). The social desirability variable in personality assessment and research. New York: Dryden Press.
Embretson, S. E., & Reise, S. P. (2013). Item response theory. Hove: Psychology Press.
Fisher, R., & Katz, J. E. (2000). Social-desirability bias and the validity of self-reported values. Psychology & Marketing, 17(2), 105–120. doi:10.1002/(SICI)1520-6793(200002)17:2<105::AID-MAR3>3.0.CO;2-9.
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286–299. doi:10.1037/1040-3590.7.3.286.
Ford, L. H., & Rubin, B. M. (1970). A social desirability questionnaire for young children. Journal of Consulting and Clinical Psychology, 35(2), 195–204. doi:10.1037/h0030042.
Gove, W. R. (1985). The effect of age and gender on deviant behavior: a biopsychosocial perspective. In A. S. Rossi (Ed.), Gender and the life course (pp. 115–144). Hawthorne: Aldine de Gruyter.
Grund, S., Lüdtke, O., & Robitzsch, A. (2016). Multiple imputation of multilevel missing data: an introduction to the R package pan. SAGE Open, 6(4), 1–17. doi:10.1177/2158244016668220.
Grusec, J. E., & Kuczynski, L. E. (1997). Parenting and children’s internalization of values: a handbook of contemporary theory. Hoboken NJ: John Wiley & Sons Inc.
Guinn, C. H., Baxter, S. D., Royer, J. A., Hardin, J. W., Mackelprang, A. J., & Smith, A. F. (2010). Fourth-grade children’s dietary recall accuracy for energy intake at school meals differs by social desirability and body mass index percentile in a study concerning retention interval. Journal of Health Psychology, 15(4), 505–514. doi:10.1177/1359105309353814.
Hauser, R. M., Brown, B. V., & Prosser, W. R. (1997). Indicators of children’s well-being. New York: Russell Sage Foundation.
Joinson, A. (1999). Social desirability, anonymity, and internet-based questionnaires. Behavior Research Methods, Instruments, & Computers, 31(3), 433–438. doi:10.3758/BF03200723.
Keyes, C. L. M. (1998). Social well-being. Social Psychology Quarterly, 61(2), 121–140. doi:10.2307/2787065.
Klein, E. B., Gould, L. J., & Corey, M. (1969). Social desirability in children: an extension and replication. Journal of Consulting and Clinical Psychology, 33(1), 128–128. doi:10.1037/h0027339.
Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: a literature review. Quality and Quantity, 47(4), 2025–2047. doi:10.1007/s11135-011-9640-9.
Ligtvoet, R., van der Ark, L. A., te Marvelde, J. M., & Sijtsma, K. (2010). Investigating an invariant item ordering for polytomously scored items. Educational and Psychological Measurement, 70(4), 578–595. doi:10.1177/0013164409355697.
Marlowe, D., & Crowne, D. P. (1961). Social desirability and response to perceived situational demands. Journal of Consulting Psychology, 25(2), 109–115. doi:10.1037/h0041627.
Marmet, S., Archimi, A., Windlin, B., & Delgrande Jordan, M. (2015). Substance use among pupils in Switzerland in 2014 and trends since 1986 – results of the “health behaviour in school-aged children” (HBSC) study. Lausanne: Addiction Switzerland Retrieved from http://www.addictionsuisse.ch/fileadmin/user_upload/DocUpload/Summary-HBSC-2014.pdf.
Messina, A., Fogliani, A. M., & Paradiso, S. (2010). Association between alexithymia, neuroticism, and social desirability scores among Italian graduate students. Psychological Reports, 107(1), 185–192. doi:10.2466/02.07.13.15.PR0.107.4.185-192.
Miller, P. H., Baxter, S. D., Hitchcock, D. B., Royer, J. A., Smith, A. F., & Guinn, C. H. (2014). Test-retest reliability of a short form of the children’s social desirability scale for nutrition and health-related research. Journal of Nutrition Education and Behavior, 46(5), 423–428. doi:10.1016/j.jneb.2013.11.002.
Miller, P. H., Baxter, S. D., Royer, J. A., Hitchcock, D. B., Smith, A. F., Collins, K. L., & Finney, C. J. (2015). Children’s social desirability: effects of test assessment mode. Personality and Individual Differences, 83, 85–90. doi:10.1016/j.paid.2015.03.039.
Mishna, F., & Alaggia, R. (2005). Weighing the risks: a child’s decision to disclose peer victimization. Children & Schools, 27(4), 217–226. doi:10.1093/cs/27.4.217.
Mokken, R. J. (1971). A theory and procedure of scale analysis: with applications in political research. Berlin: Walter de Gruyter.
Morrow, V. (1999). Conceptualising social capital in relation to the well-being of children and young people: a critical review. The Sociological Review, 47(4), 744–765. doi:10.1111/1467-954X.00194.
Mößle, T. (2012). “Dick, dumm, abhängig, gewalttätig?” Problematische Mediennutzungsmuster und ihre Folgen im Kindesalter. Ergebnisse des Berliner Längsschnitt Medien (Vol. 42). Baden-Baden: Nomos.
Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing. Principles and applications (6th ed.). New Jersey: Prentice Hall.
Myers, T. A. (2011). Goodbye, listwise deletion: presenting hot deck imputation as an easy and effective tool for handling missing data. Communication Methods and Measures, 5(4), 297–310. doi:10.1080/19312458.2011.624490.
Nederhof, A. J. (1985). Methods of coping with social desirability bias: a review. European Journal of Social Psychology, 15(3), 263–280. doi:10.1002/ejsp.2420150303.
Novick, M. R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3(1), 1–18. doi:10.1016/0022-2496(66)90002-2.
Nunnally, J. (1978). Psychometric methods. New York: McGraw-Hill.
Pollard, E. L., & Lee, P. D. (2003). Child well-being: a systematic review of the literature. Social Indicators Research, 61(1), 59–78. doi:10.1023/A:1021284215801.
Putnam, R. D., Leonardi, R., & Nanetti, R. Y. (1994). Making democracy work: civic traditions in modern Italy. Princeton: Princeton University Press.
R Core Team. (2015). R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/.
Rasch, G. (1993). Probabilistic models for some intelligence and attainment tests. Chicago: MESA Press.
Revelle, W. (2016). Psych: procedures for personality and psychological research. Evanston: Northwestern University. https://CRAN.R-project.org/package=psych, Version= 1.5. 8.
Scholte, R. H. J., & van Aken, M. (2006). Peer relations in adolescence. In S. Jackson & L. Goossens (Eds.), Handbook of adolescent development (pp. 175–199). New York: Psychology Press.
Sijtsma, K., & Hemker, B. T. (1998). Nonparametric polytomous IRT models for invariant item ordering, with results for parametric models. Psychometrika, 63(2), 183–200. doi:10.1007/BF02294774.
Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory (5th ed.). Thousand Oaks: Sage.
Van der Ark, L. A. (2007). Mokken scale analysis in R. Journal of Statistical Software, 20(11), 1–19. doi:10.18637/jss.v020.i11.
Van der Ark, L. A. (2012). New developments in Mokken scale analysis in R. Journal of Statistical Software, 48(5), 1–27. doi:10.18637/jss.v048.i05.
van Schuur, W. H. (2003). Mokken scale analysis: between the Guttman scale and parametric item response theory. Political Analysis, 11(2), 139–163. doi:10.1093/pan/mpg002.
Venkatraman, S., Dishion, T. J., Kiesner, J., & Poulin, F. (2010). Cross-cultural analysis of parental monitoring and adolescent problem behavior: theoretical challenges and model replication when east meets west. In V. Guilamo-Ramos, J. Jaccard, & P. Dittus (Eds.), Parental monitoring of adolescents: current perspectives for researchers and practitioners. New York: Columbia University Press.
Young, R., & Sweeting, H. (2004). Adolescent bullying, relationships, psychological well-being, and gender-atypical behavior: a gender diagnosticity approach. Sex Roles, 50(7–8), 525–537. doi:10.1023/B:SERS.0000023072.53886.86.
Acknowledgements
We wish to thank the regional education administration of Ticino and the participating schools for their collaboration during data collection. We also thank Dr. A.L. Dima for her constructive feedback on Item Response Theory analysis.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
None declared.
Funding
Internal funding.
Rights and permissions
About this article
Cite this article
Camerini, AL., Schulz, P.J. Social Desirability Bias in Child-Report Social Well-Being: Evaluation of the Children’s Social Desirability Short Scale Using Item Response Theory and Examination of Its Impact on Self-Report Family and Peer Relationships. Child Ind Res 11, 1159–1174 (2018). https://doi.org/10.1007/s12187-017-9472-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12187-017-9472-9