Abstract
The article gives the results of adjusting an abbreviated version of the Neighborhood Environment Walkability Scale to the situation in Mexico. The results were obtained through the application of 156 instruments to individuals selected through a probability sampling in the metropolitan area of Monterrey, in the state of Nuevo León, Mexico. The validation process was done over four stages; in the first stage, the questions were analyzed and the sampling was adjusted. In the second stage, a factor analysis was carried out; as the questions were Likert-scale type, we use principal components with a matrix of polychoric correlations. In the third stage, the ordinal and non-ordinal Cronbach Alpha coefficients were determined, as were the ordinal and non-ordinal McDonald Omega coefficients, showing that the non-ordinal ones tend to underestimate the level of reliability, as they assume that it is a continuous scale when in this case it is not; however, the literature shows that these coefficients have been the most used in the validation of this scale. Finally, the intervals of trust were calculated with the bootstrap method, with the goal of incorporating the sensitivity that the coefficients could imply in aspects such as the number of questions, intercorrelations between the questions, and the size of the sample. The results show that the ordinal Alpha and Omega coefficients for the three factors, as well as for the entire scale, will have robust values 95% of the time that the questionnaire is used.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
AMAI: Niveles Socioeconómicos. Asociación Mexicana de Agencias de Investigación de Mercado y Opinión Pública. http://www.amai.org (2008). Accessed 14 June 2016
Biner, P.M., Kidd, H.J.: The interactive effects of monetary incentive justification and questionnaire length on mail survey response rates. Psychol. Market. (1994). doi:10.1002/mar.4220110505
Böckenholt, U., Lehmann, D.R.: On the limits of research rigidity: the number of items in a scale. Market. Lett. (2015). doi:10.1007/s11002-015-9373-y
Cerin, E., Saelens, B.E., Sallis, J.F., Frank, L.D.: Neighborhood Environment Walkability Scale: validity and development of a short form. Med. Sci. Sports Exerc. (2006). doi:10.1249/01.mss.0000227639.83607.4d
Cerin, E., Macfarlane, D.J., Ko, H.-H., Chan, K.-C.A.: Measuring perceived neighborhood walkability in Hong Kong. Cities (2007). doi:10.1016/j.cities.2006.12.002
Cerin, E., Conway, T.L., Cain, K.L., Kerr, J., De Bourdeaudhuij, I., Owen, N., Reis, R.S., Sarmiento, O.L., Hinckson, E.S., Salvo, D., Christiansen, L.B., MacFarlane, D.J., Davey, R., Mitáš, J., Aguinaga-Ontoso, I., Sallis, J.F.: Sharing good NEWS across the world: developing comparable scores across 12 countries for the Neighborhood Environment Walkability Scale (NEWS). BMC Public Health (2013). doi:10.1186/1471-2458-13-309
Cerny, B.A., Kaiser, H.F.: A study of a measure of sampling adequacy for factor-analytic correlation matrices. Multivar. Behav. Res. (1977). doi:10.1207/s15327906mbr1201_3
Cortina, J.M.: What is coefficient alpha? An examination of theory and applications. J. Appl. Soc. Psychol. (1993). doi:10.1037/0021-9010.78.1.98
CONEVAL: Medición de la pobreza en México y en las Entidades Federativas 2014. Consejo Nacional de Evaluación de la Política de Desarrollo Social, Mexico City. http://www.coneval.org.mx/Medicion/MP/Paginas/AE_pobreza_2014.aspx (2015). Accessed 25 Feb 2016
Cronbach, L.J.: Coefficient alpha and the internal structure of test. Psychometrika (1951). doi:10.1007/BF02310555
De Jong, M.G., Lehmann, D.R., Netzer, O.: State-dependence effects in surveys. Market. Sci. (2012). doi:10.1287/mksc.1120.0722
Dunn, T.J., Baguley, T., Brunsden, V.: From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br. J. Psychol. (2014). doi:10.1111/bjop.12046
ENADID: Encuesta Nacional de la Dinámica Demográfica. Instituto Nacional de Estadística, Geografía e Informática. http://www.inegi.org.mx/est/contenidos/proyectos/encuestas/hogares/especiales/enadid/enadid2014/ (2014). Accessed 20 June 2016
ENVIPE: Encuesta Nacional de Victimización y Percepción de la Seguridad Pública. http://www.beta.inegi.org.mx/proyectos/enchogares/regulares/envipe/2016/ (2016). Accessed 5 Jan 2016
Fleury-Bahi, G., Marcouyeux, A., Préau, M., Annabi-Attia, T.: Development and validation of an environmental quality of life scale: study of a French sample. Soc. Indic. Res. (2013). doi:10.1007/s11205-012-0119-4
Flora, D.B., Curran, P.J.: An empirical evaluation of alternative methods of estimation for confirmatory analysis with ordinal data. Psychol. Methods (2004). doi:10.1037/1082-989X.9.4.466
Gadermann, A.M., Guhn, A.M., Zumbo, B.D.: Estimating ordinal reliability for Likert-type and ordinal item response data: a conceptual, empirical, and practical guide. Pract. Assess. Res. Eval. 17(3), 1–13 (2012)
Gebel, K., Bauman, A.E., Petticrew, M.: The physical environment and physical activity: a critical appraisal of review articles. Am. J. Prev. Med. (2007). doi:10.1016/j.amepre.2007.01.020
George, D., Mallery, P.: SPSS for Windows Step by Step: A Simple Guide and Reference, 11.0 Update, 4th edn. Allyn and Bacon, Toronto (2003)
González-Palomares, A.L., Sánchez-Vela, C.: Entorno Urbano y Uso de Parques: Estudio comparativo entre dos Barrios del Área Metropolitana de Monterrey. Políticas Públicas 2(1), 59–71 (2014)
Gorsuch, R.L.: Factor Analysis, 2nd edn. Hilldale, New Jersey (1983)
Guilford, J.P.: Psychometric Methods. McGraw-Hill, New York (1954)
Guadagnoli, E., Velicer, W.F.: Relation of sample size to the stability of component patterns. Psychol. Bull. 103, 265–275 (1988). doi:10.1037/0033-2909.103.2.265
Graham, J.M.: Congeneric and (essentially) tau-equivalent estimates of score reliability. Educ. Psychol. Meas. (2006). doi:10.1177/0013164406288165
Hassine, K., Marcouyeux, A., Annabi-Attia, T., Fleury-Bahi, G.: Measuring quality of life in the neighborhood: the cases of air-polluted cities in Tunisia. Soc. Indic. Res. (2014). doi:10.1007/s11205-013-0565-7
Hyunshik, K., Younglae, C., Jiameng, M., Kuam, H., Masashi, M.: The Neighborhood Environment Walkability Scale for the republic of Korea: reliability and relationship with walking. Iran. J. Public Health 45(11), 1427–1435 (2016)
Iacobucci, D., Duhachek, A.: Advancing alpha: measuring reliability with confidence. J. Consum. Psychol. (2003). doi:10.1207/S15327663JCP1304_14
INEGI: Perspectiva Estadística Nuevo León. Instituto Nacional de Estadística, Geografía e Informática. http://www.inegi.org.mx/est/contenidos/espanol/sistemas/perspectivas/perspectiva-nl.pdf (2011). Accessed 15 may 2016
INEGI: Perspectiva Estadística Nuevo León. Instituto Nacional de Estadística, Geografía e Informática. http://internet.contenidos.inegi.org.mx/contenidos/productos/prod_serv/contenidos/espanol/bvinegi/productos/integracion/estd_perspect/jun_2014/nl/702825061883.pdf (2014). Accessed 8 Mar 2016
INEGI: Encuesta Intercensal 2015. Instituto Nacional de Estadística, Geografía e Informática. http://www3.inegi.org.mx/sistemas/tabuladosbasicos/default.aspx?c=33725 (2015). Accessed 12 Sept 2016
Jöreskog, K.G.: Statistical analysis of sets of congeneric tests. Psychometrika (1971). doi:10.1007/BF02291393
Kaplan, R.M., Saccuzzo, D.P.: Psychological Testing: Principles, Applications, and Issues. CENGAGE Learning, San Diego (2006)
Leslie, E., Saelens, B., Frank, L., Owen, N., Bauman, A., Coffee, N., Hugo, G.: Residents perceptions of walkability attributes in objectively different neighborhoods: a pilot study. Health Place (2005). doi:10.1016/j.healthplace.2004.05.005
Li, H., Rosenthal, R., Rubin, D.B.: Reliability of measurement in psychology: from Spearman-Brown to maximal reliability. Psychol. Methods 1(1), 98–107 (1996)
Lindeman, R.H., Merenda, P.F., Gold, R.Z.: Introduction to Bivariate and Multivariate Analysis. Scott Foresman & Co, Glenview (1980)
Loo, R.: Caveat on sample sizes in factor analysis. Percept. Mot. Skills 56, 371–374 (1983)
Marans, R.W.: Understanding environmental quality through quality of life studies: the 2001 DAS and its use of subjective and objective indicators. Landsc. Urban Plan. (2003). doi:10.1016/S0169-2046(02)00239-6
Marôco, J.: Análise de equações estruturais. Fundamentos teóricos, software e aplicações. Repor Number, Ltda, Brasil (2010)
McDonald, R.P.: Theoretical foundations of principal factor analysis and alpha factor analysis. Br. J. Math. Stat. Psychol. (1970). doi:10.1111/j.2044-8317.1970.tb00432.x
McDonald, R.P.: Test Theory: A Unified Treatment. Lawrence Erlbaum, New Jersey (1999)
MacCallum, R.C., Widaman, K.F., Zhang, S., Hong, S.: Sample size in factor analysis. Psychol. Methods (1999). doi:10.1037/1082-989X.4.1.84
Nunnally, J.C., Bernstein, I.H.: Psychometric Theory, 3er edn. McGraw-Hill, New York (1994)
Oliden, P.E., Zumbo, B.D.: Coeficientes de fiabilidad para escalas de respuesta categórica ordenada. Psicothema 20(4), 896–901 (2008)
Osburn, H.G.: Coefficient alpha and related internal consistency reliability coefficients. Psychol. Methods (2000). doi:10.1037//I082-989X.5.3.343
Owen, N., Humple, N., Leslie, E., Bauman, A., Sallis, J.F.: Understanding environmental influences on walking: review and research agenda. Am. J. Prev. Med. (2004). doi:10.1016/j.amepre.2004.03.006
Oyeyemi, A.L., Sallis, J.F., Deforche, B., Oyeyemi, A.Y., De Bourdeaudhuij, I., Dyck, D.V.: Evaluation of the Neighborhood Environment Walkability Scale in Nigeria. Int. J. Health Geogr. (2013). doi:10.1186/1476-072X-12-16
Raykov, T.: Analytic estimation of standard error and confidence interval for scale reliability. Multivar. Behav. Res. (2002). doi:10.1207/S15327906MBR3701_04
Robin, M., Matheau-Police, A., Couty, C.: Development of a scale of perceived environmental annoyances in urban settings. J. Environ. Psychol. (2007). doi:10.1016/j.jenvp.2006.09.005
Saelens, B.E., Sallis, J.F., Black, J.B., Chen, D.: Neighborhood-based differences in physical activity: and environmental scale evaluation. Am. J. Public Health 93(9), 1552–1558 (2003)
Saelens, B.E., Handy, S.L.: Built environment correlates of walking: a review. Med. Sci. Sports Exerc. (2008). doi:10.1249/MSS.0b013e31817c67a4
Shafer, C.S., Lee, B.K., Turner, S.: A tale of three greenway trails: user perceptions related to quality of life. Landsc. Urban Plan. (2000). doi:10.1016/S0169-2046(00)00057-8
Streiner, D.L.: Starting at the beginning: an introduction to coefficient alpha and internal consistency. J. Personal. Assess. (2003). doi:10.1207/S15327752JPA8001_18
Tejedor, F.J., García-Valcarcel, A., Prada, S.: Medida de actitudes del profesorado universitario hacia la integración de las TIC. Revista Científica de Educomunicación (2009). doi:10.3916/c33-2009-03-002
Terry, L., Kelley, K.: Sample size planning for composite reliability coefficients: accuracy in parameter estimation via narrow confidence intervals. Br. J. Math. Stat. Psychol. (2012). doi:10.1111/j.2044-8317.2011.02030.x
Van-Zyl, J.M., Neudecker, H., Nel, D.G.: On the distribution of the maximum likelihood estimator of Cronbach’s alpha. Psychometrika (2000). doi:10.1007/BF02296146
Zinbarg, R.E., Revelle, W., Yovel, I., Li, W.: Cronbach’s α, Revelles’s β, and McDonalds’s ωH: their relations with each other and two alternative conceptualizations of reliability. Psychometrika (2005). doi:10.1007/s11336-003-0974-7
Acknowledgements
The authors would like to thank the Development with Equality Research Institute (EQUIDE) for financing for this paper, and the Iberoamericana University Research Department for the resources used in writing the article. Funding was provided by Universidad Iberoamericana Ciudad de México-EQUIDE (Grant No. 0060 EQUIDE).
Author information
Authors and Affiliations
Corresponding author
Appendix: NEWS-Mexico questionnaire
Appendix: NEWS-Mexico questionnaire
Questionnaire applied to test the scale
For questions 1 through 11:
From 1 to 10 min… (1)/From 11 to 20 min… (2)/From 21 to 30 min… (3)/From 31 to 40 min… (4)/More than 40 min… (5)
Item 1. How long does it take you to walk from your house to the store?
Item 2. How long does it take you to walk from your house to the supermarket?
Item 3. How long does it take you to walk from your house to the fruit and vegetable market?
Item 4. How long does it take you to walk from your house to the computer and accessories store?
Item 5. How long does it take you to walk from your house to the bus stop, metro, or Metrobus station, etc.?
Item 6. How long does it take you to walk from your house to a bank?
Item 7. How long does it take you to walk from your house to a park or recreation center?
Item 8. How long does it take you to walk from your house to a bookstore?
Item 9. How long does it take you to walk from your house to the gym?
Item 10. How long does it take you to walk from your house to the laundromat?
Item 11. How long does it take you to walk from your house to the café?
For question 12:
No… (1)/Yes… (2)
Item 12. Do you do most of your shopping at stores in your neighborhood?
For question 13:
Very good… (5)/Good… (4)/Regular… (3)/Bad… (2)/Very bad… (1)
Item 13. How would you rate the public transport you use?
For question 14:
From 1 to 30 min… (5)/From 31 to 60 min… (4)/From 61 to 90 min… (3)/From 91 to 120 min… (2)/More than 2 h… (1)
Item 14. How long does it take you to reach your school or workplace?
For question 15:
Yes… (2)/No… (1)
Item 15. Are there sidewalks on most of the streets of your neighborhood?
For question 16:
Very easy… (5)/Easy… (4)/Neither easy nor difficult… (3)/Difficult… (2)/Very difficult… (1)
Item 16. Given the quality of the sidewalks in your neighborhood, how easy is it to walk on them?
For questions 17 through 20:
Yes… (2)/No… (1)
Item 17. Are there trees or green areas along the streets in your neighborhood?
Item 18. In your neighborhood, are there pedestrian crosswalks and traffic lights that help you cross busy streets?
Item 19. Are the streets in your neighborhood well-lit at night?
Item 20. Generally speaking, is there no trash left on the streets in your neighborhood?
For questions 21 through 24:
Dissatisfied … (1)/Not really satisfied … (2)/Somewhat satisfied… (3)/Very satisfied… (4)
Item 21. How satisfied do you feel with the number of pedestrian crosswalks in your neighborhood?
Item 22. How satisfied do you feel with access to public transport?
Item 23. How satisfied do you feel with the neighborhood as somewhere good to raise children?
Item 24. How satisfied do you feel with the neighborhood as somewhere good to live?
Rights and permissions
About this article
Cite this article
Martínez-Martínez, O.A., Ramírez-López, A. Walkability and the built environment: validation of the Neighborhood Environment Walkability Scale (NEWS) for urban areas in Mexico. Qual Quant 52, 703–718 (2018). https://doi.org/10.1007/s11135-017-0483-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-017-0483-x