Skip to main content
SpringerLink
Log in

A Monte Carlo Approach for Nested Model Comparisons in Structural Equation Modeling

  • Conference paper
  • First Online:
New Developments in Quantitative Psychology

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 66))

Abstract

This paper proposes a Monte Carlo approach for nested model comparisons. This approach allows for test of approximate equivalency in fit between nested models and customizing cutoff criteria for difference in a fit index. Different methods to account for trivial misspecification in the Monte Carlo approach are also discussed. A simulation study is conducted to compare the Monte Carlo approach with different methods of imposing trivial misspecification to chi-square difference test and change in comparative fit index (CFI) with suggested cutoffs. The simulation study shows that the Monte Carlo approach is superior to the chi-square difference test by correctly retaining the nested model with trivial misspecification. It is also superior to the change in CFI by offering higher power to detect severe misspecification.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bentler, P. M. (1995). EQS structural equations program manual. Encino, CA: Multivariate Software.

    Google Scholar 

  • Bollen, K. A., & Stine, R. A. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21, 205–229.

    Article  Google Scholar 

  • Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230–258.

    Article  Google Scholar 

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.

    Article  MathSciNet  Google Scholar 

  • Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.

    Article  Google Scholar 

  • Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568–592.

    Article  Google Scholar 

  • Millsap, R. E. (2007). Structural equation modeling made difficult. Personality and Individual Differences, 2, 875–881.

    Article  Google Scholar 

  • Millsap, R. E. (September, 2010). A simulation paradigm for evaluating “approximate fit” in latent variable modeling. Paper presented at the conference “Current topics in the Theory and Application of Latent Variable Models: A Conference Honoring the Scientific Contributions of Michael W. Browne”, Ohio State University, Columbus, OH.

    Google Scholar 

  • Millsap, R. E. (2012). A simulation paradigm for evaluating model fit. In M. C. Edwards & R. C. MacCallum (Eds.), Current issues in the theory and application of latent variable models (pp. 165–182). New York: Routledge.

    Google Scholar 

  • Millsap, R. E. & Lee, S. (September, 2008). Approximate fit in SEM without a priori cutpoints. Paper presented at the Annual Meeting of Society of Multivariate Experimental Psychology, McGill University, Montreal, QC, Canada.

    Google Scholar 

  • Pornprasertmanit, S., Miller, P. J., & Schoemann, A. M. (2013). simsem: simulated structural equation modeling version 0.5-0 [Computer Software]. Available at the Comprehensive R Archive Network.

    Google Scholar 

  • Pornprasertmanit, S., Wu, W., & Little, T. D. (May, 2012). Monte Carlo approach to model fit evaluation in structural equation modeling: How to specify trivial misspecification. Poster presented at the American Psychological Society Annual Convention, Chicago, IL.

    Google Scholar 

  • Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.

    Google Scholar 

  • R Development Core Team (2012). R: A language and environment for statistical computing [Computer software manual]. Retrieved from http://www.R-project.org/

  • Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561–582.

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

Partial support for this project was provided by grant NSF 1053160 (Wei Wu & Todd D. Little, co-PIs) and by the Center for Research Methods and Data Analysis at the University of Kansas (when Todd D. Little was director). Todd D. Little is now director of the Institute for Measurement, Methodology, Analysis, and Policy at Texas Tech University. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the funding agencies.

Author information

Authors and Affiliations

  1. Department of Psychology and Center for Research Methods and Data Analysis, University of Kansas, Lawrence, KS, 66045, USA

    Sunthud Pornprasertmanit & Wei Wu

  2. Educational Psychology and Leadership Director, Institute for Measurement, Methodology Analysis and Policy College of Education, Texas Tech University, Lubbock, USA

    Todd D. Little (Professor)

Authors
  1. Sunthud Pornprasertmanit
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Todd D. Little
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sunthud Pornprasertmanit .

Editor information

Editors and Affiliations

  1. Department of Psychology, Arizona State University, Tempe, AZ, USA

    Roger E. Millsap

  2. Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands

    L. Andries van der Ark

  3. Department of Educational Psychology, University of Wisconsin, Madison, WI, USA

    Daniel M. Bolt

  4. Department of Psychology, University of Kansas, Lawrence, KS, USA

    Carol M. Woods

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this paper

Cite this paper

Pornprasertmanit, S., Wu, W., Little, T.D. (2013). A Monte Carlo Approach for Nested Model Comparisons in Structural Equation Modeling. In: Millsap, R.E., van der Ark, L.A., Bolt, D.M., Woods, C.M. (eds) New Developments in Quantitative Psychology. Springer Proceedings in Mathematics & Statistics, vol 66. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-9348-8_12

Download citation

Publish with us

Policies and ethics

Search

Navigation