Skip to main content
Log in

Analyzing Multiple-Item Measures of Crime and Deviance I: Item Response Theory Scaling

  • Published:
Journal of Quantitative Criminology Aims and scope Submit manuscript

Abstract

Multiple-item measures of self-reported offending typically provide the principal outcome measures for individual level research on the causes of crime and deviance. This article directs attention to the substantial problems presented by the task of forming composite scores for these measures, and it presents a possible solution to those problems. We consider scaling by means of the graded response model from item response theory (IRT) as a potential means of overcoming the shortcomings of traditional summative scaling and of obtaining valuable information about the strengths and weaknesses of our measures. We illustrate this strategy through a scale analysis of a fourteen-item, self-report measure of delinquency, using three years of data from the Monitoring the Future study, an annual national survey of high school seniors. The graded response model proves to be consistent with the data, and it provides results that address important substantive questions about self-report measures. The findings are informative about the strengths and weaknesses of alternative strategies for developing self-report instruments, indicating that there is little to be gained by making fine distinctions in the frequency of individual delinquent acts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

REFERENCES

  • Andrich, D. (1988). Rasch Models for Measurement. Sage University Paper Series on Quantitative Applications in the Social Sciences, series no. 07-068. Sage, Beverly Hills, CA.

    Google Scholar 

  • Arnold, W. R. (1965). Continuities in research: Scaling delinquent behavior. Social Problems 13: 59-66.

    Google Scholar 

  • Bachman, J. G., O'Malley, P. M., and Johnston, L. D. (1991). The Monitoring the Future Project After Seventeen Years: Design and Procedures. (Occasional Paper #33.) Institute for Social Research, Ann Arbor, MI.

    Google Scholar 

  • Bachman, J. G., O'Malley, P. M., and Johnston, L. D. (1993). Monitoring the Future: Questionnaire Responses from the Nation's High School Seniors, 1992, Institute for Social Research, Ann Arbor, MI.

    Google Scholar 

  • Blumstein, A., Cohen, J., Roth, J., and Visher, C. A. (1986). Criminal Careers and “Career” Criminals, Volume 1, National Research Council. National Academy Press, Washington, DC.

    Google Scholar 

  • Blumstein, A., Cohen, J., and Farrington, D. P. (1988). Criminal career research: Its value for criminology. Criminology 26: 1-35.

    Google Scholar 

  • Bock, R. D., and Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: An application of the EM algorithm. Psychometrika 46: 443-459.

    Google Scholar 

  • Brodsky, S. L., and Smitherman, H. O. (1983). Handbook of Scales for Research in Crime and Delinquency, Plenum Press, New York.

    Google Scholar 

  • Curry, D. G., and Spergel, I. A. (1991). Youth gang involvement and delinquency. Paper, American Sociological Association. (SA Document Delivery Delivery Service (Soc Abstracts, 039, 03, 1991) 91S25020-16 pages.)

  • Dentler, R. A., and Monroe, L. J. (1961). Social correlates of early adolescent theft. Am. Sociol. Review 26: 733-743.

    Google Scholar 

  • DeRoos, Y. S., and Allen-Meares, P. (1992). Rasch analysis: Its description and use analyzing the children's depression inventory. J. Soc. Serv. Rsrch 16: 1-17.

    Google Scholar 

  • Donovan, J., and Jessor, R. J. (1985). Structure of problem behavior in adolescence and young adulthood. J. Consult. Clinic. Psych. 53: 890-904.

    Google Scholar 

  • Donovan, J., Jessor, R. J., and Costa, F. M. (1988). Syndrome of problem behavior in preadolescence: A replication. J. Consult. Clinic. Psych. 56: 762-765.

    Google Scholar 

  • Elliott, D. S., and Ageton, S. S. (1980). Reconciling race and class differences in self-reported and official estimates of delinquency. Am. Sociol. Rev. 45: 95-110.

    Google Scholar 

  • Elliott, D. S., Huizinga D., and Ageton, S. S. (1985). Explaining Delinquency and Drug Use, Sage, Beverly Hills, CA.

    Google Scholar 

  • Elliott, D. S., Huizinga, D., and Menard, S. (1989). Multiple Problem Youth: Delinquency, Substance Use, and Mental Health Problems, Springer-Verlag, New York.

    Google Scholar 

  • Embretson, S. E. (1996). The new rules of measurement. Psych. Assess. 8: 341-349.

    Google Scholar 

  • Gold, M. (1966). Undetected delinquent behavior. J. Res. Crime Delinq. 3: 27-46.

    Google Scholar 

  • Cole, Belmont, CA}.

    Google Scholar 

  • Gottfredson, M., and Hirschi, T. (1986). The true value of lambda would appear to be zero: An essay on career criminals, criminal careers, selective incapacitation, cohort studies, and related topics. Criminology 24: 213-233.

    Google Scholar 

  • Gottfredson, M., and Hirschi, T. (1988). Science, public policy, and the career paradigm. Criminology 26: 37-56.

    Google Scholar 

  • Gottfredson, M., and Hirschi, T. (1990). A General Theory of Crime, Stanford University Press, Stanford, CA.

    Google Scholar 

  • Gray-Little, B., Williams, V. S. L., and Hancock, T. D. (1997). An item response theory analysis of the Rosenberg self-esteem scale. Pers. Soc. Psych. Bull. 23: 443-451.

    Google Scholar 

  • Gulliksen, H. (1950). Theory of Mental Tests, Wiley, New York.

    Google Scholar 

  • Hambleton, R. K., and Swaminathan, H. (1985). Item Response Theory: Principles and Applications, Kluwer-Nijhoff, Boston.

    Google Scholar 

  • Hambleton, R. K., Swaminathan, H., and Rogers, H. J. (1991). Fundamentals of Item Response Theory, Sage, Newbury Park, CA.

    Google Scholar 

  • Hindelang, M. J., Hirschi, T., and Weis, J. G. (1979). Correlates of delinquency: The illusion of discrepancy between self-report and official measures. Am. Sociol. Rev. 44: 995-1014.

    Google Scholar 

  • Hindelang, M. J., Hirschi, T., and Weis, J. G. (1981). Measuring Delinquency, Sage, Beverly Hills, CA.

    Google Scholar 

  • Hindelang, M. J., and Weis, J. G. (1972). Personality and self-reported delinquency: An application of cluster analysis. Criminology 10: 268-294.

    Google Scholar 

  • Huizinga, D., and Elliott, D. S. (1986). Reassessing the reliability and validity of self-report delinquency measures. J. Quant. Criminol. 2: 293-327.

    Google Scholar 

  • Judd, C. M., and McClelland, G. H. (1989). Data Analysis: A Model-Comparison Approach, Harcourt Brace Jovanovich, San Diego, CA.

    Google Scholar 

  • Kingston, N. M., and Dorans, N. J. (1985). The analysis of item-ability regressions: An exploratory IRT model fit tool. App. Psych. Meas. 9: 281-288.

    Google Scholar 

  • Koch, W. R. (1983). Likert scaling using the graded response latent trait model. App. Psych. Meas. 7: 15-32.

    Google Scholar 

  • Kuder, G. F., and Richardson, W. W. (1937). The theory of the estimate of test reliability. Psychometrika 2: 151-160.

    Google Scholar 

  • Lazarsfeld, P. F., and Henry, N. W. (1968). Latent Structure Analysis, Houghton Mifflin Company, Boston, MA.

    Google Scholar 

  • Leung, K., and Drasgow, F. (1986). Relation between self-esteem and delinquent behavior in three ethnic groups: An application of item response theory. J. Cross-Cultural Psych. 17: 151-167.

    Google Scholar 

  • Long, J. S. (1997). Regression Models for Categorical and Limited Dependent Variables, Sage, Thousand Oaks, CA.

    Google Scholar 

  • Lord, F. M. (1952). A Theory of Test Scores, Psychometric Monograph No. 7. Psychometric Society.

  • Lord, F. M., and Novick, M. (1968). Statistical Theories of Mental Tests, Addison-Wesley, New York.

    Google Scholar 

  • McMorris, B. J. (1997). Using Latent Structural Analysis to Examine the Distribution of Problem Behavior: Discrete Types vs. Propensity Explanations of Criminality, Ph.D. dissertation, Department of Sociology, University of Nebraska-Lincoln, Lincoln, NE.

    Google Scholar 

  • McRae, J. A. (1991). Rasch measurement and differences between women and men in self-esteem. Soc. Sci. Res. 20: 421-436.

    Google Scholar 

  • Nugent, W. R., and Hankins, J. A. (1989). The use of item-response theory in social work measurement and research. Soc. Serv. Rev. 63: 447-472.

    Google Scholar 

  • Nunnally, J. C. (1978). Psychometric Theory (2nd ed.), McGraw-Hill, New York.

    Google Scholar 

  • Nye, F. I., and J. F. Short, Jr. (1957). Scaling delinquent behavior. American Sociological Review 22: 326-331.

    Google Scholar 

  • Osgood, D. W., Finken, L. L., and McMorris, B. J. (forthcoming). Analyzing multiple-item measures of crime and deviance II: Tobit regression analysis of transformed scores. J. Quant. Criminol.

  • Osgood, D. W., Johnston, L. D., O'Malley, P. M., and Bachman, J. G. (1988). The generality of deviance in late adolescence and early adulthood. Am. Sociol. Rev. 53: 81-94.

    Google Scholar 

  • Osgood, D. W., and Rowe, D. C. (1994). Bridging criminal careers, theory, and policy through latent variable models of individual offending. Criminology 32: 517-554.

    Google Scholar 

  • Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests, Danish Institute for Educational Research, Copenhagen.

    Google Scholar 

  • Reise, S. P. (1999). Personality measurement issues viewed through the eyes of IRT. In Embretson, S. E., and Hershberger, S. L. (eds.), The New Rules of Measurement: What Every Psychologist and Educator Should Know, Lawrence Erlbaum, Mahwah, NJ.

    Google Scholar 

  • Reiser, M. (1989). An application of the item-response model to psychiatric epidemiology. Sociol. Meth. Rsrch 18: 66-103.

    Google Scholar 

  • Rowe, D. C., and Flannery, D. J. (1994). An examination of environmental and trait influences on adolescent delinquency. J. Res. Crime Delinq. 31: 374-389.

    Google Scholar 

  • Rowe, D. C., Osgood, D. W., and Nicewander, W. A. (1990). A latent trait approach to unifying criminal careers. Criminology 28: 237-270.

    Google Scholar 

  • Rowe, D. C., and Rodgers, J. L. (1989). Behavior genetics, adolescent deviance, and 'd': contributions and issues. In Adams, G. R., Montemayor, R., and Gullotta, T. P. (eds.), Biology of Adolescent Behavior and Development, Sage, Newbury Park, CA.

    Google Scholar 

  • Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, No. 17.

  • Santor, D. C., and Ramsay, J. O. (1998). Progress in the technology of measurement: Applications of item response models. Psych. Assess. 10: 345-359.

    Google Scholar 

  • Schaeffer, N. C. (1988). An application of item response theory to the measurement of depression. Sociol. Meth. 18: 271-308.

    Google Scholar 

  • Sellin, J. T., and Wolfgang, M. W. (1964). The Measurement of Delinquency, Wiley, New York.

    Google Scholar 

  • Shannon, L. W. (1968). Scaling juvenile delinquency. J. Res. Crime Delinq. 5: 52-65.

    Google Scholar 

  • Short, J. F., Jr., and Nye, F. I. (1957). Reported behavior as a criterion of deviant behavior. Soc. Problems 5: 207-213.

    Google Scholar 

  • Short, J. F., Jr., and Nye, F. I. (1958). Extent of unrecorded juvenile delinquency: Tentative conclusions. J. Crim. Law and Criminol. 49: 296-302.

    Google Scholar 

  • Steinberg, L., and Thissen, D. (1995). Item response theory in personality research. In Shrout, P. E., and Fiske, S. T. (eds.), Personality Research, Methods, and Theory: A Festschrift Honoring Donald W. Fiske, Lawrence Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Stine, W. W. (1989). Meaningful inference: The role of measurement in statistics. Psych. Bulletin 105: 147-155.

    Google Scholar 

  • Thissen, D. (1991). MULTILOG User's Guide, Version 6.0, Scientific Software, Chicago.

    Google Scholar 

  • Thissen, D., Steinberg, L., Pysczynski, T., and Greenberg, J. (1983). An item response theory for personality and attitude scales: Item analysis using restricted factor analysis. App. Psych. Measure. 7: 211-226.

    Google Scholar 

  • Wanderer, J. J. (1984). Scaling Delinquent Careers Over Time. Criminology 22: 83-95.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Osgood, D.W., McMorris, B.J. & Potenza, M.T. Analyzing Multiple-Item Measures of Crime and Deviance I: Item Response Theory Scaling. Journal of Quantitative Criminology 18, 267–296 (2002). https://doi.org/10.1023/A:1016008004010

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1016008004010

Navigation