Abstract
Many evaluations of cognitive models rely on data that have been averaged or aggregated across all experimental subjects, and so fail to consider the possibility of important individual differences between subjects. Other evaluations are done at the single-subject level, and so fail to benefit from the reduction of noise that data averaging or aggregation potentially provides. To overcome these weaknesses, we have developed a general approach to modeling individual differences using families of cognitive models in which different groups of subjects are identified as having different psychological behavior. Separate models with separate parameterizations are applied to each group of subjects, and Bayesian model selection is used to determine the appropriate number of groups. We evaluate this individual differences approach in a simulation study and show that it is superior in terms of the key modeling goals of prediction and understanding. We also provide two practical demonstrations of the approach, one using the ALCOVE model of category learning with data from four previously analyzed category learning experiments, the other using multidimensional scaling representational models with previously analyzed similarity data for colors. In both demonstrations, meaningful individual differences are found and the psychological models are able to account for this variation through interpretable differences in parameterization. The results highlight the potential of extending cognitive models to consider individual differences.
Article PDF
Similar content being viewed by others
References
Anderson, J. R., &Schooler, L. J. (1991). Reflections of the environment in memory.Psychological Science,2, 396–408.
Ashby, F. G., Maddox, W. T., &Lee, W.W. (1994). On the dangers of averaging across subjects when using multidimensional scaling or the similarity-choice model.Psychological Science,5, 144–151.
Ashby, F. G., &Perrin, N. A. (1988). Toward a unified theory of similarity and recognition.Psychological Review,95, 124–150.
Berretty, P. M., Todd, P. M., &Martignon, L. (1999). Categorization by elimination: Using few clues to choose. In G. Gigerenzer, P. M. Todd, & the ABC Research Group (Eds.),Simple heuristics that make us smart (pp. 235–254). New York: Oxford University Press.
Borg, I., &Groenen, P. (1997).Modern multidimensional scaling: Theory and applications. New York: Springer.
Carroll, J. D., &Arabie, P. (1983). INDCLUS: An individual differences generalization of the ADCLUS model and the MAPCLUS algorithm.Psychometrika,48, 157–169.
Carroll, J. D., &Chang, J. (1970). Analysis of individual differences in multidimensional scaling via ann-way generalization of “Eckart-Young” decomposition.Psychometrika,35, 283–319.
Cox, T. F., &Cox, M. A. A. (1994).Multidimensional scaling. London: Chapman & Hall.
Erickson, M. A. (1999). Rules and exemplars in category learning (Doctoral dissertation, Indiana University, Bloomington, 1999).Dissertation Abstracts International,60, 2377B.
Estes, W. K. (1956). The problem of inference from curves based on group data.Psychological Bulletin,53, 134–140.
Estes, W. K. (1997). Processes of memory loss, recovery, and distortion.Psychological Review,104, 148–169.
Garner, W. R. (1974).The processing of information and structure. Potomac, MD: Erlbaum.
Gelfand, A. E., &Dey, D. K. (1994). Bayesian model choice: Asymptotics and exact calculation.Journal of the Royal Statistical Society: Series B,56, 501–514.
Gilks, W. R., Richardson, S., &Spiegelhalter, D. J. (1996).Markov chain Monte Carlo in practice. London: Chapman & Hall.
Grünwald, P. D. (1998).The minimum description length principle and reasoning under uncertainty. Amsterdam: University of Amsterdam, Institute for Logic, Language & Computation.
Helm, C. E. (1959).A multidimensional ratio scaling analysis of color relations. Princeton, NJ: Princeton University & Educational Testing Service.
Jaynes, E. T. (2003).Probability theory: The logic of science. New York: Cambridge University Press.
Kass, R. E., &Raftery, A. E. (1995). Bayes factors.Journal of the American Statistical Association,90, 773–795.
Kruschke, J. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning.Psychological Review,99, 22–44.
Kruschke, J. K. (1993). Human category learning: Implications for backpropagation models.Connection Science,5, 3–36.
Kruschke, J. K. (1996). Base rates in category learning.Journal of Experimental Psychology: Learning, Memory, & Cognition,22, 3–26.
Kruschke, J. K. (2001). Toward a unified model of attention in associative learning.Journal of Mathematical Psychology,45, 812–863.
Kruschke, J. K., &Johansen, M. K. (1999). A model of probabilistic category learning.Journal of Experimental Psychology: Learning, Memory, & Cognition,25, 1083–1119.
Laming, D. (1992). Analysis of short-term retention: Models for Brown-Peterson experiments.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 1342–1365.
Lee, M. D. (2001). Determining the dimensionality of multidimensional scaling representations for cognitive modeling.Journal of Mathematical Psychology,45, 149–166.
Lee, M. D., &Pope, K. J. (2003). Avoiding the dangers of averaging across subjects when using multidimensional scaling.Journal of Mathematical Psychology,47, 32–46.
Lewandowsky, S., Kalish, M., &Griffiths, T. L. (2000). Competing strategies in categorization: Expediency and resistance to knowledge restructuring.Journal of Experimental Psychology: Learning, Memory, & Cognition,26, 1666–1684.
More, J. J. (1977). The Levenberg-Marquardt algorithm: Implementation and theory. In G. A. Watson (Ed.),Numerical analysis: Proceedings of the biennial conference held at Dundee, June 28–July 21 (Lecture Notes in Mathematics, Vol. 630, pp. 105–116). Berlin: Springer.
Myung, I. J., Balasubramanian, V., &Pitt, M. A. (2000). Counting probability distributions: Differential geometry and model selection.Proceedings of the National Academy of Sciences,97, 11170–11175.
Myung, I. J., Kim, C., &Pitt, M. A. (2000). Toward an explanation of the power law artifact: Insights from response surface analysis.Memory & Cognition,28, 832–840.
Myung, I. J., &Pitt, M. A. (1997). Applying Occam’s razor in modeling cognition: A Bayesian approach.Psychonomic Bulletin & Review,4, 79–95.
Nelder, J. A., &Mead, R. (1965). A simplex method for function minimization.Computer Journal,7, 308–313.
Nosofsky, R. M. (1986). Attention, similarity, and the identificationcategorization relationship.Journal of Experimental Psychology: General,115, 39–57.
Nosofsky, R. M., &Johansen, M. K. (2000). Exemplar-based accounts of “multiple-system” phenomena in perceptual categorization.Psychonomic Bulletin & Review,7, 375–402.
Nosofsky, R. M., Palmeri, T. J., &McKinley, S. C. (1994). Rule-plusexception model of classification learning.Psychological Review,101, 53–79.
Peruggia, M., Van Zandt, T., &Chen, M. (2002). Was it a car or a cat I saw? An analysis of response times for word recognition. In C. Gatsonis, R. E. Kass, A. Carriquiry, A. Gelman, D. Higdon, D. K. Pauler, & I. Verdinelli (Eds.),Case studies in Bayesian statistics (Vol. 6, pp. 319–334). New York: Springer.
Pitt, M. A., Myung, I. J., &Zhang, S. (2002). Toward a method of selecting among computational models of cognition.Psychological Review,109, 472–491.
Rissanen, J. (1996). Fisher information and stochastic complexity.IEEE Transactions on Information Theory,42, 40–47.
Rissanen, J. (2001). Strong optimality of the normalized ML models as universal codes and information in data.IEEE Transactions on Information Theory,47, 1712–1717.
Rouder, J. N., &Lu, J. (2005). An introduction to Bayesian hierarchical models with an application in the theory of signal detection.Psychonomic Bulletin & Review,12, 573–604.
Rouder, J. N., Sun, D., Speckman, P. L., Lu, J., &Zhou, D. (2003). A hierarchical Bayesian statistical framework for response time distributions.Psychometrika,68, 589–606.
Rubin, D. C., &Wenzel, A. E. (1996). One hundred years of forgetting: A quantitative description of retention.Psychological Review,103, 734–760.
Schwarz, G. (1978). Estimating the dimension of a model.Annals of Statistics,6, 461–464.
Shepard, R. N. (1980). Multidimensional scaling, tree-fitting, and clustering.Science,210, 390–398.
Shepard, R. N. (1987). Toward a universal law of generalization for psychological science.Science,237, 1317–1323.
Shepard, R. N. (1991). Integrality versus separability of stimulus dimensions: From an early convergence of evidence to a proposed theoretical basis. In J. R. Pomerantz & G. L. Lockhead (Eds.),The perception of structure: Essays in honor of Wendell R. Garner (pp. 53–71). Washington, DC: American Psychological Association.
Tenenbaum, J. B. (1996). Learning the structure of similarity. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.),Advances in neural information processing systems (Vol. 8, pp. 3–9). Cambridge, MA: MIT Press.
Tenenbaum, J. B. (1999). Bayesian modeling of human concept learning. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.),Advances in neural information processing systems (Vol. 11, pp. 59–65). Cambridge, MA: MIT Press.
Treat, T. A., McFall, R., Viken, R. J., &Kruschke, J. K. (2001). Using cognitive science methods to assess the role of social information processing in sexually coercive behavior.Psychological Assessment,13, 549–565.
Tversky, A. (1977). Features of similarity.Psychological Review,84, 327–352.
Webb, M. R., &Lee, M. D. (2004). Modeling individual differences in category learning. In K. Forbus, D. Gentner, & T. Regier (Eds.),Proceedings of the 26th Annual Conference of the Cognitive Science Society (pp. 1440–1445). Mahwah, NJ: Erlbaum.
Wixted, J. T., &Ebbesen, E. B. (1997). Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions.Memory & Cognition,25, 731–739.
Yang, L., &Lewandowsky, S. (2003). Context-gated knowledge partitioning in categorization.Journal of Experimental Psychology: Learning, Memory, & Cognition,29, 663–679.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by Australian Research Council Grant DP0451793.
Rights and permissions
About this article
Cite this article
Lee, M.D., Webb, M.R. Modeling individual differences in cognition. Psychonomic Bulletin & Review 12, 605–621 (2005). https://doi.org/10.3758/BF03196751
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03196751