Skip to main content

The Brain’s Cognitive Dynamics: The Link between Learning, Attention, Recognition, and Consciousness

  • Conference paper
Knowledge-Based Intelligent Information and Engineering Systems (KES 2003)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2773))

Abstract

The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach a predictive and attentive consensus between what is expected and what is there in the outside world. It is suggested that all conscious states in the brain are resonant states, and that these resonant states trigger learning of sensory and cognitive representations when they amplify and synchronize distributed neural signals that are bound by the resonance. Thus, processes of learning, intention, attention, synchronization, and consciousness are intimately bound up together. The name Adaptive Resonance Theory, or ART, summarizes the predicted link between these processes. Illustrative psychophysical and neurobiological data have been explained and quantitatively simulated using these concepts in the areas of early vision, visual object recognition, auditory streaming, and speech perception, among others. It is noted how these mechanisms seem to be realized by known laminar circuits of the visual cortex. In particular, they seem to be operative at all levels of the visual system. Indeed, the mammalian neocortex, which is the seat of higher biological intelligence in all modalities, exhibits a remarkably uniform laminar architecture, with six characteristic layers and sublamina. These known laminar ART, or LAMINART, models illustrate the emerging paradigm of Laminar Computing which is attempting to answer the fundamental question: How does laminar computing give rise to biological intelligence? These laminar circuits also illustrate the fact that, in a rapidly growing number of examples, an individual model can quantitatively simulate the recorded dynamics of identified neurons in anatomically characterized circuits and the behaviors that they control. In this precise sense, the classical Mind/Body problem is starting to get solved. It is further noted that many parallel processing streams of the brain often compute properties that are complementary to each other, much as a lock fits a key or the pieces of a puzzle fit together. Hierarchical and parallel interactions within and between these processing streams can overcome their complementary deficiencies by generating emergent properties that compute complete information about a prescribed form of intelligent behavior. This emerging paradigm of Complementary Computing is proposed to be a better paradigm for understanding biological intelligence than various previous proposals, such as the postulate of independent modules that are specialized to carry out prescribed intelligent tasks. Complementary computing is illustrated by the fact that sensory and cognitive processing in the What processing stream of the brain, that passes through cortical areas V1-V2-V4-IT on the way to prefrontal cortex, obey top-down matching and learning laws that are often complementary to those used for spatial and motor processing in the brain’s Where/How processing stream, that passes through cortical areas V1-MT-MST-PPC on the way to prefrontal cortex. These complementary properties enable sensory and cognitive representations to maintain their stability as we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports their spatial and motor processes cannot lead to resonance. Because ART principles and mechanisms clarify how incremental learning can occur autonomously without a loss of stability under both unsupervised and supervised conditions in response to a rapidly changing world, algorithms based on ART have been used in a wide range of applications in science and technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 74.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baloch, A.A., Grossberg, S.: A neural model of high-level motion processing: Line motion and formotion dynamics. Vision Research 37, 3037–3059 (1997)

    Article  Google Scholar 

  2. Banuet, J.-P., Grossberg, S.: Probing cognitive processes through the structure of event-related potentials during learning: An experimental and theoretical analysis. Applied Optics 26, 4931–4946 (1987); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Article  Google Scholar 

  3. Boardman, I., Grossberg, S., Myers, C., Cohen, M.A.: Neural dynamics of perceptual order and context effects for variable-rate speech syllables. Perception and Psychophysics 61, 1477–1500 (1999)

    Article  Google Scholar 

  4. Bradski, G., Grossberg, S.: Fast-learning VIEWNET architectures for recognizing three-dimensional objects from multiple two-dimensional views. Neural Networks 8, 1053–1080 (1995)

    Article  Google Scholar 

  5. Bradski, G., Carpenter, G.A., Grossberg, S.: Working memory networks for learning temporal order with application to three-dimensional visual object recognition. Neural Computation 4, 270–286 (1992)

    Article  Google Scholar 

  6. Bradski, G., Carpenter, G.A., Grossberg, S.: STORE working memory networks for storage and recall of arbitrary temporal sequences. Biological Cybernetics 71, 469–480 (1994)

    Article  Google Scholar 

  7. Carpenter, G.A.: Neural network models for pattern recognition and associative memory. Neural Networks 2, 243–257 (1989); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Article  Google Scholar 

  8. Carpenter, G.A.: Distributed learning, recognition, and prediction byART and ARTMAP neural networks. Neural Networks 10, 1473–1494 (1997)

    Article  Google Scholar 

  9. Carpenter, G.A., Grossberg, S.: A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing 37, 54–115 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)

    Article  MATH  Google Scholar 

  10. Carpenter, G.A., Grossberg, S.: ART 2: Self-organization of stable category recognition codes for analog input patterns. Applied Optics 26, 4919–4930 (1987); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Article  Google Scholar 

  11. Carpenter, G.A., Grossberg, S.: ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures. Neural Networks 3, 129–152 (1990); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Article  Google Scholar 

  12. Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Google Scholar 

  13. Carpenter, G.A., Grossberg, S.: A self-organizing neural network for supervised learning, recognition, and prediction. IEEE Communications Magazine, 38–49 (September 1992)

    Google Scholar 

  14. Carpenter, G.A., Grossberg, S.: Normal and amnesic learning, recognition, and memory by a neural model of cortico-hippocampal interactions. Trends in Neurosciences 16, 131–137 (1993)

    Article  Google Scholar 

  15. Carpenter, G.A., Grossberg, S., Markuzon, N., Reynolds, J.H., Rosen, D.B.: Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimentional maps. IEEE Transactions on Neural Networks 3, 698–713 (1992)

    Article  Google Scholar 

  16. Carpenter, G.A., Grossberg, S., Reynolds, J.H.: ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks 4, 565–588 (1991); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Article  Google Scholar 

  17. Carpenter, G.A., Grossberg, S., Reynolds, J.H.: A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems. IEEE Transactions on Neural Networks 6, 1330–1336 (1995)

    Article  Google Scholar 

  18. Carpenter, G.A., Grossberg, S., Rosen, D.B.: ART 2-A: An adaptive resonance algorithm for rapid category learning and recognition. Neural Networks 4, 493–504 (1991)

    Article  Google Scholar 

  19. Chey, J., Grossberg, S., Mingolla, E.: Neural dynamics of motion grouping: From aperture ambiguity to object speed and direction. Journal of the Optical Society of America A 14, 2570–2594 (1997)

    Article  Google Scholar 

  20. Cohen, M.A., Grossberg, S.: Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Transactrions on Systems, Man, and Cybernetics 13, 815–826 (1983); Reprinted in Grossberg, S.: The Adaptive Brain, vol. I. Elsevier Science, Amsterdam (1987)

    Article  MathSciNet  MATH  Google Scholar 

  21. Cohen, M.A., Grossberg, S.: Neural dynamics of speech and language coding: Developmental programs, perceptual grouping, and competition for short term memory. Human Neurobiology 5, 1–22 (1986); Reprinted in Grossberg, S.: The Adaptive Brain, vol. II. Elsevier Science, Amsterdam (1987)

    Google Scholar 

  22. Cohen, M.A., Grossberg, S.: Masking fields: A massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. Applied Optics 26, 1866–1891 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)

    Article  Google Scholar 

  23. Cohen, M.A., Grossberg, S., Stork, D.G.: Speech perception and production by a self-organizing neural network. In: Lee, Y.C. (ed.) Evolution, Learning, Cognition, and Advanced Architectures., World Scientific, Singapore (1988); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Google Scholar 

  24. Ellias, S.A., Grossberg, S.: Pattern formation, contrast control, and oscillations in the short-term memory of shunting on-center off-surround networks. Biological Cybernetics 20, 69–98 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  25. Gove, A., Grossberg, S., Mingolla, E.: Brightness perception, illusory contours, and corticogeniculate feedback. Visual Neuroscience 12, 1027–1052 (1995)

    Article  Google Scholar 

  26. Granger, E., Rubin, M., Grossberg, S., Lavoie, P.: A what-and-where fusion neural network for recognition and tracking of multiple radar emitters. Neural Networks 14, 325–344 (2001)

    Article  Google Scholar 

  27. Grossberg, S.: On learning and energy-entropy dependence in recurrent and nonrecurrent signed networks. Journal of Statistical Physics 1, 319–350 (1969)

    Article  MathSciNet  Google Scholar 

  28. Grossberg, S.: Pavlovian pattern learning by nonlinear neural networks. Proceedings of the National Academy of Sciences 68, 828–831 (1971)

    Article  MathSciNet  MATH  Google Scholar 

  29. Grossberg, S.: Pattern learning by functional-differential neural networks with arbitrary path weights. In: Schmitt, K. (ed.) Delay and functional-differential equations and their applications, Academic Press, New York (1972)

    Google Scholar 

  30. Grossberg, S.: Contour enhancement, short term memory, and constancies in reverberating neural Networks. Studies in Applied Mathematics LII, 213–257 (1973); Reprinted in Grossberg, S.: Studies of Mind and Brain.Kluwer/Reidel, New York (1982)

    MathSciNet  Google Scholar 

  31. Grossberg, S.: Classical and instrumental learning by neural networks. In: Rosen, R., Snell, F. (eds.) Progress in Theoretical Biology, vol. 3, pp. 51–141. Academic Press, New York (1974)

    Chapter  Google Scholar 

  32. Grossberg, S.: Adaptive pattern classification and universal recoding, I: Parallel development and coding of neural feature detectors. Biological Cybernetics 23, 121–134 (1976); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)

    Article  MathSciNet  MATH  Google Scholar 

  33. Grossberg, S.: Adaptive pattern classification and universal recoding, II: Feedback, expectation, olfaction, and illusions. Biological Cybernetics 23, 187–202 (1976)

    Article  MathSciNet  MATH  Google Scholar 

  34. Grossberg, S.: Pattern formation by the global limits of a nonlinear competitive interaction in n dimensions. Journal of Mathematical Biology 4, 237–256 (1977)

    Article  MathSciNet  MATH  Google Scholar 

  35. Grossberg, S.: A theory of human memory: Self-organization and performance of sensory-motor codes, maps and plans. In: Rosen, R., Snell, F. (eds.) Progress in Theoretical Biology, vol. 5, pp. 233–374. Academic Press, New York (1978); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)

    Chapter  Google Scholar 

  36. Grossberg, S.: Behavioral contrast in short term memory: serial binary memory models or parallel continuous memory models. Journal of Mathematical Psychology 17, 199–219 (1978); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)

    Article  Google Scholar 

  37. Grossberg, S.: Competition, decision, and consensus. Journal of Mathematical Analysis and Applications 66, 470–493 (1978); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)

    Article  MathSciNet  MATH  Google Scholar 

  38. Grossberg, S.: Decisions, patterns, and oscillations in nonlinear competitive systems with applications to Volterra-Lotka systems. Journal of Theoretical Biology 73, 101–130 (1978)

    Article  MathSciNet  Google Scholar 

  39. Grossberg, S.: Biological competition: Decision rules, pattern formation, and oscillations. Proceedings of the National Academy of Sciences 77, 2338–2342 (1980)

    Article  MATH  Google Scholar 

  40. Grossberg, S.: How does a brain build a cognitive code? Psychological Review 87, 1–51 (1980); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)

    Article  Google Scholar 

  41. Grossberg, S.: Studies of Mind and Brain: Neural principles of learning, perception, development, cognition, and motor control. Kluwer/Reidel, New York (1982)

    Book  MATH  Google Scholar 

  42. Grossberg, S.: Associative and competitive principles of learning and development: The temporal unfolding and stability of STM and LTM patterns. In: Amari, S., Arbib, M. (eds.) Competition and Cooperation in Neural Nets. Lecture Notes in Biomathematics, vol. 45, pp. 295–341. Springer, New York (1982); Reprinted in Gossberg, S.: The Adaptive Brain, vol. I. Elsevier Science, Amsterdam (1987)

    Chapter  Google Scholar 

  43. Grossberg, S.: Processing of expected and unexpected events during conditioning and attention: A psychophysiological theory. Psychological Review 89, 529–572 (1982)

    Article  Google Scholar 

  44. Grossberg, S.: Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. Biological Psychiatry 19, 1075–1118 (1984)

    Google Scholar 

  45. Grossberg, S.: Some psychophysiological and pgharmacological correlates of a developmental, cognitive, and motivational theory. In: Karrer, R., Cohen, J., Tueting, P. (eds.) Brain and Information: Event Related Potentials, vol. 425, pp. 58–151. New York Academy of Sciences (1984); Reprinted in Grossberg, S.: The Adaptive Brain, vol. 1. Elsevier Science, Amsterdam (1987)

    Google Scholar 

  46. Grossberg, S.: Unitization, automaticity, temporal order, and word recognition. Cognition and Brain Theory 7, 263–283 (1984)

    Google Scholar 

  47. Grossberg, S.: Competitive learning: From interactive activation to adaptive resonance. Cognitive Science 11, 23–63 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1982)

    Article  Google Scholar 

  48. Grossberg, S.: The Adaptive Brain, vol. I & II. Elsevier Science, Amsterdam (1987)

    Google Scholar 

  49. Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)

    Google Scholar 

  50. Grossberg, S.: Nonlinear neural networks: Principles, mechanisms, and architectures. Neural Networks 1, 17–61 (1988); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)

    Article  Google Scholar 

  51. Grossberg, S.: The attentive brain. American Scientist 83, 438–449 (1995)

    Google Scholar 

  52. Grossberg, S.: How does the cerebral cortex work: Learning, attention, and grouping by the laminar circuits of visual cortex. Spatial Vision 12, 163–186 (1999)

    Article  Google Scholar 

  53. Grossberg, S.: The link between brain learning, attention, and consciousness. Consciousness and Cognition 8, 1–44 (1999)

    Article  Google Scholar 

  54. Grossberg, S.: Pitch-based streaming in auditory perception. In: Griffith, N., Todd, P. (eds.) Musical networks: Parallel Distributed Perception and Performance, pp. 117–140. MIT Press, Cambridge (1999)

    Google Scholar 

  55. Grossberg, S.: The complementary brain: Unifying brain dynamics and modularity. Trends in Cognitive Sciences, 233–246 (2000)

    Google Scholar 

  56. Grossberg, S.: The imbalanced brain: From normal behavior to schizophrenia. Biological Psychiatry, 81–98 (2000)

    Google Scholar 

  57. Grossberg, S.: How hallucinations may arise from brain mechanisms of learning, attention, and volition. Journal of the International Neuropsychological Society 6, 583–592 (2000)

    Article  Google Scholar 

  58. Grossberg, S., Boardman, I., Cohen, M.A.: Neural dynamics of variable-rate speech categorization. Journal of Experimental Psychology: Human Perception and Performance 23, 481–503 (1997)

    Article  Google Scholar 

  59. Grossberg, S., Grunewald, A.: Cortical synchronization and perceptual framing. Journal of Cognitive Neuroscience 9, 117–132 (1997)

    Article  Google Scholar 

  60. Grossberg, S., Howe, P.D.L.: A laminar cortical model of stereopsis and three-dimensional surface perception. Vision Research (2002) (in press)

    Google Scholar 

  61. Grossberg, S., Levine, D.: Some developmental and attentional biases in the contrast enhancement and short-term memory of recurrent neural networks. Journal of Theoretical Biology 53, 341–380 (1976)

    Article  MathSciNet  Google Scholar 

  62. Grossberg, S., Levine, D.: Neural dynamics of attentionally modulated Pavlovian cnditioning: Blocking, interstimulus interval, and secondary conditioning. Applied Optics 26, 5015–5030 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)

    Article  Google Scholar 

  63. Grossberg, S., Merrill, J.W.L.: A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Cognitive Brain Research 1, 3–38 (1992)

    Article  Google Scholar 

  64. Grossberg, S., Merrill, J.W.L.: The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. Journal of Cognitive Neuroscience 8, 257–277 (1996)

    Article  Google Scholar 

  65. Grossberg, S., Mingolla, E., Ross, W.D.: A neural theory of attentive visual search: Interactions of boundary, surface, spatial, and object representations. Psychological Review 101, 470–489 (1994)

    Article  Google Scholar 

  66. Grossberg, S., Mingolla, E., Ross, W.D.: Visual brain and visual perception: How does the cortex do perceptual grouping? Trends in Neurosciences 20, 106–111 (1997)

    Article  Google Scholar 

  67. Grossberg, S., Mingolla, E., Viswanathan, L.: Neural dynamics of motion integration and segmentation within and across apertures. Vision Research 41, 2521–2553 (2001)

    Article  Google Scholar 

  68. Grossberg, S., Myers, C.: The resonant dynamics of speech perception: Interword integration and duration-dependent backward effects. Psychological Review 107, 735–767 (2000)

    Article  Google Scholar 

  69. Grossberg, S., Raizada, R.D.S.: Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex. Vision Research 40, 1413–1432 (2000)

    Article  Google Scholar 

  70. Grossberg, S., Schmajuk, N.A.: Neural dynamics of attentional modulated Pavlovian conditioning: Conditioned reinforcement, inhibition, and opponent processing. Psychobiology 15, 195–240; Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)

    Google Scholar 

  71. Grossberg, S., Somers, D.: Synchronized oscillations during cooperative feature linking in a cortical model of visual perception. Neural Networks 4, 453–466 (1991)

    Article  Google Scholar 

  72. Grossberg, S., Stone, G.: Neural dynamics of attention switching and temporal order information in short term memory. Memory and Cognition 14, 451–468 (1986); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge, MA (1988)

    Article  Google Scholar 

  73. Grossberg, S., Stone, G.: Neural dynamics of word recognition and recall: Attentional priming, learning, and resonance. Psychological Review 93, 46–74 (1986); Reprinted in Grossberg, S.: The Adaptive Brain, vol. II. Elsevier Science, Amsterdam (1987)

    Article  Google Scholar 

  74. Grossberg, S., Williamson, J.R.: A self-organizing neural system for learning to recognize textured scenes. Vision Research 39, 1385–1406 (1999)

    Article  Google Scholar 

  75. Grossberg, S., Williamson, J.R.: A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual grouping and learning. Cerebral Cortex 11, 37–58 (2001)

    Article  Google Scholar 

  76. Grunewald, A., Grossberg, S.: Self-organization of binocular disparity tuning by reciprocal corticogeniculate interactions. Journal of Cognitive Neuroscience 10, 100–215 (1998)

    Article  Google Scholar 

  77. Olson, S.J., Grossberg, S.: A neural network model for the development of simple and complex cell receptive fields within cortical maps of orientation and ocular dominance. Neural Networks 11, 189–208 (1998)

    Article  Google Scholar 

  78. Raizada, R.D.S., Grossberg, S.: Context-sensitive binding by the laminar circuits of V1 and V2: A unified model of perceptual groupiing, attention, and orientation contrast. Visual Cognition 8, 431–466 (2001)

    Article  Google Scholar 

  79. Raizada, R., Grossberg, S.: Towards a Theory of the Laminar Architecture of Cerebral Cortex: Computational Clues from the Visual System. Cerebral Cortex 13, 100–113 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Grossberg, S. (2003). The Brain’s Cognitive Dynamics: The Link between Learning, Attention, Recognition, and Consciousness. In: Palade, V., Howlett, R.J., Jain, L. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2003. Lecture Notes in Computer Science(), vol 2773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45224-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-45224-9_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40803-1

  • Online ISBN: 978-3-540-45224-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics