Abstract
The information storing capacity of certain associative and auto-associative memories is calculated. For example, in a 100×100 matrix of 1 bit storage elements more than 6,500 bits can be stored associatively, and more than 688,000 bits in a 1,000×1,000 matrix. Asymptotically, the storage capacity of an associative memory increases proportionally to the number of storage elements. The usefulness of associative memories, as opposed to conventional listing memories, is discussed — especially in connection with brain modelling.
Similar content being viewed by others
References
Anderson, J.A.: Kybernetik 5, 113 (1968)
Anderson, J.A.: Math. Biosci. 14, 197 (1972)
Ashby, W.R.: Design for a brain. New York: Wiley 1952
Braitenberg, V.: Physics and mathematics of the nervous system. Conrad, M., Güttinger, W., Dal Cin, M. (eds.), p. 290 Berlin, Heidelberg, New York: Springer 1974
Braitenberg, V.: On the texture of brains. Berlin, Heidelberg, New York: Springer 1977
Braitenberg, V.: Thebretical approaches to complex systems. Heim, R., Palm, G. (eds.) p. 171. Berlin, Heidelber, New York: Springer 1978
Cajal, S.R.: Histologie du système nerveux de l'homme et des vertébrés. Paris: Maloin 1911
Gabor, D.: IBM. J. Res. Dev. 13, 156 (1969)
Hebb, D.O.: The organization of behaviour New York: Wiley 1949
van Heerden, P.J.: (and also Willshaw, D.J., Longuet-Higgins, H.C. and Buneman, O.P.) Nature 225, 177 and 178 (1970)
Longuet-Higgins, H.C., Willshaw, D.J., Buneman, O.P.: Rev. Biophys. 3, 223 (1970)
Kohonen, T.: IEEE Trans. Comp. C 21, 353 (1972)
Kohonen, T., IEEE Trans. Comp. C 23 444 (1974)
Kohonen, T., Oja, E.: Biol. Cybernetics 21, 85 (1976)
Kohonen, T.: Associative memory. Berlin, Heidelber, New York: Springer 1977
v. d. Malsburg, C.: Kybernetik 14, 85 (1973)
Marr, D.: J. Physiol. (London) 202, 437 (1969)
Marr, D.: Philos. Trans. R. Soc. London Ser. B 176, 161 (1970)
Marr, D.: Philos. Trans. R. Soc. London Ser. B 262, 23 (1971)
Nass, M.M., Cooper, L.N.: Biol. Cybernetics 19, 1 (1975)
Palm, G.: Biol. Cybernetics 31, 119 (1978)
Pfaffelhuber, E.: J. Theor. Biol. 40, 63 (1973)
Pfaffelhuber, E.: Biol. Cybernetics 18, 217 (1975)
Poggio, T.: Biol. Cybernetics 19, 201 (1975)
Rosenblatt, F.: Principles of neurodynamics, New York: Spartan Books 1962
Samuel, A.L.: IBM.J. Res. Dev. 3, 210 (1959)
Samuel, A.L.: IBM. J. Res. Dev. 11, 601 (1967)
Steinbuch, K.: Kybernetik 1, 36 (1961)
Uttley, A.M.: Automata studies. Shannon, C.E., McCarthy, J. (eds.), pp. 252 and 237, Princeton: Princeton University Press 1956
Willshaw, D.J., Buneman, O.P., Longuet-Higgins, H.C.: Nature 222, 960 (1969)
Willshaw, D.J.: Models of distributed associative memory. Thesis, University of Edinburgh 1971
Willwacher, G.: Biol. Cybernetics 24, 181 (1976)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Palm, G. On associative memory. Biol. Cybernetics 36, 19–31 (1980). https://doi.org/10.1007/BF00337019
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00337019