Abstract
In this paper, we observe some important aspects of Hebbian and error-correction learning rules for complex-valued neurons. These learning rules, which were previously considered for the multi-valued neuron (MVN) whose inputs and output are located on the unit circle, are generalized for a complex-valued neuron whose inputs and output are arbitrary complex numbers. The Hebbian learning rule is also considered for the MVN with a periodic activation function. It is experimentally shown that Hebbian weights, even if they still cannot implement an input/output mapping to be learned, are better starting weights for the error-correction learning, which converges faster starting from the Hebbian weights rather than from the random ones.
Similar content being viewed by others
Notes
The data are available at http://www.commsp.ee.ic.ac.uk/~mandic/wind-dataset.zip and the same data were used in Goh et al. (2006).
References
Aizenberg I (2008) Solving the XOR and parity n problems using a single universal binary neuron. Soft Comput 12(3):215–222
Aizenberg I (2010) A periodic activation function and a modified learning algorithm for a multi-valued neuron. IEEE Trans Neural Netw 21(12):1939–1949
Aizenberg I (2011) Complex-valued neural networks with multi-valued neurons. Springer, Heidelberg
Aizenberg NN, Aizenberg IN (1992) CNN based on multi-valued neuron as a model of associative memory for gray-scale images. In: Proceedings of the second IEEE international workshop on cellular neural networks and their applications. Technical University Munich, Germany, October 14–16, pp 36–41
Aizenberg I, Moraga C (2007) Multilayer feedforward neural network based on multi-valued neurons (MLMVN) and a backpropagation learning algorithm. Soft Comput 11(2):169–183
Aizenberg NN, Ivaskiv YL, Pospelov DA (1971) About one generalization of the threshold function. Doklady Akademii Nauk SSSR (Rep Acad Sci USSR) 196(6):1287–1290 (in Russian)
Aizenberg I, Aizenberg N, Vandewalle J (2000) Multi-valued and universal binary neurons theory, learning and applications. Kluwer, Boston
Aizenberg I, Moraga C, Paliy D (2005) Feedforward neural network based on multi-valued neurons. In: Reusch B (ed) Computational intelligence, theory and applications. Advances in soft computing, vol XIV. Springer, Berlin, pp 599–612
Aoki H, Watanabe E, Nagata A, Kosugi Y (2001) Rotation-invariant image association for endoscopic positional identification using complex-valued associative memories. In: Mira J, Prieto A (eds) Bio-inspired applications of connectionism. Lecture notes in computer science, vol 2085. Springer, Berlin, pp 369–374
Fiori S (2003) Extended Hebbian learning for blind separation of complex-valued sources. IEEE Trans Circuits Syst Part II 50(4):195–202
Fiori S (2005) Non-linear complex-valued extensions of Hebbian learning: an essay. Neural Comput 17(4):779–838
Goh SL, Chen M, Popovic DH, Aihara K, Obradovic D, Mandic DP (2006) Complex-valued forecasting of wind profile. Renew Energy 31:1733–1750
Haykin S (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Englewood Cliffs
Hebb DO (1949) The organization of behavior. Wiley, New York
Hirose A (2006) Complex-valued neural networks. Springer, Berlin
Jankowski S, Lozowski A, Zurada JM (1996) Complex-valued multistate neural associative memory. IEEE Trans Neural Netw 7:1491–1496
Mandic D, Su Lee Goh V (2009) Complex valued nonlinear adaptive filters noncircularity. Widely linear and neural models. Wiley, New York
Muezzinoglu MK, Guzelis C, Zurada JM (2003) A new design method for the complex-valued multistate Hopfield associative memory. IEEE Trans Neural Netw 14(4):891–899
Rosenblatt F (1960) on the convergence of reinforcement procedures in simple perceptron. Report VG 1196-G-4. Cornell Aeronautical Laboratory, Buffalo, NY
Acknowledgments
This work is supported by the National Science Foundation under Grant 0925080.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Aizenberg, I. Hebbian and error-correction learning for complex-valued neurons. Soft Comput 17, 265–273 (2013). https://doi.org/10.1007/s00500-012-0891-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-012-0891-8