Abstract
It is well known that large-scale neural networks suffer from serious problems such as the scale problem and the local minima problems. Modular architecture neural network is an approach to alleviate these problems. It is important that the construction of modular neural network is the selection or construction of a network that can converge and has the good generalization ability for a task, and the Akaike Information Criterion (AIC) is a criterion of evaluation of estimated model from observed parameters is a very useful tool for selection of network. This paper proposes a method for task allocation in a modular architecture neural network. The method allocates a best fit network that has a good generalization ability from multiple neural networks for a task with (AIC) and the state of convergence of a network, simply and certainly. The performance of proposed method is evaluated with the Fisher’ Iris data and the What and Where vision tasks.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
B.L.M. Happel and J.M.J. Murre, ‘Design and Evolution of Modular Neural Network Architectures’, Neural Networks, Volume 7, pages 985–1004, 1994.
R.A. Jacobs, M.I. Jordan and A. G. Barto, ‘Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks’, Cognitive Science 15, pages 219–250, 1991.
R.A. Jacobs and M.I. Jordan, ‘A Competitive Modular Connectionist Architecture’, Neural Information Processing Systems, Volume 3, pages 767–773, 1991.
S.J. Nowlan and G.E. Hinton, ‘Evaluation of Adaptive Mixtures of Competing Experts’, Neural Information Processing Systems, Volume 3, pages 774–780, 1991.
E. Ronco and P. Gawthrop, ‘Modular Neural Networks: A State of the Art’, CSC-95026, University of Glasgow, UK, 1995.
Y. Sakamoto, M. Ishiguro and G. Kitagawa, ‘Akaike Information Criterion Statistics’, D. Reidel Publishing Company, 1986.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Wien
About this paper
Cite this paper
Kim, HH., Anzai, Y. (1998). A Method for Task Allocation in Modular Neural Network with an Information Criterion. In: Artificial Neural Nets and Genetic Algorithms. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6492-1_110
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6492-1_110
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83087-1
Online ISBN: 978-3-7091-6492-1
eBook Packages: Springer Book Archive