Evolutionary Learning of Neural Structures for Visuo-Motor Control Artificial neural networks are computing tools, modeled after the human brain in order to make its vast learning and data processing potential available to computers. These networks are known to be powerful tools with natural learning capabilities. However, learning the structure and synaptic weights of an artificial neural network to solve a complex problem can be a very difficult task. With a growing size of the required network the dimension of the search space can make it next to impossible to find a globally optimal solution. We apply a relatively new method called EANT to develop a network that moves a robot arm in a visuo-motor control scenario with the goal to align its hand with an object. EANT starts from a simple initial network and gradually develops it further using an evolutionary method. On a larger scale new neural structures are added to a current generation of networks. On a smaller scale the current individuals (structures) are optimised by changing their parameters. Using a simulation to evaluate the individuals a reinforcement learning procedure for neural topologies has been realised. We present results from experiments with two types of optimisation strategies for the parameter optimisation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Peter J Angeline, Gregory M Saunders, and Jordan B Pollack. An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks, 5:54–65, 1994.
Wolfgang Banzhaf, Peter Nordin, Robert E Keller, and Frank D Francone. Genetic Programming: An Introduction on the Automatic Evolution of Computer Programs and Its Applications. Morgan Kaufmann, San Francisco, USA, 1998.
Richard Ernest Bellman. Adaptive Control Processes. Princeton University Press, Princeton, USA, 1961.
Andrea Beltratti, Sergio Margarita, and Pietro Terna. Neural Networks for Economic and Financial Modelling. International Thomson Computer Press, London, UK, 1996.
Chris C Bissell. Control Engineering. Number 15 in Tutorial Guides in Electronic Engineering. CRC Press, Boca Raton, USA, 2nd edition, 1996.
Wolfram Blase, Josef Pauli, and Jörg Bruske. Vision-based manipulator navigation using mixtures of RBF neural networks. In International Conference on Neural Network and Brain, pages 531–534, Bejing, China, April 1998.
Ágoston E Eiben and James E Smith. Introduction to Evolutionary Computing. Springer Verlag, Berlin, Germany, 2003.
Scott E Fahlman and Christian Lebiere. The cascade-correlation learning architecture. Technical Report CMU-CS-90-100, Carnegie Mellon University, Pittsburgh, USA, August 1991.
Roger Fletcher. Practical Methods of Optimization. John Wiley & Sons, New York, Chichester, 2nd edition, 1987.
Nikolaus Hansen and Andreas Ostermeier. Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation, 9(2):159–195, 2001.
Koichi Hashimoto, editor. Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback, volume 7 of Series in Robotics and Automated Systems. World Scientific Publishing Co., Singapore, 1994.
Gilles Hermann, Patrice Wira, and Jean-Philippe Urban. Neural networks organizations to learn complex robotic functions. In Proceedings of the 11th European Symposium on Artificial Neural Networks (ESANN 2003), pages 33–38, Bruges, Belgium, April 2005.
Kurt Hornik, Maxwell B Stinchcombe, and Halbert White. Multilayer feedforward networks are universal approximators. Neural Networks, 2:359–366, 1989.
Seth Hutchinson, Greg Hager, and Peter Corke. A tutorial on visual servo control. Tutorial notes, Yale University, New Haven, USA, May 1996.
William R Hutchison and Kenneth R Stephens. The airline marketing tactician (AMT): A commercial application of adaptive networking. In Proceedings of the 1st IEEE International Conference on Neural Networks, San Diego, USA, volume 2, pages 753–756, 1987.
Martin Jägersand. Visual servoing using trust region methods and estimation of the full coupled visual-motor Jacobian. In Proceedings of the IASTED Applications of Control and Robotics, Orlando, USA, pages 105–108, January 1996.
Jae-Yoon Jung and James A Reggia. A descriptive encoding language for evolving modular neural networks. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), pages 519–530. Springer Verlag, 2004.
Yohannes Kassahun and Gerald Sommer. Automatic neural robot controller design using evolutionary acquisition of neural topologies. In 19. Fachgespräch Autonome Mobile Systeme (AMS 2005), pages 259–266, Stuttgart, Germany, December 2005.
Yohannes Kassahun and Gerald Sommer. Efficient reinforcement learning through evolutionary acquisition of neural topologies. In Proceedings of the 13th European Symposium on Artificial Neural Networks (ESANN 2005), pages 259–266, Bruges, Belgium, April 2005.
Scott Kirkpatrick, Charles Daniel Gelatt, and Mario P Vecchi. Optimization by simulated annealing. Science, 220(4598):671–680, May 1983.
James W Melody. On universal approximation using neural networks. Report from project ECE 480, Decision and Control Laboratory, University of Illinois, Urbana, USA, June 1999.
Tom M Mitchell. Machine Learning. McGraw-Hill, London, UK, 1997.
David E Moriarty and Risto Miikkulainen. Evolving obstacle avoidance behavior in a robot arm. In Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, Cape Cod, USA, 1996.
Arnold Neumaier. Complete search in continuous global optimization and constraint satisfaction. Acta Numerica, 13:271–369, June 2004.
Apostolos-Paul Refenes, editor. Neural Networks in the Capital Markets. John Wiley & Sons, New York, Chichester, USA, 1995.
Claude Robert, Charles-Daniel Arreto, Jean Azerad, and Jean-François Gaudy. Bibliometric overview of the utilization of artificial neural networks in medicine and biology. Scientometrics, 59(1):117–130, 2004.
Raúl Rojas. Neural Networks - A Systematic Introduction. Springer Verlag, Berlin, Germany, 1996.
James C Spall. Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control. John Wiley & Sons, Hoboken, USA, 2003.
Kenneth O Stanley and Risto Miikkulainen. Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2):99–127, 2002.
Robert R Trippi and Efraim Turban, editors. Neural Networks in Finance and Investing. Probus Publishing Co., Chicago, USA, 1993.
Jean-Philippe Urban, Jean-Luc Buessler, and Julien Gresser. Neural networks for visual servoing in robotics. Technical Report EEA-TROP-TR-97-05, Université de Haute-Alsace, Mulhouse-Colmar, France, November 1997.
Lee E Weiss, Arthur C Sanderson, and Charles P Neuman. Dynamic sensor-based control of robots with visual feedback. IEEE Journal of Robotics and Automation, 3(5):404–417, October 1987.
Xin Yao. Evolving artificial neural networks. Proceedings of the IEEE, 87(9):1423–1447, September 1999.
Xin Yao and Yong Liu. A new evolutionary system for evolving artificial neural networks. IEEE Transactions on Neural Networks, 8(3):694–713, May 1997.
Michael Zeller, Kenneth R Wallace, and Klaus Schulten. Biological visuo-motor control of a pneumatic robot arm. In Cihan Hayreddin Dagli, Metin Akay, C L Philip Chen, Benito R Fernandez, and Joydeep Ghosh, editors, Intelligent Engineering Systems Through Artificial Neural Networks. Proceedings of the Artificial Neural Networks in Engineering Conference, New York, volume 5, pages 645–650. American Society of Mechanical Engineers, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Siebel, N.T., Sommer, G., Kassahun, Y. (2008). Evolutionary Learning of Neural Structures for Visuo-Motor Control. In: Kelemen, A., Abraham, A., Liang, Y. (eds) Computational Intelligence in Medical Informatics. Studies in Computational Intelligence, vol 85. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75767-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-75767-2_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75766-5
Online ISBN: 978-3-540-75767-2
eBook Packages: EngineeringEngineering (R0)