Evolutionary modular neural networks for intelligent systems

The evolutionary approach to artificial neural networks has been rapidly developing in recent years and shows great potential as a powerful tool. However, most evolutionary neural networks have paid little attention to the fact that they can evolve from modules. This paper presents a hybrid method of modular neural networks and evolutionary algorithm as a promising model for intelligent systems. To build a neural network system that is rich in autonomy and creativity, some ideas of artificial life have been adopted. This paper describes the concepts and methodologies for the evolvable model of modular neural networks, which might not only develop spontaneously new functionality, but also grow and evolve its own structure autonomously. We show the potential of the method by applying it to a visual categorization task with handwritten digits. The evolutionary mechanism has shown a strong potential to generate useful network architectures from an initial set of randomly connected networks. Q 1998 John Wiley & Sons, Inc.

[1]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[2]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[3]  Stewart W. Wilson The Genetic Algorithm and Simulated Evolution , 1987, ALIFE.

[4]  Shigeo Abe,et al.  Neural Networks and Fuzzy Systems , 1996, Springer US.

[5]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[6]  David H. Sharp,et al.  A connectionist model of development. , 1991, Journal of theoretical biology.

[7]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[8]  D. Parisi,et al.  Growing neural networks , 1991 .

[9]  Sung-Bae Cho,et al.  Combining multiple neural networks by fuzzy integral for robust classification , 1995, IEEE Trans. Syst. Man Cybern..

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  Alexander H. Waibel,et al.  The Meta-Pi Network: Building Distributed Knowledge Representations for Robust Multisource Pattern Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Frank Dellaert,et al.  Toward an evolvable model of development for autonomous agent synthesis , 1994 .

[13]  L. Darrell Whitley,et al.  Optimizing Neural Networks Using FasterMore Accurate Genetic Search , 1989, ICGA.

[14]  R. H. Phaf,et al.  CALM: Categorizing and learning module , 1992, Neural Networks.

[15]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..