Evolving Neural Network Structures: An Evaluation of Encoding Techniques

Feed-forward neural network structures, trained with back-propagation, are adapted by the use of the genetic algorithm (GA). Through this search technique problem specific topologies are found. The method used to represent network structure, in a form suitable for the GA, is investigated. Comparisons are made between three such encoding methods. Details are given of how these representational schemes can influence the performance of both the genetic algorithm and the resultant neural networks found by the GA.

[1]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[2]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[3]  Robert F. Port,et al.  Fractally configured neural networks , 1991, Neural Networks.

[4]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[7]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[8]  Larry J. Eshelman,et al.  Using genetic search to exploit the emergent behavior of neural networks , 1990 .

[9]  Heinrich Braun,et al.  Evolving Neural Feedforward Networks , 1993 .

[10]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[11]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[12]  Tariq Samad,et al.  Designing Application-Specific Neural Networks Using the Genetic Algorithm , 1989, NIPS.

[13]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[14]  Lawrence D. Jackel,et al.  Large Automatic Learning, Rule Extraction, and Generalization , 1987, Complex Syst..

[15]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..