Hierarchical genetic algorithm based neural network design

In this paper, we propose a novel genetic algorithm based design procedure for multi-layer feedforward neural network. Hierarchical genetic algorithm is used to evolve both neural network topology and parameters. Compared with traditional genetic algorithm based designs for neural network, the proposed hierarchical approach addressed several deficiencies highlighted in literature. A multi-objective function is used herein to optimize the performance and topology of the evolved neural network. Two benchmark problems are successfully verified and the proposed algorithm proves to be competitive or even superior to the traditional back-propagation network in Mackey-Glass chaotic time series prediction.

[1]  D. R. McGregor,et al.  Designing application-specific neural networks using the structured genetic algorithm , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[2]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[3]  Lawrence Davis,et al.  Hybridizing the Genetic Algorithm and the K Nearest Neighbors Classification Algorithm , 1991, ICGA.

[4]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[5]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[6]  David B. Fogel.  Selecting an optimal neural network , 1990, [Proceedings] IECON '90: 16th Annual Conference of IEEE Industrial Electronics Society.

[7]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[8]  Seppo J. Ovaska,et al.  Speech signal restoration using an optimal neural network structure , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[9]  K. F. Man,et al.  Hierarchical genetic fuzzy controller for a solar power plant , 1998, IEEE International Symposium on Industrial Electronics. Proceedings. ISIE'98 (Cat. No.98TH8357).

[10]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[11]  Richard Lippmann,et al.  Using Genetic Algorithms to Improve Pattern Classification Performance , 1990, NIPS.