Fault-tolerance inclusion in neural networks by a concurrent training algorithm

A learning algorithm, referred to as concurrent training, based on genetic algorithms for a neural network with connected modules is described. The algorithm does not require the knowledge of training sets for each module so that all modules can be trained concurrently. For an N module system, N separate pools of chromosomes are maintained and updated. The concurrent training algorithm is applied to train multilayered feedforward networks by considering each layer of connections to be a 1-layer network module. The algorithm is tested using the 4-bit parity problem and a linearly nonseparable classification problem. Experiment results are presented and the learning behavior and performance is analyzed.<<ETX>>

[1]  Thomas P. Caudell,et al.  Parametric Connectivity: Training of Constrained Networks using Genetic Algorithms , 1989, ICGA.

[2]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[3]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[4]  Hugo de Garis,et al.  Genetic Programming , 1990, ML.

[5]  John R. Koza,et al.  Genetic generation of both the weights and architecture for a neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[6]  Yuval Davidor,et al.  A Naturally Occurring Niche and Species Phenomenon: The Model and First Results , 1991, ICGA.

[7]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[8]  Chalapathy Neti,et al.  Maximally fault-tolerant neural networks and nonlinear programming , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[9]  C. H. Sequin,et al.  Fault tolerance in artificial neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  L. Darrell Whitley,et al.  Optimizing Neural Networks Using FasterMore Accurate Genetic Search , 1989, ICGA.

[13]  M. Naraghi-Pour,et al.  Fault tolerance design of feedforward networks , 1994, Proceedings of 1994 37th Midwest Symposium on Circuits and Systems.