Optimal control using a neural/evolutionary hybrid system

One of the biggest hurdles to developing neurocontrollers is the difficulty in establishing good training data for the neural network. We propose a hybrid approach to the development of neurocontrollers that employs both evolutionary computation (EC) and neural networks (NN). EC is used to discover appropriate control actions for specific plant states. The survivors of the evolutionary process are used to construct a training set for the NN. The NN learns the training set, is able to generalize to new plant states, and is then used for neurocontrol. Thus the EC/NN approach combines the broad, parallel search of EC with the rapid execution and generalization of NN to produce a viable solution to the control problem. The paper presents the EC/NN hybrid and demonstrates its utility in developing a neurocontroller that demonstrates stability, generalization, and optimality.

[1]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[2]  Tariq Samad,et al.  Designing Application-Specific Neural Networks Using the Genetic Algorithm , 1989, NIPS.

[3]  Tony R. Martinez,et al.  Using Evolutionary Computation to Generate Training Set Data for Neural Networks , 1995, ICANNGA.

[4]  Alexis P. Wieland,et al.  Evolving Controls for Unstable Systems , 1991 .

[5]  Steve G. Romaniuk Evolutionary Growth Perceptrons , 1993, ICGA.

[6]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  A. P. Wieland,et al.  Evolving neural network controllers for unstable systems , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[8]  Maureen Caudill,et al.  Evolutionary neural networks , 1991 .

[9]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[10]  Tony R. Martinez,et al.  A General Evolutionary/Neural Hybrid Approach to Learning Optimization Problems , 1996 .

[11]  Tony R. Martinez,et al.  Robust optimization using training set evolution , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[14]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .