Neural networks as process controllers-optimization aspects

Neural networks are now being extensively used as feedback controllers. The authors overview the basic approaches to neurocontroller development and concentrate their attention on the "model-based neurocontrol design" approach. Controller design is viewed as an optimization problem, and a basic distinction is made between gradient-based and nongradient-based algorithms. The former impose constraints on the design problem in order to facilitate the computational aspects of the optimization, whereas nongradient-based optimization allows for general problem formulations but at significant computational cost. The "Parametrized Neurocontroller" concept is discussed to motivate the need for nongradient-based optimization and an evolutionary optimization algorithm is presented.

[1]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[2]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[3]  Pierre Roussel-Ragot,et al.  Neural Networks and Nonlinear Adaptive Filtering: Unifying Concepts and New Algorithms , 1993, Neural Computation.

[4]  B. Widrow,et al.  The truck backer-upper: an example of self-learning in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[5]  A. P. Wieland,et al.  Evolving neural network controllers for unstable systems , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[6]  Hans J. Bremermann,et al.  How the Brain Adjusts Synapses - Maybe , 1991, Automated Reasoning: Essays in Honor of Woody Bledsoe.

[7]  V. Vemuri,et al.  A comparison of adaptive critic and chemotaxis methods in adaptive control , 1995 .

[8]  W. Foslien,et al.  Parametrized neurocontrollers , 1993, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[9]  W. Foslien,et al.  Fuzzy controller synthesis with neural network process models , 1993, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[10]  Walter C. Merrill,et al.  Design and evaluation of a robust dynamic neurocontroller for a multivariable aircraft control problem , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[11]  Samuel H. Brooks.  A Discussion of Random Methods for Seeking Maxima , 1958 .

[12]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[13]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[14]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[15]  Richard S. Sutton,et al.  Sequential Decision Problems and Neural Networks , 1989, NIPS 1989.

[16]  Patrick van der Smagt.  Minimisation methods for training feedforward neural networks , 1994, Neural Networks.

[17]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[18]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[19]  Bernard Widrow,et al.  THE TRUCK BACKER-UPPER , 1990 .

[20]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  Walter C. Merrill,et al.  Towards practical control design using neural computation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.