An introduction to the use of neural networks in control systems

The purpose of this paper is to provide a quick overview of neural networks and to explain how they can be used in control systems. We introduce the multilayer perceptron neural network and describe how it can be used for function approximation. The backpropagation algorithm (including its variations) is the principal procedure for training multilayer perceptrons; it is briefly described here. Care must be taken, when training perceptron networks, to ensure that they do not overfit the training data and then fail to generalize well in new situations. Several techniques for improving generalization are discussed. The paper also presents three control architectures: model reference adaptive control, model predictive control, and feedback linearization control. These controllers demonstrate the variety of ways in which multilayer perceptron neural networks can be used as basic building blocks. We demonstrate the practical implementation of these controllers on three applications: a continuous stirred tank reactor, a robot arm, and a magnetic levitation system. Copyright © 2002 John Wiley & Sons, Ltd.

[1]  Kent Robertson Van Horn,et al.  Design and application , 1967 .

[2]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[3]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[4]  L. E. Scales,et al.  Introduction to Non-Linear Optimization , 1985 .

[5]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[6]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[7]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[8]  David D. Brengel,et al.  Multistep nonlinear predictive controller , 1989 .

[9]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[10]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[11]  C. Charalambous,et al.  Conjugate gradient algorithm for efficient training of artifi-cial neural networks , 1990 .

[12]  C. Charalambous,et al.  Conjugate gradient algorithm for efficient training of artifi-cial neural networks , 1990 .

[13]  David F. Shanno,et al.  Recent advances in numerical techniques for large scale optimization , 1990 .

[14]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[15]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[16]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[17]  B. Widrow,et al.  Adaptive inverse control , 1987, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[18]  Eduardo D. Sontag,et al.  Neural Networks for Control , 1993 .

[19]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[20]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[21]  Bernard Widrow,et al.  Neural networks: applications in industry, business and science , 1994, CACM.

[22]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[23]  Martin T. Hagan,et al.  Neural network design , 1995 .

[24]  Warren S. Sarle,et al.  Stopped Training and Other Remedies for Overfitting , 1995 .

[25]  Duc Truong Pham,et al.  Neural Networks for Identification, Prediction and Control , 1995 .

[26]  S. N. Balakrishnan,et al.  Neurocontrol: A literature survey , 1996 .

[27]  Marzuki Khalid,et al.  Neuro-control and its applications , 1996 .

[28]  S. M. Phillips,et al.  IDENTIFICATION AND CONTROL , 1996 .

[29]  P. J. Haley,et al.  Neural generalized predictive control , 1996, Proceedings of the 1996 IEEE International Symposium on Intelligent Control.

[30]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[31]  Johan A. K. Suykens,et al.  NLq Theory: A Neural Control Framework with Global Asymptotic Stability Criteria , 1997, Neural Networks.

[32]  Snehasis Mukhopadhyay,et al.  Adaptive control using neural networks and approximate models , 1997, IEEE Trans. Neural Networks.

[33]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[34]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[35]  M. Agarwal.  A systematic classification of neural-network-based control , 1997 .

[36]  Tomas Hrycej,et al.  Neurocontrol: Towards an Industrial Control Methodology , 1997 .

[37]  David L. Elliott,et al.  Neural Systems for Control , 1997 .

[38]  Thomas H. Kerr,et al.  Critique of some neural network architectures and claims for control and estimation , 1998 .

[39]  Martin T. Hagan,et al.  Neural networks for control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[40]  Martin T. Hagan,et al.  Neural networks for control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[41]  M. Hagan,et al.  TRAINING RECURRENT NETWORKS FOR FILTERING AND CONTROL , 1999 .

[42]  Allan Pinkus,et al.  Approximation theory of the MLP model in neural networks , 1999, Acta Numerica.

[43]  Roger L. Schultz,et al.  Training Recurrent Neural Networks for Filtering and Control , 1999 .

[44]  Proceedings of the 1999 American Control Conference , 1999 .

[45]  Federico Girosi,et al.  Generalization bounds for function approximation from scattered noisy data , 1999, Adv. Comput. Math..

[46]  Manolis A. Christodoulou,et al.  Adaptive Control with Recurrent High-order Neural Networks , 2000, Advances in Industrial Control.

[47]  Niels Kjølstad Poulsen,et al.  Neural Networks for Modelling and Control of Dynamic Systems: A Practitioner’s Handbook , 2000 .

[48]  Fahmida N. Chowdhury,et al.  A survey of neural networks applications in automatic control , 2001, Proceedings of the 33rd Southeastern Symposium on System Theory (Cat. No.01EX460).

[49]  M.T. Hagan,et al.  Backpropagation through time for a general class of recurrent network , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[50]  O. De Jesus,et al.  Forward perturbation algorithm for a general class of recurrent network , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[51]  O. De Jesus,et al.  Analysis of recurrent network training and suggestions for improvements , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[52]  Guo-Ping Liu,et al.  Nonlinear Identification and Control , 2001 .

[53]  Marko Bacic,et al.  Model predictive control , 2003 .

[54]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[55]  J. Sjöberg.  Neural networks for modelling and control of dynamic systems: M. Nørgaard, O. Ravn, N. K. Poulsen and L. K. Hansen. Springer-Verlag, London Berlin Heidelberg, 2000, pp. xiv+246 , 2004 .