Issues in the application of neural networks for tracking based on inverse control

Since 1990 a substantial amount of research has been reported in the literature concerning the identification and control of nonlinear dynamical systems using artificial neural networks. Various methods for tracking based on inverse control have been proposed, and constitute one of the main thrusts of this research effort. A significant part of this work has been heuristic in nature, and the conclusions drawn are generally justified using computer simulations. The general success of the simulation studies has also resulted in the increased use of artificial neural networks as controllers in industrial applications. As a result, there is a real need for a better understanding of the questions and problems that can arise in such contexts. This paper attempts to provide the theoretical foundations as well as insights that are essential for the efficient design of neural network controllers based on inverse control.

[1]  J. Grizzle,et al.  Necessary conditions for asymptotic tracking in nonlinear systems , 1994, IEEE Trans. Autom. Control..

[2]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[3]  Songwu Lu,et al.  Robust nonlinear system identification using neural-network models , 1998, IEEE Trans. Neural Networks.

[4]  B. Widrow,et al.  Adaptive inverse control , 1987, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[5]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[6]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[7]  S. Monaco,et al.  Nonlinear regulation for a class of discrete-time systems , 1993 .

[8]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[9]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[10]  Eduardo D. Sontag,et al.  Neural Networks for Control , 1993 .

[11]  B. Francis.  The linear multivariable regulator problem , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[12]  Richard S. Sutton,et al.  Computational Schemes and Neural Network Models for Formation and Control of Multijoint Arm Trajectory , 1995 .

[13]  Richard S. Sutton,et al.  Connectionist Learning for Control , 1995 .

[14]  Johan A. K. Suykens,et al.  Nonlinear system identification using neural networks , 1996 .

[15]  C. Lee Giles,et al.  Constructing deterministic finite-state automata in recurrent neural networks , 1996, JACM.

[16]  Kumpati S. Narendra,et al.  Neural networks in control systems , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[17]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[18]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[19]  Snehasis Mukhopadhyay,et al.  Adaptive control using neural networks and approximate models , 1997, IEEE Trans. Neural Networks.

[20]  Allan Pinkus,et al.  Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function , 1991, Neural Networks.

[21]  Kumpati S. Narendra,et al.  Gradient methods for the optimization of dynamical systems containing neural networks , 1991, IEEE Trans. Neural Networks.

[22]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[23]  Marios M. Polycarpou,et al.  Stable adaptive neural control scheme for nonlinear systems , 1996, IEEE Trans. Autom. Control..

[24]  Andrew G. Barto,et al.  Connectionist learning for control , 1990 .

[25]  A. Isidori.  Nonlinear Control Systems , 1985 .

[26]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[27]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[28]  F. Lewis,et al.  Discrete-time neural net controller for a class of nonlinear dynamical systems , 1996, IEEE Trans. Autom. Control..

[29]  S Z Qin,et al.  Comparison of four neural net learning methods for dynamic system identification , 1992, IEEE Trans. Neural Networks.

[30]  Anuradha M. Annaswamy,et al.  Stable Adaptive Systems , 1989 .

[31]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[32]  K. S. Narendra,et al.  Neural networks for control theory and practice , 1996, Proc. IEEE.

[33]  Henk Nijmeijer.  Local (dynamic) Input-Output Decoupling of Discrete Time Nonlinear Systems , 1987 .

[34]  H. Nijmeijer,et al.  Dynamic input-output decoupling of nonlinear control systems , 1988 .

[35]  Hassan K. Khalil,et al.  Adaptive control of a class of nonlinear discrete-time systems using neural networks , 1995, IEEE Trans. Autom. Control..

[36]  Johan A. K. Suykens,et al.  Artificial neural networks for modelling and control of non-linear systems , 1995 .

[37]  Jessy W. Grizzle,et al.  Feedback Linearization of Discrete-Time Systems , 1986 .

[38]  Lennart Ljung,et al.  Nonlinear black-box modeling in system identification: a unified overview , 1995, Autom..

[39]  Arjan van der Schaft,et al.  Non-linear dynamical control systems , 1990 .

[40]  Daniel E. Miller.  On necessary assumptions in discrete‐time model reference adaptive control , 1996 .

[41]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[42]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[43]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[44]  Mitsuo Kawato,et al.  Computational schemes and neural network models for formulation and control of multijoint arm trajectory , 1990 .

[45]  K S Narendra,et al.  Control of nonlinear dynamical systems using neural networks. II. Observability, identification, and control , 1996, IEEE Trans. Neural Networks.

[46]  Eduardo D. Sontag,et al.  NEURAL NETS AS SYSTEMS MODELS AND CONTROLLERS , 1992 .

[47]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[48]  D. Normand-Cyrot,et al.  Minimum-phase nonlinear discrete-time systems and feedback stabilization , 1987, 26th IEEE Conference on Decision and Control.