Multiobjective Algebraic Synthesis of Neural Control Systems by Implicit Model Following

The advantages brought about by using classical linear control theory in conjunction with neural approximators have long been recognized in the literature. In particular, using linear controllers to obtain the starting neural control design has been shown to be a key step for the successful development and implementation of adaptive-critic neural controllers. Despite their adaptive capabilities, neural controllers are often criticized for not providing the same performance and stability guarantees as classical linear designs. Therefore, this paper develops an algebraic synthesis procedure for designing dynamic output-feedback neural controllers that are closed-loop stable and meet the same performance objectives as any classical linear design. The performance synthesis problem is addressed by deriving implicit model-following algebraic relationships between model matrices, obtained from the classical design, and the neural control parameters. Additional linear matrix inequalities (LMIs) conditions for closed-loop exponential stability of the neural controller are derived using existing integral quadratic constraints (IQCs) for operators with repeated slope-restricted nonlinearities. The approach is demonstrated by designing a recurrent neural network controller for a highly maneuverable tailfin-controlled missile that meets multiple design objectives, including pole placement for transient tuning, H infin and H 2 performance in the presence of parameter uncertainty, and command-input tracking.

[1]  R. T. Reichert Robust autopilot design using μ-synthesis , 1990 .

[2]  Gwo-Ruey Yu,et al.  Gain scheduling for lateral motion of propulsion controlled aircraft using neural networks , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[3]  Robert C. Scott,et al.  Active control of wind-tunnel model aeroelastic response using neural networks , 2000, Smart Structures.

[4]  Mukul Agarwal,et al.  Combining neural and conventional paradigms for modelling, prediction and control , 1997, Int. J. Syst. Sci..

[5]  Warren B. Powell,et al.  GUIDANCE IN THE USE OF ADAPTIVE CRITICS FOR CONTROL , 2007 .

[6]  J. Tyler The characteristics of model-following systems as synthesized by optimal control , 1964 .

[7]  Mustafa Khammash,et al.  Robust Gain-scheduled Aircraft Longitudinal Controller Design using an 3c, Approach * , 2001 .

[8]  Heinz Erzberger,et al.  Analysis and design of model following control systems by state space techniques , 1968 .

[9]  Okyay Kaynak,et al.  Robust and adaptive backstepping control for nonlinear systems using RBF neural networks , 2004, IEEE Transactions on Neural Networks.

[10]  R.T. Reichert Dynamic scheduling of modern-robust-control autopilot designs for missiles , 1992, IEEE Control Systems.

[11]  Jennie Si,et al.  Neural network-based control design: an LMI approach , 1998, IEEE Trans. Neural Networks.

[12]  B. Womack,et al.  Adaptive Control Using Neural Networks , 1991, 1991 American Control Conference.

[13]  Jun Wang,et al.  Global exponential stability of recurrent neural networks for synthesizing linear feedback control systems via pole assignment , 2002, IEEE Trans. Neural Networks.

[14]  Derong Liu,et al.  A new synthesis approach for feedback neural networks based on the perceptron training algorithm , 1997, IEEE Trans. Neural Networks.

[15]  Robert Shorten,et al.  On the Kalman–Yacubovich–Popov lemma and common Lyapunov solutions for matrices with regular inertia , 2007 .

[16]  Wilson J. Rugh,et al.  Analytical Framework for Gain Scheduling , 1990, 1990 American Control Conference.

[17]  Jin Zhang,et al.  Neural-network control of nonaffine nonlinear system with zero dynamics by state and output feedback , 2003, IEEE Trans. Neural Networks.

[18]  Marios M. Polycarpou,et al.  Stable adaptive neural control scheme for nonlinear systems , 1996, IEEE Trans. Autom. Control..

[19]  I. D. Landau,et al.  A survey of model reference adaptive techniques - Theory and applications , 1973, Autom..

[20]  Huijun Gao,et al.  Induced l2 and Generalized H2 Filtering for Systems With Repeated Scalar Nonlinearities , 2005 .

[21]  Juan Ignacio Mulero Martínez An Improved Dynamic Neurocontroller Based on Christoffel Symbols , 2007, IEEE Trans. Neural Networks.

[22]  A. Rantzer,et al.  System Analysis via Integral Quadratic Constraints. Part II , 1997 .

[23]  Sigeru Omatu,et al.  Temperature control in a batch process by neural networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[24]  Naira Hovakimyan,et al.  Neural Network Adaptive Control for a Class of Nonlinear Uncertain Dynamical Systems With Asymptotic Stability Guarantees , 2008, IEEE Transactions on Neural Networks.

[25]  R. Stengel,et al.  Classical/Neural Synthesis of Nonlinear Control Systems , 2000 .

[26]  Noel Duerksen,et al.  Adaptive Neural Network Inverse Controller for General Aviation Safety , 2004 .

[27]  K. D. Young,et al.  Design of variable structure model-following control systems , 1978 .

[28]  Zhe Lin,et al.  Robust gain-scheduled aircraft longitudinal controller design using an /spl Hscr//sub /spl infin// approach , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[29]  Frank L. Lewis,et al.  Neurodynamic Programming and Zero-Sum Games for Constrained Control Systems , 2008, IEEE Transactions on Neural Networks.

[30]  Jun Wang,et al.  An Improved Algebraic Criterion for Global Exponential Stability of Recurrent Neural Networks With Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[31]  Wei-Min Lu,et al.  An LFT approach to autopilot design for missiles , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[32]  Frank L. Lewis,et al.  Robust backstepping control of induction motors using neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[33]  K. Krishnakumar,et al.  NONLINEAR CONTROL USING NEURAL APPROXIMATORS WITH LINEAR CONTROL THEORY , 1997 .

[34]  Yun-Chung Chu,et al.  Stabilization and performance synthesis for systems with repeated scalar nonlinearities , 1999, IEEE Trans. Autom. Control..

[35]  R. T. Reichert,et al.  Robust autopilot design for aircraft with multiple lateral-axes controls using H/sub infinity / synthesis , 1990, 29th IEEE Conference on Decision and Control.

[36]  Jan Dimon Bendtsen,et al.  Robust quasi-LPV control based on neural state-space models , 2002, IEEE Trans. Neural Networks.

[37]  Xin-Ping Guan,et al.  Output Feedback Stabilization for Time-Delay Nonlinear Interconnected Systems Using Neural Networks , 2008, IEEE Transactions on Neural Networks.

[38]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[39]  P. Gahinet,et al.  A convex characterization of gain-scheduled H∞ controllers , 1995, IEEE Trans. Autom. Control..

[40]  P. Gahinet,et al.  A convex characterization of gain-scheduled H∞ controllers , 1995, IEEE Trans. Autom. Control..

[41]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[42]  Pierre Apkarian,et al.  Self-scheduled H∞ control of linear parameter-varying systems: a design example , 1995, Autom..

[43]  Wei Qiao,et al.  Fault-Tolerant Indirect Adaptive Neurocontrol for a Static Synchronous Series Compensator in a Power Network With Missing Sensor Measurements , 2008, IEEE Transactions on Neural Networks.

[44]  Huijun Gao,et al.  Induced l/sub 2/ and generalized H/sub 2/ filtering for systems with repeated scalar nonlinearities , 2005, IEEE Transactions on Signal Processing.

[45]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[46]  A. Rantzer,et al.  System analysis via integral quadratic constraints , 1997, IEEE Trans. Autom. Control..

[47]  Nathaniel E. Helwig,et al.  An Introduction to Linear Algebra , 2006 .

[48]  A. Rantzer On the Kalman-Yakubovich-Popov lemma , 1996 .

[49]  R.T. Reichert,et al.  Robust autopilot design using μ-synthesis , 1990, 1990 American Control Conference.

[50]  Robert F. Stengel,et al.  Smooth function approximation using neural networks , 2005, IEEE Transactions on Neural Networks.

[51]  Alexandre Megretski,et al.  New results for analysis of systems with repeated nonlinearities , 2001, Autom..

[52]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[53]  A. Barto,et al.  ModelBased Adaptive Critic Designs , 2004 .

[54]  A. Packard,et al.  Robust performance of linear parametrically varying systems using parametrically-dependent linear feedback , 1994 .

[55]  Robert F. Stengel,et al.  Restructurable control using proportional-integral implicit model following , 1990 .

[56]  Anthony J. Calise,et al.  Robust nonlinear adaptive flight control for consistent handling qualities , 2005, IEEE Transactions on Control Systems Technology.

[57]  Pierre Apkarian,et al.  Robust pole placement in LMI regions , 1999, IEEE Trans. Autom. Control..

[58]  Naira Hovakimyan,et al.  Novel ⅂1 neural network adaptive control architecture with guaranteed transient performance , 2007, 2007 European Control Conference (ECC).

[59]  Robert F. Stengel,et al.  Online Adaptive Critic Flight Control , 2004 .

[60]  Naira Hovakimyan,et al.  Novel ${\cal L}_{1}$ Neural Network Adaptive Control Architecture With Guaranteed Transient Performance , 2007, IEEE Transactions on Neural Networks.