Adaptive critic autopilot design of Bank-to-turn missiles using fuzzy basis function networks

A new adaptive critic autopilot design for bank-to-turn missiles is presented. In this paper, the architecture of adaptive critic learning scheme contains a fuzzy-basis-function-network based associative search element (ASE), which is employed to approximate nonlinear and complex functions of bank-to-turn missiles, and an adaptive critic element (ACE) generating the reinforcement signal to tune the associative search element. In the design of the adaptive critic autopilot, the control law receives signals from a fixed gain controller, an ASE and an adaptive robust element, which can eliminate approximation errors and disturbances. Traditional adaptive critic reinforcement learning is the problem faced by an agent that must learn behavior through trial-and-error interactions with a dynamic environment, however, the proposed tuning algorithm can significantly shorten the learning time by online tuning all parameters of fuzzy basis functions and weights of ASE and ACE. Moreover, the weight updating law derived from the Lyapunov stability theory is capable of guaranteeing both tracking performance and stability. Computer simulation results confirm the effectiveness of the proposed adaptive critic autopilot.

[1]  In-Joong Ha,et al.  Nonlinear autopilot for high maneuverability of bank-to-turn missiles , 2001 .

[2]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[3]  S. N. Balakrishnan,et al.  State-constrained agile missile control with adaptive-critic-based neural networks , 2002, IEEE Trans. Control. Syst. Technol..

[4]  Anthony J. Calise,et al.  Adaptive nonlinear control of agile antiair missiles using neural networks , 2000, IEEE Trans. Control. Syst. Technol..

[5]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[6]  Li-Chen Fu,et al.  Adaptive Robust Bank-to-Turn Missile Autopilot Design Using Neural Networks , 1997 .

[7]  Hu Yunan,et al.  Robust nonlinear control for bank-to-turn missile , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[8]  C. F. Lin,et al.  Application of Sliding Mode Control to Bank-To-Turn Missile Systems , 1993, Proceedings. The First IEEE Regional Conference on Aerospace Control Systems,.

[9]  Frank L. Lewis,et al.  Reinforcement adaptive learning neural-net-based friction compensation control for high speed and precision , 2000, IEEE Trans. Control. Syst. Technol..

[10]  George W. Irwin,et al.  Neural model reference adaptive control and application to a BTT-CLOS guidance system , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[11]  M. C. Mickle,et al.  Bank-to-turn roll-yaw-pitch autopilot design using dynamic nonlinear inversion and PD-eigenvalue assignment , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[12]  George W. Irwin,et al.  Hybrid neural adaptive control for bank-to-turn missiles , 1997, IEEE Trans. Control. Syst. Technol..

[13]  Chuan-Kai Lin,et al.  A reinforcement learning adaptive fuzzy controller for robots , 2003, Fuzzy Sets Syst..

[14]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[15]  Jeff S. Shamma,et al.  Gain-scheduled bank-to-turn autopilot design using linear parameter varying transformations , 1996 .

[16]  Paul J. Werbos,et al.  Consistency of HDP applied to a simple reinforcement learning problem , 1990, Neural Networks.

[17]  Derek A. Linkens,et al.  Learning control using fuzzified self-organizing radial basis function network , 1993, IEEE Trans. Fuzzy Syst..

[18]  Sheng-De Wang,et al.  A self-organizing fuzzy control approach for bank-to-turn missiles , 1998, Fuzzy Sets Syst..

[19]  Frank L. Lewis,et al.  Adaptive critic design using non‐linear network structures , 2003 .

[20]  Li-Chen Fu,et al.  Adaptive Robust Autopilot Design for Bank-to-Turn Aircraft , 1993, 1993 American Control Conference.

[21]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[22]  Sheng-De Wang,et al.  An adaptive H/sup /spl infin// controller design for bank-to-turn missiles using ridge Gaussian neural networks , 2004, IEEE Transactions on Neural Networks.