Finite-Horizon Approximate Optimal Guaranteed Cost Control of Uncertain Nonlinear Systems With Application to Mars Entry Guidance

This paper studies the finite-horizon optimal guaranteed cost control (GCC) problem for a class of time-varying uncertain nonlinear systems. The aim of this problem is to find a robust state feedback controller such that the closed-loop system has not only a bounded response in a finite duration of time for all admissible uncertainties but also a minimal guaranteed cost. A neural network (NN) based approximate optimal GCC design is developed. Initially, by modifying the cost function to account for the nonlinear perturbation of system, the optimal GCC problem is transformed into a finite-horizon optimal control problem of the nominal system. Subsequently, with the help of the modified cost function together with a parametrized bounding function for all admissible uncertainties, the solution to the optimal GCC problem is given in terms of a parametrized Hamilton-Jacobi-Bellman (PHJB) equation. Then, a NN method is developed to solve offline the PHJB equation approximately and thus obtain the nearly optimal GCC policy. Furthermore, the convergence of approximate PHJB equation and the robust admissibility of nearly optimal GCC policy are also analyzed. Finally, by applying the proposed design method to the entry guidance problem of the Mars lander, the achieved simulation results show the effectiveness of the proposed controller.

[1]  Derong Liu,et al.  Adaptive approximation based control: Unifying neural, fuzzy and traditional adaptive approximation approaches. Jay A. Farrell and Marios M. Polycarpou, Wiley, New York, 2006. No of pages: 440. ISBN 978-0-471-72788-0 , 2008 .

[2]  B. Finlayson.  The method of weighted residuals and variational principles : with application in fluid mechanics, heat and mass transfer , 1972 .

[3]  Derong Liu,et al.  Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming , 2014, Inf. Sci..

[4]  Ali Heydari,et al.  Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[5]  N. Vinh,et al.  Hypersonic and Planetary Entry Flight Mechanics , 1980 .

[6]  John Valasek,et al.  Integrated Guidance and Fault Tolerant Adaptive Control for Mars Entry Vehicle , 2009 .

[7]  Li Yu,et al.  Optimal guaranteed cost control of linear uncertain systems: LMI approach , 1999 .

[8]  Kai-Yuan Cai,et al.  H2 guaranteed cost fuzzy control for uncertain nonlinear systems via linear matrix inequalities , 2004, Fuzzy Sets Syst..

[9]  P. Olver.  Nonlinear Systems , 2013 .

[10]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[11]  Philip Rabinowitz,et al.  Methods of Numerical Integration , 1985 .

[12]  George N. Saridis,et al.  An Approximation Theory of Optimal Control for Trainable Manipulators , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Frank L. Lewis,et al.  A Neural Network Solution for Fixed-Final Time Optimal Control of Nonlinear Systems , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[14]  Frank L. Lewis,et al.  Online actor critic algorithm to solve the continuous-time infinite horizon optimal control problem , 2009, 2009 International Joint Conference on Neural Networks.

[15]  Frank L. Lewis,et al.  Fixed-Final Time Constrained Optimal Control of Nonlinear Systems Using Neural Network HJB Approach , 2006, CDC.

[16]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[17]  R. Manning,et al.  Mars exploration entry, descent and landing challenges , 2006, 2006 IEEE Aerospace Conference.

[18]  Ian R. Petersen,et al.  An uncertainty averaging approach to optimal guaranteed cost control of uncertain systems with structured uncertainty , 1995, Autom..

[19]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[20]  Frank L. Lewis,et al.  Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach , 2005, Autom..

[21]  T. K. C. Peng,et al.  Adaptive Guaranteed Cost of Control of Systems with Uncertain Parameters , 1970 .

[22]  R. Manning,et al.  Mars Exploration Entry, Descent, and Landing Challenges , 2007 .

[23]  W. Haddad,et al.  Optimal non-linear robust control for non-linear uncertain systems , 2000 .

[24]  Ian R. Petersen,et al.  Optimal guaranteed cost control of discrete‐time uncertain linear systems , 1998 .

[25]  Randal W. Beard,et al.  Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation , 1997, Autom..

[26]  Frank L. Lewis,et al.  Fixed-Final-Time-Constrained Optimal Control of Nonlinear Systems Using Neural Network HJB Approach , 2007, IEEE Transactions on Neural Networks.

[27]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[28]  César Torres,et al.  Stable optimal control applied to a cylindrical robotic arm , 2014, Neural Computing and Applications.

[29]  Derong Liu,et al.  Policy Iteration Algorithm for Online Design of Robust Control for a Class of Continuous-Time Nonlinear Systems , 2014, IEEE Transactions on Automation Science and Engineering.

[30]  David K. Geller,et al.  Apollo-derived Mars precision lander guidance , 1998 .

[31]  D. McFarlane,et al.  Optimal guaranteed cost control and filtering for uncertain linear systems , 1994, IEEE Trans. Autom. Control..

[32]  I. Sandberg.  Notes on uniform approximation of time-varying systems on finite time intervals , 1998 .

[33]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[34]  Greg A. Dukeman,et al.  Profile-Following Entry Guidance Using Linear Quadratic Regulator Theory , 2002 .

[35]  Minyue Fu,et al.  Guaranteed cost control of uncertain nonlinear systems via polynomial lyapunov functions , 2002, IEEE Trans. Autom. Control..