Fixed-Final Time Constrained Optimal Control of Nonlinear Systems Using Neural Network HJB Approach

Fixed-final time constrained input optimal control laws using neural networks to solve Hamilton-Jacobi-Bellman (HJB) equations for general affine in the input nonlinear systems are proposed. A neural network is used to approximate the time-varying cost function using the method of least-squares on a pre-defined region and hence solve the HJB. The result is a neural network nearly optimal constrained feedback controller that has time-varying coefficients found by a priori offline tuning. The results of this paper are demonstrated on an example.

[1]  Robert Bartle,et al.  The Elements of Real Analysis , 1977, The Mathematical Gazette.

[2]  S. Kahne,et al.  Optimal control: An introduction to the theory and ITs applications , 1967, IEEE Transactions on Automatic Control.

[3]  B. Finlayson.  The method of weighted residuals and variational principles : with application in fluid mechanics, heat and mass transfer , 1972 .

[4]  V. Arnold,et al.  Ordinary Differential Equations , 1973 .

[5]  M. Balas.  MODAL CONTROL OF CERTAIN FLEXIBLE DYNAMIC SYSTEMS , 1978 .

[6]  George N. Saridis,et al.  An Approximation Theory of Optimal Control for Trainable Manipulators , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  George Leitmann,et al.  The Calculus of Variations and Optimal Control , 1982 .

[8]  R. W. Brockett,et al.  Asymptotic stability and feedback stabilization , 1982 .

[9]  Frank L. Lewis,et al.  Optimal Control , 1986 .

[10]  A. Bloch,et al.  Controllability and stabilizability properties of a nonholonomic control system , 1990, 29th IEEE Conference on Decision and Control.

[11]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[12]  S. Sastry,et al.  Steering nonholonomic systems using sinusoids , 1990, 29th IEEE Conference on Decision and Control.

[13]  Jean-Jacques E. Slotine,et al.  Stable adaptive control and recursive identification using radial Gaussian networks , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[14]  Richard M. Murray,et al.  Steering nonholonomic systems in chained form , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[15]  W. Schmitendorf,et al.  Stability analysis for a class of linear controllers under control constraints , 1991 .

[16]  A. Isidori,et al.  Disturbance attenuation and H/sub infinity /-control via measurement feedback in nonlinear systems , 1992 .

[17]  A. Schaft.  L/sub 2/-gain analysis of nonlinear systems and nonlinear state-feedback H/sub infinity / control , 1992 .

[18]  A. Bloch,et al.  Control and stabilization of nonholonomic dynamic systems , 1992 .

[19]  Georges Bastin,et al.  A hybrid strategy for the feedback stabilization of nonholonomic mobile robots , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[20]  D. Bernstein.  Nonquadratic cost and nonlinear feedback control , 1993 .

[21]  Manolis A. Christodoulou,et al.  Adaptive control of unknown plants using dynamical neural networks , 1994, IEEE Trans. Syst. Man Cybern..

[22]  Olav Egeland,et al.  Exponential stabilization of a nonholonomic underwater vehicle with constant desired configuration , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[23]  Chen-Chung Liu,et al.  Adaptively controlling nonlinear continuous-time systems using multilayer neural networks , 1994, IEEE Trans. Autom. Control..

[24]  Eduardo Sontag,et al.  A general result on the stabilization of linear systems using bounded controls , 1994, IEEE Trans. Autom. Control..

[25]  Jie Huang,et al.  Numerical approach to computing nonlinear H-infinity control laws , 1995 .

[26]  S. Lyashevskiy.  Robust nonlinear control of uncertain systems with state and control constraints , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[27]  O. J. Sørdalen,et al.  Exponential stabilization of nonholonomic chained systems , 1995, IEEE Trans. Autom. Control..

[28]  D. Bernstein.  Optimal nonlinear, but continuous, feedback control of systems with saturating actuators , 1995 .

[29]  S. Lyashevskiy,et al.  Control system analysis and design upon the Lyapunov method , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[30]  Ilya Kolmanovsky,et al.  Developments in nonholonomic control problems , 1995 .

[31]  S. Lyashevskiy.  Constrained optimization and control of nonlinear systems: new results in optimal control , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[32]  Shuzhi Sam Ge.  Robust adaptive NN feedback linearization control of nonlinear systems , 1996, Int. J. Syst. Sci..

[33]  Andrew R. Teel,et al.  Control of linear systems with saturating actuators , 1996 .

[34]  S. Lyashevskiy.  Control of linear dynamic systems with constraints: optimization issues and applications of nonquadratic functionals , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[35]  Marios M. Polycarpou,et al.  Stable adaptive neural control scheme for nonlinear systems , 1996, IEEE Trans. Autom. Control..

[36]  Randal W. Beard,et al.  Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation , 1997, Autom..

[37]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[38]  Frank L. Lewis,et al.  Robust Practical Point Stabilization of a Nonholonomic Mobile Robot Using Neural Networks , 1997, J. Intell. Robotic Syst..

[39]  Romeo Ortega,et al.  Regulation and tracking of the nonholonomic double integrator: A field-oriented control approach , 1998, Autom..

[40]  Frank L. Lewis,et al.  Neural Network Control Of Robot Manipulators And Non-Linear Systems , 1998 .

[41]  S. Lyshevski.  Optimal control of nonlinear continuous-time systems: design of bounded controllers via generalized nonquadratic functionals , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[42]  I. Sandberg.  Notes on uniform approximation of time-varying systems on finite time intervals , 1998 .

[43]  S. Lyshevski.  Optimal tracking control of nonlinear dynamic systems with control bounds , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[44]  Andrew W. Moore,et al.  Gradient descent approaches to neural-net-based solutions of the Hamilton-Jacobi-Bellman equation , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[45]  S. Lyshevski.  Optimization of a class of nonholonomic dynamic systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[46]  F. D. Lio,et al.  On the Bellman Equation for Infinite Horizon Problems with Unbounded Cost Functional , 2000 .

[47]  Frank L. Lewis,et al.  Intelligent optimal control of robotic manipulators using neural networks , 2000, Autom..

[48]  K. Teo,et al.  Solving Hamilton-Jacobi-Bellman equations by a modified method of characteristics , 2000 .

[49]  Sergey Edward Lyshevski.  Control Systems Theory with Engineering Applications , 2001 .

[50]  Frank L. Lewis,et al.  Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach , 2005, Autom..

[51]  Frank L. Lewis,et al.  A Neural Network Solution for Fixed-Final Time Optimal Control of Nonlinear Systems , 2006, MED 2006.