Analytical Approximation Methods for the Stabilizing Solution of the Hamilton–Jacobi Equation

In this paper, two methods for approximating the stabilizing solution of the Hamilton-Jacobi equation are proposed using symplectic geometry and a Hamiltonian perturbation technique as well as stable manifold theory. The first method uses the fact that the Hamiltonian lifted system of an integrable system is also integrable and regards the corresponding Hamiltonian system of the Hamilton-Jacobi equation as an integrable Hamiltonian system with a perturbation caused by control. The second method directly approximates the stable flow of the Hamiltonian systems using a modification of stable manifold theory. Both methods provide analytical approximations of the stable Lagrangian submanifold from which the stabilizing solution is derived. Two examples illustrate the effectiveness of the methods.

[1]  J. Helton,et al.  H∞ control for nonlinear systems with output feedback , 1993, IEEE Trans. Autom. Control..

[2]  Leiba Rodman,et al.  Algebraic Riccati equations , 1995 .

[3]  A. Schaft.  On a state space approach to nonlinear H ∞ control , 1991 .

[4]  J. A..  On a state space approach to nonlinear control , 2002 .

[5]  William L. Garrard,et al.  Design of nonlinear automatic flight control systems , 1977, Autom..

[6]  John Guckenheimer,et al.  A Survey of Methods for Computing (un)Stable Manifolds of Vector Fields , 2005, Int. J. Bifurc. Chaos.

[7]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[8]  E. T. Copson.  Partial Differential Equations: Partial differential equations of the first order , 1975 .

[9]  C. Robinson.  Dynamical Systems: Stability, Symbolic Dynamics, and Chaos , 1994 .

[10]  John R. Hauser,et al.  The Geometry of the Solution Set of Nonlinear Optimal Control Problems , 2006 .

[11]  Noboru Sakamoto,et al.  Analysis of the Hamilton--Jacobi Equation in Nonlinear Control Theory by Symplectic Geometry , 2001, SIAM J. Control. Optim..

[12]  Arjan van der Schaft,et al.  Inner-outer factorization for nonlinear noninvertible systems , 2004, IEEE Transactions on Automatic Control.

[13]  J. W. Humberston.  Classical mechanics , 1980, Nature.

[14]  Randal W. Beard,et al.  Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation , 1997, Autom..

[15]  A. Schaft.  L/sub 2/-gain analysis of nonlinear systems and nonlinear state-feedback H/sub infinity / control , 1992 .

[16]  Pierpaolo Soravia.  ${\cal H}_\infty$ Control of Nonlinear Systems: Differential Games and Viscosity Solutions , 1996 .

[17]  Charles-Michel Marle,et al.  Symplectic geometry and analytical mechanics , 1987 .

[18]  A. Schaft,et al.  Variational and Hamiltonian Control Systems , 1987 .

[19]  H. Hermes,et al.  Foundations of optimal control theory , 1968 .

[20]  A. Isidori,et al.  Disturbance attenuation and H/sub infinity /-control via measurement feedback in nonlinear systems , 1992 .

[21]  A. Schaft.  L2-Gain and Passivity Techniques in Nonlinear Control. Lecture Notes in Control and Information Sciences 218 , 1996 .

[22]  J. Potter.  Matrix Quadratic Solutions , 1966 .

[23]  Joseph A. Ball,et al.  J-inner-outer factorization, J-spectral factorization, and robust control for nonlinear systems , 1996, IEEE Trans. Autom. Control..

[24]  P. Lions,et al.  Viscosity solutions of Hamilton-Jacobi equations , 1983 .

[25]  J. Cloutier,et al.  Control designs for the nonlinear benchmark problem via the state-dependent Riccati equation method , 1998 .

[26]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[27]  Jacquelien M. A. Scherpen,et al.  Nonlinear input-normal realizations based on the differential eigenstructure of Hankel operators , 2005, IEEE Transactions on Automatic Control.

[28]  S. Zagatti.  On viscosity solutions of Hamilton-Jacobi equations , 2008 .

[29]  P. Moylan,et al.  The stability of nonlinear dissipative systems , 1976 .

[30]  Van,et al.  L2-Gain Analysis of Nonlinear Systems and Nonlinear State Feedback H∞ Control , 2004 .

[31]  P J Fox,et al.  THE FOUNDATIONS OF MECHANICS. , 1918, Science.

[32]  J. M. A. Scherpen,et al.  Balancing for nonlinear systems , 1993 .

[33]  Y. Nishikawa,et al.  A method for suboptimal design of nonlinear feedback systems , 1971 .

[34]  C. Poole,et al.  Classical Mechanics, 3rd ed. , 2002 .

[35]  D. Owen.  Handbook of Mathematical Functions with Formulas , 1965 .

[36]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[37]  A. P. S. Selvadurai,et al.  Partial differential equations of the first-order , 2000 .

[38]  V. Arnold.  Mathematical Methods of Classical Mechanics , 1974 .

[39]  Wei-Min Lu,et al.  Nonlinear optimal control: alternatives to Hamilton-Jacobi equation , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[40]  A. Astolfi.  Disturbance Attenuation and H,-Control Via Measurement Feedback in , 1992 .

[41]  Suguru Arimoto,et al.  Optimal Feedback Control Minimizing the Effects of Noise Disturbances , 1966 .

[42]  J. Willems.  Dissipative dynamical systems part I: General theory , 1972 .

[43]  I. Norman Katz,et al.  An Iterative Algorithm for Solving Hamilton-Jacobi Type Equations , 2000, SIAM J. Sci. Comput..

[44]  J. Helton,et al.  H∞ control for nonlinear systems with output feedback , 1993, IEEE Trans. Autom. Control..

[45]  J. Hale,et al.  Methods of Bifurcation Theory , 1996 .

[46]  B. Francis,et al.  A Course in H Control Theory , 1987 .

[47]  W. Garrard.  Additional results on sub–optimal feedback control of non–linear systems , 1969 .

[48]  D. Lukes.  Optimal Regulation of Nonlinear Dynamical Systems , 1969 .

[49]  A. Rantzer,et al.  On approximate policy iteration for continuous-time systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[50]  Ruey-Wen Liu,et al.  Construction of Suboptimal Control Sequences , 1967 .