Max–Plus Eigenvector Methods for Nonlinear H∞ Problems: Error Analysis

The H∞ problem for a nonlinear system is considered. The corresponding dynamic programming equation is a fully nonlinear, first-order, steady-state partial differential equation (PDE), possessing a term which is quadratic in the gradient. The solutions are typically nonsmooth, and further, there is non-uniqueness among the class of viscosity solutions. In the case where one tests a feedback control to see if it yields an H∞ controller, or where either the controller or disturbance sufficiently dominate, the PDE is a Hamilton-Jacobi-Bellman equation. The computation of the solution of a nonlinear, steady-state, first-order PDE is typically quite difficult. In a companion paper, we developed an entirely new class of methods for the obtaining the “correct” solution of such PDEs. These methods are based on the linearity of the associated semi-group over the max-plus (or, in some cases, min-plus) algebra. In particular, solution of the PDE is reduced to solution of a max-plus (or min-plus) eigenvector problem for known unique eigenvalue 0 (the max-plus multiplicative identity). It was demonstrated that the eigenvector is unique, and that the power method converges to it. In the companion paper, the basic method was laid out without discussion of errors and convergence. In this paper, we both approach the error analysis for such an algorithm, and demonstrate convergence. The errors are due to both the truncation of the basis expansion and computation of the matrix whose eigenvector one computes.

[1]  Kenneth Kreutz-Delgado,et al.  Numerical solution of nonlinear 𝒽2 and 𝒽∞ control problems with application to jet engine compressors , 2000, IEEE Trans. Control. Syst. Technol..

[2]  William M. McEneaney,et al.  Max-Plus Eigenvector Representat ions for Nonlinear H, Value Functions , 1998 .

[3]  Ian R. Petersen,et al.  Robustness and risk-sensitive filtering , 2002, IEEE Trans. Autom. Control..

[4]  William M. McEneaney A uniqueness result for the isaacs equation corresponding to nonlinear H∞ control , 1998, Math. Control. Signals Syst..

[5]  W. McEneaney Robust/ H ∞ filtering for nonlinear systems , 1998 .

[6]  G. Litvinov,et al.  Idempotent Functional Analysis: An Algebraic Approach , 2000, math/0009128.

[7]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[8]  W. Fleming Deterministic nonlinear filtering , 1997 .

[9]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[10]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[11]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[12]  Paul Dupuis,et al.  Convergence of the Optimal Feedback Policies in a Numerical Method for a Class of Deterministic Optimal Control Problems , 2001, SIAM J. Control. Optim..

[13]  Matthew R. James,et al.  A partial differential inequality for dissipative nonlinear systems , 1993 .

[14]  V. Maslov On a new principle of superposition for optimization problems , 1987 .

[15]  J. Helton,et al.  H" CONTROL FOR NONLINEAR PLANTS: CONNECTIONS WITH DIFFERENTIAL GAMES , 1989 .

[16]  P. Dupuis,et al.  Markov chain approximations for deterministic control problems with affine dynamics and quadratic cost in the control , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[17]  R. Tyrrell Rockafellar Conjugate Duality and Optimization , 1974 .

[18]  William M. McEneaney,et al.  Max-plus eigenvector representations for solution of nonlinear H∞ problems: basic concepts , 2003, IEEE Trans. Autom. Control..

[19]  H. Anton,et al.  Functions of several variables , 2021, Thermal Physics of the Atmosphere.

[20]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[21]  W. McEneaney Error Analysis of a Max-Plus Algorithm for a First-Order HJB Equation , 2001 .

[22]  W.M. McEneaney Convergence and error analysis for a max-plus algorithm , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[23]  Van,et al.  L2-Gain Analysis of Nonlinear Systems and Nonlinear State Feedback H∞ Control , 2004 .

[24]  W. Fleming,et al.  Risk sensitive and robust nonlinear filtering , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[25]  Tamer Başar,et al.  H1-Optimal Control and Related Minimax Design Problems , 1995 .