Worst case analysis of nonlinear systems

The authors work out a framework for evaluating the performance of a continuous-time nonlinear system when this is quantified as the maximal value at an output port under bounded disturbances-the disturbance problem. This is useful in computing gain functions and L/sub /spl infin//-induced norms, which are often used to characterize performance and robustness of feedback systems. The approach is variational and relies on the theory of viscosity solutions of Hamilton-Jacobi equations. Convergence of Euler approximation schemes via discrete dynamic programming is established. The authors also provide an algorithm to compute upper bounds for value functions. Differences between the disturbance problem and the optimal control problem are noted, and a proof of convergence of approximation schemes for the control problem is given. Case studies are presented which assess the robustness of a feedback system and the quality of trajectory tracking in the presence of structured uncertainty.

[1]  R. Bellman Dynamic programming. , 1957, Science.

[2]  E. Barron Differential games maximum cost , 1990 .

[3]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[4]  H. Ishii A simple, direct proof of uniqueness for solutions of the hamilton-jacobi equations of eikonal type , 1987 .

[5]  Eduardo D. Sontag,et al.  State-space and I/O stability for nonlinear systems , 1995 .

[6]  H. Ishii,et al.  Approximate solutions of the bellman equation of deterministic control theory , 1984 .

[7]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[8]  P. Henrici Discrete Variable Methods in Ordinary Differential Equations , 1962 .

[9]  J. Shamma Optimization of the l∞-induced norm under full state feedback , 1996, IEEE Trans. Autom. Control..

[10]  Gary J. Balas,et al.  Linear fractional transformation control of the F-14 aircraft lateral-directional axis during powered approach landing , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[11]  Tryphon T. Georgiou,et al.  On the 𝓛1 norm of uncertain linear systems , 1995, IEEE Trans. Autom. Control..

[12]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[13]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[14]  R. Murray,et al.  Numerically Efficient Robustness Analysis of Trajectory Tracking for Nonlinear Systems , 1997 .

[15]  Matthew R. James,et al.  Numerical approximation of the H∞ norm for nonlinear systems , 1995, Autom..

[16]  Rufus Isaacs,et al.  Differential Games , 1965 .

[17]  H. Ishii Uniqueness of unbounded viscosity solution of Hamilton-Jacobi equations , 1984 .

[18]  Wei-Min Lu,et al.  Rejection of persistent L∞-bounded disturbances for nonlinear systems , 1998, IEEE Trans. Autom. Control..

[19]  J. Warga Relaxed variational problems , 1962 .

[20]  M. Falcone,et al.  Discrete Dynamic Programming and Viscosity Solutions of the Bellman Equation , 1989 .

[21]  Richard M. Murray,et al.  Robust performance analysis for a class of uncertain nonlinear systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[22]  P. Lions Generalized Solutions of Hamilton-Jacobi Equations , 1982 .

[23]  G. Barles,et al.  Discontinuous solutions of deterministic optimal stopping time problems , 1987 .

[24]  R. Murray,et al.  An efficient algorithm for performance analysis of nonlinear control systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[25]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[26]  E. Barron,et al.  The Bellman equation for minimizing the maximum cost , 1989 .

[27]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[28]  T. Georgiou,et al.  L2 State-feedback Control with a Prescribed Rate of Exponential Convergence , 1997, IEEE Trans. Autom. Control..

[29]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1991 .

[30]  T. Georgiou,et al.  Robustness analysis of nonlinear feedback systems: an input-output approach , 1997, IEEE Trans. Autom. Control..

[31]  M. Falcone A numerical approach to the infinite horizon problem of deterministic control theory , 1987 .