On reachability and minimum cost optimal control

Questions of reachability for continuous and hybrid systems can be formulated as optimal control or game theory problems, whose solution can be characterized using variants of the Hamilton-Jacobi-Bellman or Isaacs partial differential equations. The formal link between the solution to the partial differential equation and the reachability problem is usually established in the framework of viscosity solutions. This paper establishes such a link between reachability, viability and invariance problems and viscosity solutions of a special form of the Hamilton-Jacobi equation. This equation is developed to address optimal control problems where the cost function is the minimum of a function of the state over a specified horizon. The main advantage of the proposed approach is that the properties of the value function (uniform continuity) and the form of the partial differential equation (standard Hamilton-Jacobi form, continuity of the Hamiltonian and simple boundary conditions) make the numerical solution of the problem much simpler than other approaches proposed in the literature. This fact is demonstrated by applying our approach to a reachability problem that arises in flight control and using numerical tools to compute the solution.

[1]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[2]  Bruce H. Krogh,et al.  Verification of Polyhedral-Invariant Hybrid Automata Using Polygonal Flow Pipe Approximations , 1999, HSCC.

[3]  Alexandre M. Bayen,et al.  Validating a Hamilton-Jacobi Approximation to Hybrid System Reachable Sets , 2001, HSCC.

[4]  Thomas A. Henzinger,et al.  A User Guide to HyTech , 1995, TACAS.

[5]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[6]  George J. Pappas,et al.  Discrete abstractions of hybrid systems , 2000, Proceedings of the IEEE.

[7]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[8]  Stavros Tripakis,et al.  Verification of Hybrid Systems with Linear Differential Inclusions Using Ellipsoidal Approximations , 2000, HSCC.

[9]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[10]  Jean-Pierre Aubin,et al.  Impulse differential inclusions: a viability approach to hybrid systems , 2002, IEEE Trans. Autom. Control..

[11]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[12]  E. Barron Differential games maximum cost , 1990 .

[13]  Stavros Tripakis,et al.  The Tool KRONOS , 1996, Hybrid Systems.

[14]  Nancy A. Lynch,et al.  Formal Verification of Safety-Critical Hybrid Systems , 1998, HSCC.

[15]  Tryphon T. Georgiou,et al.  Worst case analysis of nonlinear systems , 1999, IEEE Trans. Autom. Control..

[16]  Datta N. Godbole,et al.  Addressing Multiobjective Control: Safety and Performance through Constrained Optimization , 2001, HSCC.

[17]  Pravin Varaiya,et al.  Ellipsoidal Techniques for Reachability Analysis , 2000, HSCC.

[18]  李幼升,et al.  Ph , 1989 .

[19]  George J. Pappas,et al.  Hybrid control in air traffic management systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[20]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[21]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[22]  P. Saint-Pierre,et al.  Numerical Schemes for Discontinuous Value Functions of Optimal Control , 2000 .

[23]  E. Barron Viscosity solutions and analysis in L , 1999 .

[24]  George Leitmann,et al.  Viability analysis of an aircraft flight domain for take-off in a windshear , 2002 .

[25]  Ian M. Mitchell,et al.  Integrating Projections , 1998, HSCC.

[26]  A. Cuza,et al.  A VIABILITY APPROACH FOR OPTIMAL CONTROL WITH INFIMUM COST , 2005 .

[27]  Rajeev Alur,et al.  Timing Analysis in COSPAN , 1996, Hybrid Systems.

[28]  E. Barron,et al.  The Bellman equation for minimizing the maximum cost , 1989 .

[29]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[30]  Ian M. Mitchell,et al.  Level Set Methods for Computation in Hybrid Systems , 2000, HSCC.

[31]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[32]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[33]  A. Pnueli,et al.  Effective synthesis of switching controllers for linear systems , 2000, Proceedings of the IEEE.

[34]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[35]  J. Lygeros,et al.  High-level modeling and analysis of the traffic alert and collision avoidance system (TCAS) , 2000, Proceedings of the IEEE.

[36]  Marc Quincampoix,et al.  Pursuit Differential Games with State Constraints , 2000, SIAM J. Control. Optim..

[37]  Ian M. Mitchell,et al.  Safety verification of conflict resolution manoeuvres , 2001, IEEE Trans. Intell. Transp. Syst..

[38]  Wang Yi,et al.  UPPAAL - a Tool Suite for Automatic Verification of Real-Time Systems , 1996, Hybrid Systems.

[39]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[40]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[41]  John Lygeros,et al.  Verified hybrid controllers for automated vehicles , 1998, IEEE Trans. Autom. Control..