On the Reachability Problem for Uncertain Hybrid Systems

In this paper, we revisit the problem of designing controllers to meet safety specifications for hybrid systems, whose evolution is affected by both control and disturbance inputs. The problem is formulated as a dynamic game and an appropriate notion of hybrid strategy for the control inputs is developed. The design of hybrid strategies to meet safety specifications is based on an iteration of alternating discrete and continuous safety calculations. We show that, under certain assumptions, the iteration converges to a fixed point, which turns out to be the maximal set of states for which the safety specifications can be met. The continuous part of the calculation relies on the computation of the set of winning states for one player in a two player, two target, pursuit evasion differential game. We develop a characterization of these winning states (as well as the winning states for the other player for completeness) using methods from nonsmooth analysis and viability theory.

[1]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[2]  Yu. S. Ledyaev,et al.  Nonsmooth analysis and control theory , 1998 .

[3]  James R. Munkres,et al.  Topology; a first course , 1974 .

[4]  P. Cardaliaguet.  Nonsmooth semipermeable barriers, Isaacs’ equation, and application to a differential game with one target and two players , 1994 .

[5]  Jean-Pierre Aubin,et al.  Impulse differential inclusions: a viability approach to hybrid systems , 2002, IEEE Trans. Autom. Control..

[6]  H. Wong-Toi,et al.  The synthesis of controllers for linear hybrid automata , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[7]  P. Saint-Pierre,et al.  Numerical Schemes for Discontinuous Value Functions of Optimal Control , 2000 .

[8]  JiGuan G. Lin,et al.  Existence of Saddle Points in Differential Games , 1969 .

[9]  Ian M. Mitchell,et al.  A Toolbox of Hamilton-Jacobi Solvers for Analysis of Nondeterministic Continuous and Hybrid Systems , 2005, HSCC.

[10]  Alonzo Church,et al.  Logic, arithmetic, and automata , 1962 .

[11]  Joseph Lewin,et al.  Differential Games , 1994 .

[12]  P. Varaiya.  On the Existence of Solutions to a Differential Game , 1967 .

[13]  John Lygeros,et al.  Subliminal air traffic control: Human friendly control of a multi-agent system , 2007, 2007 American Control Conference.

[14]  G. Barles.  Discontinuous viscosity solutions of first-order Hamilton-Jacobi equations: a guided visit , 1993 .

[15]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[16]  Joseph Sifakis,et al.  On the Synthesis of Discrete Controllers for Timed Systems (An Extended Abstract) , 1995, STACS.

[17]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[18]  Marc Quincampoix,et al.  Pursuit Differential Games with State Constraints , 2000, SIAM J. Control. Optim..

[19]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[20]  B. Davey,et al.  Introduction to Lattices and Order: Appendix B: further reading , 2002 .

[21]  H. Frankowska.  Optimal trajectories associated to a solution of contingent Hamilton-Jacobi equation , 1987 .

[22]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[23]  Wolfgang Thomas,et al.  On the Synthesis of Strategies in Infinite Games , 1995, STACS.

[24]  John Lygeros,et al.  A Hybrid Model for Subliminal Air Traffic Control , 2007, HSCC.

[25]  Karl Henrik Johansson,et al.  Dynamical properties of hybrid automata , 2003, IEEE Trans. Autom. Control..

[26]  M. Rabin.  Automata on Infinite Objects and Church's Problem , 1972 .

[27]  Feng Lin,et al.  Synthesis and Viability of Minimally Interventive Legal Controllers for Hybrid Systems , 1998, Discret. Event Dyn. Syst..

[28]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[29]  Halina Frankowska,et al.  Measurable Viability Theorems and the Hamilton-Jacobi-Bellman Equation , 1995 .

[30]  George J. Pappas,et al.  Hybrid control in air traffic management systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[31]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[32]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[33]  Datta N. Godbole,et al.  Addressing Multiobjective Control: Safety and Performance through Constrained Optimization , 2001, HSCC.

[34]  G. Basile,et al.  Controlled and conditioned invariants in linear system theory , 1992 .

[35]  Shouchuan Hu.  Differential equations with discontinuous right-hand sides☆ , 1991 .

[36]  John Lygeros,et al.  On reachability and minimum cost optimal control , 2004, Autom..

[37]  W. M. Wonham,et al.  The control of discrete event systems , 1989 .

[38]  Ian M. Mitchell,et al.  Safety verification of conflict resolution manoeuvres , 2001, IEEE Trans. Intell. Transp. Syst..

[39]  John Lygeros,et al.  On the control of uncertain impulsive systems: approximate stabilization and controlled invariance , 2004 .

[40]  J. Hespanha,et al.  Hybrid systems: Generalized solutions and robust stability , 2004 .

[41]  P. Cardaliaguet.  A differential game with two players and one target , 1994 .

[42]  J. Sethian.  Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[43]  J. R. Büchi,et al.  Solving sequential conditions by finite-state strategies , 1969 .

[44]  John Lygeros,et al.  Verified hybrid controllers for automated vehicles , 1998, IEEE Trans. Autom. Control..

[45]  Halina Frankowska,et al.  Optimal trajectories associated to a solution of contingent Hamilton-Jacobi equation , 1987, 26th IEEE Conference on Decision and Control.

[46]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[47]  Marc Quincampoix,et al.  Pursuit-Evasion Games with Impulsive Dynamics , 2007 .