A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games

We describe and implement an algorithm for computing the set of reachable states of a continuous dynamic game. The algorithm is based on a proof that the reachable set is the zero sublevel set of the viscosity solution of a particular time-dependent Hamilton-Jacobi-Isaacs partial differential equation. While alternative techniques for computing the reachable set have been proposed, the differential game formulation allows treatment of nonlinear systems with inputs and uncertain parameters. Because the time-dependent equation's solution is continuous and defined throughout the state space, methods from the level set literature can be used to generate more accurate approximations than are possible for formulations with potentially discontinuous solutions. A numerical implementation of our formulation is described and has been released on the web. Its correctness is verified through a two vehicle, three dimensional collision avoidance example for which an analytic solution is available.

[1]  Rufus Isaacs,et al.  Differential Games , 1965 .

[2]  A. Merz.  The game of two identical cars , 1972 .

[3]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[4]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[5]  P. Lions,et al.  Two approximations of solutions of Hamilton-Jacobi equations , 1984 .

[6]  Randal E. Bryant,et al.  Graph-Based Algorithms for Boolean Function Manipulation , 1986, IEEE Transactions on Computers.

[7]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[8]  S. Osher,et al.  Efficient implementation of essentially non-oscillatory shock-capturing schemes,II , 1989 .

[9]  S. Osher,et al.  High-order essentially nonsocillatory schemes for Hamilton-Jacobi equations , 1990 .

[10]  Robert P. Kurshan,et al.  Analysis of digital circuits through symbolic reduction , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[11]  P. Cardaliaguet.  A differential game with two players and one target , 1994 .

[12]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[13]  T. Henzinger,et al.  Algorithmic Analysis of Nonlinear Hybrid Systems , 1998, CAV.

[14]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[15]  M. Bardi.  Some applications of viscosity solutions to optimal control and differential games , 1997 .

[16]  Anders Rantzer,et al.  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1997, 1997 European Control Conference (ECC).

[17]  Stephen P. Boyd,et al.  Analysis of linear systems with saturation using convex optimization , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[18]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[19]  Ian M. Mitchell,et al.  Reachability Analysis Using Polygonal Projections , 1999, HSCC.

[20]  Olaf Stursberg,et al.  Reachability Analysis of a Class of Switched Continuous Systems by Integrating Rectangular Approximation and Rectangular Analysis , 1999, HSCC.

[21]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[22]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[23]  M. Falcone,et al.  Numerical Methods for Pursuit-Evasion Games via Viscosity Solutions , 1999 .

[24]  Ian M. Mitchell,et al.  Level Set Methods for Computation in Hybrid Systems , 2000, HSCC.

[25]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[26]  Alberto Bemporad,et al.  Optimization-Based Verification and Stability Characterization of Piecewise Affine and Hybrid Systems , 2000, HSCC.

[27]  Alberto L. Sangiovanni-Vincentelli,et al.  Optimal Control Using Bisimulations: Implementation , 2001, HSCC.

[28]  Alexandre M. Bayen,et al.  Validating a Hamilton-Jacobi Approximation to Hybrid System Reachable Sets , 2001, HSCC.

[29]  Ashish Tiwari,et al.  Series of Abstractions for Hybrid Automata , 2002, HSCC.

[30]  Bruce H. Krogh,et al.  Computational techniques for hybrid system verification , 2003, IEEE Trans. Autom. Control..

[31]  Stanley Osher,et al.  Fast Sweeping Algorithms for a Class of Hamilton-Jacobi Equations , 2003, SIAM J. Numer. Anal..

[32]  Alexander Vladimirsky,et al.  Ordered Upwind Methods for Static Hamilton-Jacobi Equations: Theory and Algorithms , 2003, SIAM J. Numer. Anal..

[33]  Alexandre M. Bayen,et al.  A Differential Game Formulation of Alert Levels in ETMS Data for High Altitude Traffic , 2003 .

[34]  Antoine Girard,et al.  Reachability Analysis of Nonlinear Systems Using Conservative Approximation , 2003, HSCC.

[35]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[36]  Ian M. Mitchell,et al.  Overapproximating Reachable Sets by Hamilton-Jacobi Projections , 2003, J. Sci. Comput..

[37]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[38]  Ian A Mitchell,et al.  Demonstrating Numerical Convergence to the Analytic Solution of some Backwards Reachable Sets with Sharp Features , 2004 .

[39]  John Lygeros,et al.  On reachability and minimum cost optimal control , 2004, Autom..

[40]  Ali Jadbabaie,et al.  Safety Verification of Hybrid Systems Using Barrier Certificates , 2004, HSCC.

[41]  Stanislaw Raczynski.  Continuous Simulation, Differential Inclusions, Uncertainty, and Traveling in Time , 2004, Simul..

[42]  S.S. Sastry,et al.  Deciding to land a UAV safely in real time , 2005, Proceedings of the 2005, American Control Conference, 2005..

[43]  Alexandre M. Bayen,et al.  Lagrangian Delay Predictive Model for Sector-Based Air Traffic Flow , 2005 .

[44]  Ian M. Mitchell,et al.  A Toolbox of Level Set Methods , 2005 .

[45]  Wang Hai-bing,et al.  High-order essentially non-oscillatory schemes for Hamilton-Jacobi equations , 2006 .

[46]  Ian M. Mitchell,et al.  Games of Two Identical Vehicles , 2007 .