Hamilton-Jacobi formulation for reach-avoid problems with an application to air traffic management

A new framework for formulating reachability problems with nonlinear dynamics and state constraints as optimal control problems is developed. The work in this paper is motivated by such problems in the area of air traffic management, in particular the problem of collision avoidance in the presence of 4D constraints, called Target Windows, that the aircraft have to respect to meet their schedule. Earlier approaches to reach-avoid computations are either restricted to linear systems, or face numerical difficulties due to possible discontinuities in the Hamiltonian of the optimal control problem. The main advantage of the approach proposed in this paper is that it can be applied to nonlinear dynamics and has very good properties in terms of its numerical solution, since the value function and the Hamiltonian of the system are both continuous. The performance of the proposed method is demonstrated by applying it to conflict detection and resolution under Target Window constraints in a two aircraft scenario.

[1]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[2]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[3]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[4]  E. Barron,et al.  The Bellman equation for minimizing the maximum cost , 1989 .

[5]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[6]  P. Cardaliaguet.  A differential game with two players and one target , 1994 .

[7]  George J. Pappas,et al.  Hybrid control in air traffic management systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[8]  J. Sethian.  Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[9]  S. Shankar Sastry,et al.  Conflict resolution for air traffic management: a study in multiagent hybrid systems , 1998, IEEE Trans. Autom. Control..

[10]  S. Shankar Sastry,et al.  Aerodynamic envelope protection using hybrid control , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[11]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[12]  Tryphon T. Georgiou,et al.  Worst case analysis of nonlinear systems , 1999, IEEE Trans. Autom. Control..

[13]  S. Sastry.  Nonlinear Systems: Analysis, Stability, and Control , 1999 .

[14]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[15]  Ian M. Mitchell,et al.  Level Set Methods for Computation in Hybrid Systems , 2000, HSCC.

[16]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[17]  Marc Quincampoix,et al.  Pursuit Differential Games with State Constraints , 2000, SIAM J. Control. Optim..

[18]  Alexandre M. Bayen,et al.  Validating a Hamilton-Jacobi Approximation to Hybrid System Reachable Sets , 2001, HSCC.

[19]  Pravin Varaiya,et al.  Optimization Methods for Target Problems of Control , 2002 .

[20]  John Lygeros,et al.  On reachability and minimum cost optimal control , 2004, Autom..

[21]  Pravin Varaiya,et al.  Ellipsoidal Techniques for Reachability Under State Constraints , 2006, SIAM J. Control. Optim..

[22]  Yan Gao,et al.  On the Reachability Problem for Uncertain Hybrid Systems , 2007, IEEE Transactions on Automatic Control.

[23]  John Lygeros,et al.  A Stochastic Hybrid Model for Air Traffic Management Processes , 2007 .

[24]  John Lygeros,et al.  Air traffic management with target windows: An approach using reachability , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[25]  Hasnaa Zidani,et al.  Reachability and Minimal Times for State Constrained Nonlinear Problems without Any Controllability Assumption , 2010, SIAM J. Control. Optim..

[26]  John Lygeros,et al.  Hamilton–Jacobi Formulation for Reach–Avoid Differential Games , 2009, IEEE Transactions on Automatic Control.