Reach-avoid problems with time-varying dynamics, targets and constraints

We consider a reach-avoid differential game, in which one of the players aims to steer the system into a target set without violating a set of state constraints, while the other player tries to prevent the first from succeeding; the system dynamics, target set, and state constraints may all be time-varying. The analysis of this problem plays an important role in collision avoidance, motion planning and aircraft control, among other applications. Previous methods for computing the guaranteed winning initial conditions and strategies for each player have either required augmenting the state vector to include time, or have been limited to problems with either no state constraints or entirely static targets, constraints and dynamics. To incorporate time-varying dynamics, targets and constraints without the need for state augmentation, we propose a modified Hamilton-Jacobi-Isaacs equation in the form of a double-obstacle variational inequality, and prove that the zero sublevel set of its viscosity solution characterizes the capture basin for the target under the state constraints. Through this formulation, our method can compute the capture basin and winning strategies for time-varying games at virtually no additional computational cost relative to the time-invariant case. We provide an implementation of this method based on well-known numerical schemes and show its convergence through a simple example; we include a second example in which our method substantially outperforms the state augmentation approach.

[1]  Hasnaa Zidani,et al.  Reachability and Minimal Times for State Constrained Nonlinear Problems without Any Controllability Assumption , 2010, SIAM J. Control. Optim..

[2]  Wang Hai-bing,et al.  High-order essentially non-oscillatory schemes for Hamilton-Jacobi equations , 2006 .

[3]  Pierre Cardaliaguet,et al.  A double obstacle problem arising in differential game theory , 2009 .

[4]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[5]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[6]  A. Cuza,et al.  A VIABILITY APPROACH FOR OPTIMAL CONTROL WITH INFIMUM COST , 2005 .

[7]  R. Elliott,et al.  The Existence Of Value In Differential Games , 1972 .

[8]  S. Osher,et al.  A PDE-Based Fast Local Level Set Method 1 , 1998 .

[9]  E. Barron,et al.  The Bellman equation for minimizing the maximum cost , 1989 .

[10]  Mo Chen,et al.  Safe sequential path planning of multi-vehicle systems via double-obstacle Hamilton-Jacobi-Isaacs variational inequality , 2014, 2015 European Control Conference (ECC).

[11]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[12]  Alain Rapaport,et al.  Characterization of Barriers of Differential Games , 1998 .

[13]  Andrea Cosso,et al.  Stochastic Differential Games Involving Impulse Controls and Double-Obstacle Quasi-variational Inequalities , 2012, SIAM J. Control. Optim..

[14]  S. Shankar Sastry,et al.  Reachability calculations for automated aerial refueling , 2008, 2008 47th IEEE Conference on Decision and Control.

[15]  E. Roxin Axiomatic approach in differential games , 1969 .

[16]  O. Bokanowski,et al.  Minimal Time Problems with Moving Targets and Obstacles , 2011 .

[17]  Jaime F. Fisac,et al.  Reachability-based safe learning with Gaussian processes , 2014, 53rd IEEE Conference on Decision and Control.

[18]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[19]  E. Barron Differential games maximum cost , 1990 .

[20]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[21]  S. Osher,et al.  High-order essentially nonsocillatory schemes for Hamilton-Jacobi equations , 1990 .

[22]  E. Coddington,et al.  Theory of Ordinary Differential Equations , 1955 .

[23]  Ian M. Mitchell,et al.  A Toolbox of Level Set Methods , 2005 .

[24]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[25]  S. Osher,et al.  Efficient implementation of essentially non-oscillatory shock-capturing schemes,II , 1989 .

[26]  Claire J. Tomlin,et al.  A differential game approach to planning in adversarial scenarios: A case study on capture-the-flag , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  P. Varaiya On the Existence of Solutions to a Differential Game , 1967 .