A general, open-loop formulation for reach-avoid games

A reach-avoid game is one in which an agent attempts to reach a predefined goal, while avoiding some adversarial circumstance induced by an opposing agent or disturbance. Their analysis plays an important role in problems such as safe motion planning and obstacle avoidance, yet computing solutions is often computationally expensive due to the need to consider adversarial inputs. In this work, we present an open-loop formulation of a two-player reach-avoid game whereby the players define their control inputs prior to the start of the game. We define two open-loop games, each of which is conservative towards one player, show how the solutions to these games are related to the optimal feedback strategy for the closed-loop game, and demonstrate a modified Fast Marching Method to efficiently compute those solutions.

[1]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[2]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[3]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[4]  M. Bardi Some applications of viscosity solutions to optimal control and differential games , 1997 .

[5]  J. A. Sethian,et al.  Fast Marching Methods , 1999, SIAM Rev..

[6]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[7]  Hajime Asama,et al.  Inevitable collision states — a step towards safer robots? , 2004, Adv. Robotics.

[8]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[9]  Deb Roy,et al.  Connecting language to the world , 2005, Artif. Intell..

[10]  Geoffrey J. Gordon,et al.  Finding Approximate POMDP solutions Through Belief Compression , 2011, J. Artif. Intell. Res..

[11]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[12]  P. Varaiya,et al.  Differential Games , 1994 .

[13]  L. Blackmore Robust Path Planning and Feedback Design Under Stochastic Uncertainty , 2008 .

[14]  Mark H. Overmars,et al.  Planning Time-Minimal Safe Paths Amidst Unpredictably Moving Obstacles , 2008, Int. J. Robotics Res..

[15]  Claire J. Tomlin,et al.  A differential game approach to planning in adversarial scenarios: A case study on capture-the-flag , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  C. Tomlin,et al.  Closed-loop belief space planning for linear, Gaussian systems , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Claire J. Tomlin,et al.  Time-optimal multi-stage motion planning with guaranteed collision avoidance via an open-loop game formulation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Zhengyuan Zhou,et al.  An Efficient Algorithm for a Visibility-Based Surveillance-Evasion Game , 2014 .