Reach-Avoid Games With Two Defenders and One Attacker: An Analytical Approach

This paper considers a reach-avoid game on a rectangular domain with two defenders and one attacker. The attacker aims to reach a specified edge of the game domain boundary, while the defenders strive to prevent that by capturing the attacker. First, we are concerned with the barrier, which is the boundary of the reach-avoid set, splitting the state space into two disjoint parts: 1) defender dominance region (DDR) and 2) attacker dominance region (ADR). For the initial states lying in the DDR, there exists a strategy for the defenders to intercept the attacker regardless of the attacker’s best effort, while for the initial states lying in the ADR, the attacker can always find a successful attack strategy. We propose an attack region method to construct the barrier analytically by employing Voronoi diagram and Apollonius circle for two kinds of speed ratios. Then, by taking practical payoff functions into considerations, we present optimal strategies for the players when their initial states lie in their winning regions, and show that the ADR is divided into several parts corresponding to different strategies for the players. Numerical approaches, which suffer from inherent inaccuracy, have already been utilized for multiplayer reach-avoid games, but computational complexity complicates solving such games and consequently hinders efficient on-line applications. However, this method can obtain the exact formulation of the barrier and is applicable for real-time updates.

[1]  Howard M. Schwartz,et al.  Multi-Agent Machine Learning: A Reinforcement Approach , 2014 .

[2]  Mo Chen,et al.  Multiplayer Reach-Avoid Games via Pairwise Outcomes , 2016, IEEE Transactions on Automatic Control.

[3]  Tal Shima,et al.  A Cooperative Differential Game for Imposing a Relative Intercept Angle , 2017 .

[4]  Mac Schwager,et al.  Intercepting Rogue Robots: An Algorithm for Capturing Multiple Evaders With Multiple Pursuers , 2017, IEEE Robotics and Automation Letters.

[5]  Mo Chen,et al.  Robust Sequential Trajectory Planning Under Disturbances and Adversarial Intruder , 2019, IEEE Transactions on Control Systems Technology.

[6]  Dongbing Gu,et al.  Construction of Barrier in a Fishing Game With Point Capture , 2017, IEEE Transactions on Cybernetics.

[7]  Wei Li,et al.  Escape Analysis on the Confinement-Escape Problem of a Defender Against an Evader Escaping From a Circular Region , 2016, IEEE Transactions on Cybernetics.

[8]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[9]  Ismail Bustany,et al.  Method of Outer Approximations and Adaptive Approximations for a Class of Matrix Games , 2016, J. Optim. Theory Appl..

[10]  Qichao Zhang,et al.  Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics , 2016, IEEE Transactions on Cybernetics.

[11]  Naira Hovakimyan,et al.  A Visibility-Based Pursuit-Evasion Game with a Circular Obstacle , 2016, Journal of Optimization Theory and Applications.

[12]  Eloy García,et al.  Active target defense using first order missile models , 2017, Autom..

[13]  Rafael Murrieta-Cid,et al.  A differential pursuit/evasion game of capture between an omnidirectional agent and a differential drive robot, and their winning roles , 2016, Int. J. Control.

[14]  Claire J. Tomlin,et al.  Automation-Assisted Capture-the-Flag: A Differential Game Approach , 2015, IEEE Transactions on Control Systems Technology.

[15]  Bai Xue,et al.  Reach-Avoid Verification for Nonlinear Systems Based on Boundary Analysis , 2017, IEEE Transactions on Automatic Control.

[16]  Oguzhan Alagöz,et al.  Modeling secrecy and deception in a multiple-period attacker-defender signaling game , 2010, Eur. J. Oper. Res..

[17]  Pierre T. Kabamba,et al.  Pursuit-evasion games in the presence of obstacles , 2016, Autom..

[18]  Shaul Gutman,et al.  Vector Guidance Approach to Three-Player Conflict in Exoatmospheric Interception , 2015 .

[19]  Meir Pachter,et al.  On the Suicidal Pedestrian Differential Game , 2014, Dynamic Games and Applications.

[20]  Howard M. Schwartz,et al.  A Learning Invader for the “Guarding a Territory” Game , 2016, Journal of Intelligent & Robotic Systems.

[21]  Rui Zou,et al.  Visibility-Based Finite-Horizon Target Tracking Game , 2016, IEEE Robotics and Automation Letters.

[22]  Jaime F. Fisac,et al.  The pursuit-evasion-defense differential game in dynamic constrained environments , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[23]  Mo Chen,et al.  Multi-vehicle collision avoidance via hamilton-jacobi reachability and mixed integer programming , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[24]  Efstathios Bakolas,et al.  Relay pursuit of a maneuvering target using dynamic Voronoi diagrams , 2012, Autom..

[25]  Elena Deza,et al.  Voronoi Diagram Distances , 2013 .

[26]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[27]  Volkan Isler,et al.  Lion and man game in the presence of a circular obstacle , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Wei Sun,et al.  Pursuit evasion game of two players under an external flow field , 2015, 2015 American Control Conference (ACC).

[29]  Amiram Moshaiov,et al.  Game-Based Safe Aircraft Navigation in the Presence of Energy-Bleeding Coasting Missile , 2016 .

[30]  Zhengyuan Zhou,et al.  Cooperative pursuit with Voronoi partitions , 2016, Autom..

[31]  Yisheng Zhong,et al.  Defense game in a circular region , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[32]  Dongbing Gu,et al.  Multi-player pursuit-evasion games with one superior evader , 2016, Autom..

[33]  Ian Postlethwaite,et al.  Cooperative Multiple Pursuers against a Single Evader , 2017, J. Intell. Robotic Syst..

[34]  Huaguang Zhang,et al.  Near-Optimal Control for Nonzero-Sum Differential Games of Continuous-Time Nonlinear Systems Using Single-Network ADP , 2013, IEEE Transactions on Cybernetics.

[35]  Wei Li,et al.  Formulation of a Cooperative-Confinement-Escape problem of multiple cooperative defenders against an evader escaping from a circular region , 2016 .

[36]  John Lygeros,et al.  Hamilton–Jacobi Formulation for Reach–Avoid Differential Games , 2009, IEEE Transactions on Automatic Control.

[37]  Francesco Bullo,et al.  Vehicle placement to intercept moving targets , 2010, Proceedings of the 2010 American Control Conference.

[38]  Yisheng Zhong,et al.  Escape-avoid games with multiple defenders along a fixed circular orbit , 2017, 2017 13th IEEE International Conference on Control & Automation (ICCA).