Pursuer Assignment and Control Strategies in Multi-Agent Pursuit-Evasion Under Uncertainties

We consider a pursuit-evasion problem with a heterogeneous team of multiple pursuers and multiple evaders. Although both the pursuers and the evaders are aware of each others’ control and assignment strategies, they do not have exact information about the other type of agents’ location or action. Using only noisy on-board sensors the pursuers (or evaders) make probabilistic estimation of positions of the evaders (or pursuers). Each type of agent use Markov localization to update the probability distribution of the other type. A search-based control strategy is developed for the pursuers that intrinsically takes the probability distribution of the evaders into account. Pursuers are assigned using an assignment algorithm that takes redundancy (i.e., an excess in the number of pursuers than the number of evaders) into account, such that the total or maximum estimated time to capture the evaders is minimized. In this respect we assume the pursuers to have clear advantage over the evaders. However, the objective of this work is to use assignment strategies that minimize the capture time. This assignment strategy is based on a modified Hungarian algorithm as well as a novel algorithm for determining assignment of redundant pursuers. The evaders, in order to effectively avoid the pursuers, predict the assignment based on their probabilistic knowledge of the pursuers and use a control strategy to actively move away from those pursues. Our experimental evaluation shows that the redundant assignment algorithm performs better than an alternative nearest-neighbor based assignment algorithm 1 .

[1]  Bernhard Rinner,et al.  Cooperative Robots to Observe Moving Targets: Review , 2018, IEEE Transactions on Cybernetics.

[2]  J. Diebold Automation , 1955, Industry, Innovation and Infrastructure.

[3]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[4]  Ariel Felner,et al.  Theta*: Any-Angle Path Planning on Grids , 2007, AAAI.

[5]  Daniel E. Koditschek,et al.  Exact robot navigation using artificial potential functions , 1992, IEEE Trans. Robotics Autom..

[6]  Geoffrey A. Hollinger,et al.  Probabilistic Strategies for Pursuit in Cluttered Environments with Multiple Robots , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[8]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[9]  J.P. Hespanha,et al.  Multiple-agent probabilistic pursuit-evasion games , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[10]  Sven Koenig,et al.  Incremental Phi*: Incremental Any-Angle Path Planning on Grids , 2009, IJCAI.

[11]  Sven Koenig,et al.  Lazy Theta*: Any-Angle Path Planning and Path Length Analysis in 3D , 2010, SOCS.

[12]  Geoffrey A. Hollinger,et al.  Search and pursuit-evasion in mobile robotics , 2011, Auton. Robots.

[13]  BhattacharyaSubhrajit,et al.  Multi-robot coverage and exploration on Riemannian manifolds with boundaries , 2014 .

[14]  Sarit Kraus,et al.  Adversarial Uncertainty in Multi-Robot Patrol , 2009, IJCAI.

[15]  Vijay Kumar,et al.  Multi-robot coverage and exploration on Riemannian manifolds with boundaries , 2014, Int. J. Robotics Res..

[16]  Wolfram Burgard,et al.  Estimating the Absolute Position of a Mobile Robot Using Position Probability Grids , 1996, AAAI/IAAI, Vol. 2.

[17]  Subhrajit Bhattacharya,et al.  Multi-agent Pursuit-Evasion Under Uncertainties with Redundant Robot Assignments: Extended Abstract , 2019, 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).

[18]  Michael Trentini,et al.  Probabilistic Cooperative Target Localization , 2015, IEEE Transactions on Automation Science and Engineering.

[19]  Mac Schwager,et al.  Multi-agent Cooperative Pursuit-Evasion Strategies Under Uncertainty , 2018, DARS.

[20]  Amanda Prorok,et al.  Robust Assignment Using Redundant Robots on Transport Networks With Uncertain Travel Time , 2020, IEEE Transactions on Automation Science and Engineering.

[21]  John S. McCaskill,et al.  Robots and Autonomous Agents , 2000 .

[22]  Hugh F. Durrant-Whyte,et al.  Inertial navigation systems for mobile robots , 1995, IEEE Trans. Robotics Autom..

[23]  Weihong Zhang,et al.  A Probabilistic Approach to Tracking Moving Targets With Distributed Sensors , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[24]  Mac Schwager,et al.  Intercepting Rogue Robots: An Algorithm for Capturing Multiple Evaders With Multiple Pursuers , 2017, IEEE Robotics and Automation Letters.

[25]  Gregory Dudek,et al.  Model-Based Probabilistic Pursuit via Inverse Reinforcement Learning , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Nathan R. Sturtevant,et al.  Benchmarks for Grid-Based Pathfinding , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[27]  Wolfram Burgard,et al.  Active Markov localization for mobile robots , 1998, Robotics Auton. Syst..

[28]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[29]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[30]  Panagiotis Tsiotras,et al.  Optimal Evading Strategies and Task Allocation in Multi-player Pursuit–Evasion Problems , 2019, Dyn. Games Appl..

[31]  Noa Agmon,et al.  On the Power and Limitations of Deception in Multi-Robot Adversarial Patrolling , 2017, IJCAI.

[32]  S. Sastry,et al.  Probabilistic pursuit-evasion games: a one-step Nash approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[33]  Christine Julien,et al.  On coordination in practical multi-robot patrol , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  Pierre T. Kabamba,et al.  Pursuit-evasion games in the presence of obstacles , 2016, Autom..

[35]  Stephen C. Jacobsen,et al.  Inertial navigation systems , 1986, IEEE Control Systems Magazine.