On events in multi-robot patrol in adversarial environments

The problem of multi-robot patrol in adversarial environments has been gaining considerable interest during the recent years. In this problem, a team of mobile robots is required to repeatedly visit some target area in order to detect penetrations that are controlled by an adversary. Little has been written so far on the nature of the event of penetration, and it is commonly assumed that the goal of the robots is to detect the penetration at any time during its occurrence. In this paper we offer a new definition of an event, with correlation to a utility function such that the detection of the event by the robots in different stages of its occurrence grants the robots a different reward. The goal of the robots is, then, to maximize their utility from detecting the event. We provide three different models of events, for which we describe algorithms for calculating the expected utility from detecting the event and discuss the how the model influences the optimality of the patrol algorithm. In the first and basic model, we assume that there exists a reward function such that detecting an event at different times grants the robots with an associated reward. In the second model, the event might evolve during its occurrence, and this progression correlates to both different rewards and to growing probability of detection. Finally, we consider a general model, in which the event can be detected from distance, where the probability of detection depends both on the distance from the robot and on the current state of the event. Last, we discuss how the new event models presented in this paper set grounds for handling the problem of patrol in heterogeneous environments, where parts of the perimeter could be more sensitive to occurrence of events.

[1]  Yann Chevaleyre,et al.  Theoretical analysis of the multi-agent patrolling problem , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..

[2]  Milind Tambe,et al.  Effective solutions for real-world Stackelberg games: when agents must deal with human uncertainties , 2009, AAMAS 2009.

[3]  Jacques Wainer,et al.  Probabilistic Multiagent Patrolling , 2008, SBIA.

[4]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[5]  Francesco Amigoni,et al.  A Game-Theoretic Approach to Determining Efficient Patrolling Strategies for Mobile Robots , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[6]  Peter Stone,et al.  A multi-robot system for continuous area sweeping tasks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[7]  Sarit Kraus,et al.  Security in multiagent systems by policy randomization , 2006, AAMAS '06.

[8]  Reid G. Simmons,et al.  Robot Navigation with Markov Models: A Framework for Path Planning and Learning with Limited Computational Resources , 1995, Reasoning with Uncertainty in Robotics.

[9]  Nicola Basilico,et al.  Extending Algorithms for Mobile Robot Patrolling in the Presence of Adversaries to More Realistic Settings , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[10]  Sarit Kraus,et al.  The impact of adversarial knowledge on adversarial planning in perimeter patrol , 2008, AAMAS.

[11]  Nicola Basilico,et al.  Leader-follower strategies for robotic patrolling in environments with arbitrary topologies , 2009, AAMAS.

[12]  Sarit Kraus,et al.  Multi-robot perimeter patrol in adversarial settings , 2008, 2008 IEEE International Conference on Robotics and Automation.

[13]  Sarit Kraus,et al.  An efficient heuristic approach for security against multiple adversaries , 2007, AAMAS '07.