Patrol Scheduling Against Adversaries with Varying Attack Durations

We consider a generalization of zero-sum patrolling security game that allows the attacker choosing when, where, and how long to launch an attack, under three different attacker models. The attacker's payoff is the acquired utilities of the attack minus a penalty if the attacker is caught by the defender in patrol. The goal is to reduce the payoff of the attacker. To find the optimal defender/ attacker strategy, the game is converted to a combinatorial minimax problem with a closed-form objective function. Due to the complexity of the utility functions, we show that the minimax problem is not convex for all attacker models, even when the defender strategy is assumed as the time-homogeneous first-order Markov chain (i.e., the patroller's next visit only depends on his current location). However, for the zero penalty case, we prove that the optimal solution is either minimizing the expected hitting time or return time, based on different attacker models. We also observe that increasing the randomness of the patrol schedule helps to reduce the attacker's expected payoff for high penalty cases. Thus, to find solutions for general cases, we formulated a bi-criteria optimization problem and proposed three algorithms that support finding a trade-off between the expected maximum reward and the randomness. Another characteristic is that the third algorithm is able to find the optimal deterministic patrol schedule, although the running time is exponential on the number of patrol spots. Experiments demonstrate the effectiveness and scalability of our solutions. It also shows that our solutions outperform the baselines from state of the art in both artificial and real-world crime datasets.

[1]  Milind Tambe,et al.  Optimal patrol strategy for protecting moving targets with multiple mobile resources , 2013, AAMAS.

[2]  Cliff T. Ragsdale,et al.  Scheduling pre-printed newspaper advertising inserts using genetic algorithms , 2002 .

[3]  Daniele Nardi,et al.  Multi-robot patrolling with coordinated behaviours in realistic environments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[5]  Milind Tambe,et al.  Towards a science of security games , 2016 .

[6]  Mattia D'Emidio,et al.  Bamboo Garden Trimming Problem: Priority Schedulings , 2019, Algorithms.

[7]  John G. Kemeny,et al.  Finite Markov chains , 1960 .

[8]  Giorgio Ausiello,et al.  On Salesmen, Repairmen, Spiders, and Other Traveling Agents , 2000, CIAC.

[9]  Bo An,et al.  Adversarial patrolling games , 2012, AAMAS.

[10]  G. Reinelt,et al.  Optimal control of plotting and drilling machines: A case study , 1991, ZOR Methods Model. Oper. Res..

[11]  Bo An,et al.  PROTECT: a deployed game theoretic system to protect the ports of the United States , 2012, AAMAS.

[12]  Manish Jain,et al.  Efficiently Solving Joint Activity Based Security Games , 2013, IJCAI.

[13]  Yehuda Elmaliach,et al.  A realistic model of frequency-based multi-robot polyline patrolling , 2008, AAMAS.

[14]  Kap Hwan Kim,et al.  A crane scheduling method for port container terminals , 2004, Eur. J. Oper. Res..

[15]  Steve Kirkland,et al.  Minimising the largest mean first passage time of a Markov chain: The influence of directed graphs , 2017 .

[16]  Mohamed Mosbah,et al.  Non-Uniform Random Spanning Trees on Weighted Graphs , 1999, Theor. Comput. Sci..

[17]  J. Baillieul,et al.  Stochastic Strategies for Autonomous Robotic Surveillance , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[18]  Nicola Basilico,et al.  Adversarial patrolling with spatially uncertain alarm signals , 2015, Artif. Intell..

[19]  Sanjeev Arora,et al.  Polynomial time approximation schemes for Euclidean TSP and other geometric problems , 1996, Proceedings of 37th Conference on Foundations of Computer Science.

[20]  Nicos Christofides Worst-Case Analysis of a New Heuristic for the Travelling Salesman Problem , 1976, Operations Research Forum.

[21]  Nathan Michael,et al.  Multi-robot persistent surveillance planning as a Vehicle Routing Problem , 2011, 2011 IEEE International Conference on Automation Science and Engineering.

[22]  Nicola Basilico,et al.  Patrolling security games: Definition and algorithms for solving large instances with single patroller and single intruder , 2012, Artif. Intell..

[23]  Gilbert Laporte,et al.  The vehicle routing problem: An overview of exact and approximate algorithms , 1992 .

[24]  Steve Kirkland,et al.  Fastest expected time to mixing for a Markov chain on a directed graph , 2010 .

[25]  R. Serfozo Basics of Applied Stochastic Processes , 2012 .

[26]  Sarit Kraus,et al.  The impact of adversarial knowledge on adversarial planning in perimeter patrol , 2008, AAMAS.

[27]  Nicola Gatti,et al.  Game Theoretical Insights in Strategic Patrolling: Model and Algorithm in Normal-Form , 2008, ECAI.

[28]  Branislav Bosanský,et al.  Computing time-dependent policies for patrolling games with mobile targets , 2011, AAMAS.

[29]  Andrew B. Whinston,et al.  Computer-Assisted School Bus Scheduling , 1972 .

[30]  David Portugal,et al.  On the performance and scalability of multi-robot patrolling algorithms , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[31]  Francesco Bullo,et al.  Markov Chains With Maximum Return Time Entropy for Robotic Surveillance , 2020, IEEE Transactions on Automatic Control.

[32]  Stephen L. Smith,et al.  Stochastic patrolling in adversarial settings , 2016, 2016 American Control Conference (ACC).

[33]  Giorgio Cannata,et al.  A Minimalist Algorithm for Multirobot Continuous Coverage , 2011, IEEE Transactions on Robotics.

[34]  Sanjeev Arora,et al.  Polynomial time approximation schemes for Euclidean traveling salesman and other geometric problems , 1998, JACM.

[35]  Esther M. Arkin,et al.  Joint sensing duty cycle scheduling for heterogeneous coverage guarantee , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[36]  Sarit Kraus,et al.  Deployed ARMOR protection: the application of a game theoretic model for security at the Los Angeles International Airport , 2008, AAMAS 2008.

[37]  Bo An,et al.  PROTECT - A Deployed Game Theoretic System for Strategic Security Allocation for the United States Coast Guard , 2012, AI Mag..

[38]  Christel Baier,et al.  SOFSEM 2017: Theory and Practice of Computer Science - 43rd International Conference on Current Trends in Theory and Practice of Computer Science, Limerick, Ireland, January 16-20, 2017, Proceedings , 2017, SOFSEM.

[39]  Rong Yang,et al.  Adaptive resource allocation for wildlife protection against illegal poachers , 2014, AAMAS.

[40]  David P. Williamson,et al.  A note on the prize collecting traveling salesman problem , 1993, Math. Program..

[41]  Santosh S. Vempala,et al.  Improved approximation guarantees for minimum-weight k-trees and prize-collecting salesmen , 1995, STOC '95.

[42]  Antonio Franchi,et al.  On Cooperative Patrolling: Optimal Trajectories, Complexity Analysis, and Approximation Algorithms , 2011, IEEE Transactions on Robotics.

[43]  Michel Gendreau,et al.  A review of dynamic vehicle routing problems , 2013, Eur. J. Oper. Res..

[44]  Nicola Basilico,et al.  Leader-follower strategies for robotic patrolling in environments with arbitrary topologies , 2009, AAMAS.

[45]  Vincent Conitzer,et al.  A double oracle algorithm for zero-sum security games on graphs , 2011, AAMAS.

[46]  Francesco Bullo,et al.  Robotic Surveillance and Markov Chains With Minimal Weighted Kemeny Constant , 2015, IEEE Transactions on Automatic Control.

[47]  Joseph S. B. Mitchell,et al.  Guillotine Subdivisions Approximate Polygonal Subdivisions: A Simple Polynomial-Time Approximation Scheme for Geometric TSP, k-MST, and Related Problems , 1999, SIAM J. Comput..

[48]  Bo An,et al.  Computing Solutions in Infinite-Horizon Discounted Adversarial Patrolling Games , 2014, ICAPS.

[49]  Manish Jain,et al.  Security Games with Arbitrary Schedules: A Branch and Price Approach , 2010, AAAI.

[50]  Zhaohui Liu,et al.  Vehicle routing problems with regular objective functions on a path , 2014 .

[51]  Elaheh Fata,et al.  Persistent monitoring in discrete environments: Minimizing the maximum weighted latency between observations , 2012, Int. J. Robotics Res..

[52]  Manish Jain,et al.  Computing optimal randomized resource allocations for massive security games , 2009, AAMAS.

[53]  Francesco Bullo,et al.  Markov Chains With Maximum Entropy for Robotic Surveillance , 2019, IEEE Transactions on Automatic Control.

[54]  S. Gorenstein Printing Press Scheduling for Multi-Edition Periodicals , 1970 .

[55]  Milind Tambe,et al.  Security and Game Theory: IRIS – A Tool for Strategic Security Allocation in Transportation Networks , 2011, AAMAS 2011.

[56]  Sarit Kraus,et al.  Multi-Robot Adversarial Patrolling: Facing a Full-Knowledge Opponent , 2011, J. Artif. Intell. Res..