An extended study on multi-objective security games

The burgeoning area of security games has focused on real-world domains where security agencies protect critical infrastructure from a diverse set of adaptive adversaries. In such domains, decision makers have multiple competing objectives they must consider which may take different forms that are not readily comparable including safety, cost, and public perception. Thus, it can be difficult to know how to weigh the different objectives when deciding on a security strategy. To address the challenges of these domains, we propose a fundamentally different solution concept, multi-objective security games (MOSGs). Instead of a single optimal solution, MOSGs have a set of Pareto optimal (non-dominated) solutions referred to as the Pareto frontier, which can be generated by solving a sequence of constrained single-objective optimization problems (CSOPs). The Pareto frontier allows the decision maker to analyze the tradeoffs that exist between the multiple objectives. Our contributions include: (i) an algorithm, Iterative-ε-Constraints,, for generating the sequence of CSOPs; (ii) an exact approach for solving an mixed-integer linear program (MILP) formulation of a CSOP; (iii) heuristics that achieve speed up by exploiting the structure of security games to further constrain the MILP; (iv) an approximate approach for solving a CSOP built off those same heuristics, increasing the scalability of our approach with quality guarantees. Additional contributions of this paper include proofs on the level of approximation, detailed experimental evaluation of the proposed approaches and heuristics, as well as a discussion on techniques for visualizing the Pareto frontier.

[1]  M. Abido Environmental/economic power dispatch using multiobjective evolutionary algorithms , 2003, 2003 IEEE Power Engineering Society General Meeting (IEEE Cat. No.03CH37491).

[2]  Mark D. Johnston,et al.  Multi-Objective Evolutionary Algorithms for Scheduling the James Webb Space Telescope , 2008, ICAPS.

[3]  Rong Yang,et al.  Computing optimal strategy against quantal response in security games , 2012, AAMAS.

[4]  M. Ramachandran,et al.  Application of multi-criteria decision making to sustainable energy planning--A review , 2004 .

[5]  Sarit Kraus,et al.  Playing games for security: an efficient exact algorithm for solving Bayesian Stackelberg games , 2008, AAMAS.

[6]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[7]  B. Stengel,et al.  Leadership with commitment to mixed strategies , 2004 .

[8]  A. Inselberg,et al.  Parallel coordinates for visualizing multi-dimensional geometry , 1987 .

[9]  Bo An,et al.  GUARDS and PROTECT: next generation applications of security games , 2011, SECO.

[10]  Markus Wagner,et al.  Approximation-Guided Evolutionary Multi-Objective Optimization , 2011, IJCAI.

[11]  B. Taylor,et al.  Evaluating the Costs and Benefits of Transit Smart Cards , 2008 .

[12]  Bo An,et al.  Multi-objective optimization for security games , 2012, AAMAS.

[13]  J. Current,et al.  Theory and methodology , 1991 .

[14]  Riccardo Poli,et al.  Genetic and Evolutionary Computation , 2006, Intelligenza Artificiale.

[15]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[16]  Marco Laumanns,et al.  An efficient, adaptive parameter variation scheme for metaheuristics based on the epsilon-constraint method , 2006, Eur. J. Oper. Res..

[17]  Manish Jain,et al.  Computing optimal randomized resource allocations for massive security games , 2009, AAMAS 2009.

[18]  George Mavrotas Effective implementation of the epsilon-constraint method in Multi-Objective Mathematical Programming problems , 2009, Appl. Math. Comput..

[19]  Milind Tambe,et al.  Effective solutions for real-world Stackelberg games: when agents must deal with human uncertainties , 2009, AAMAS 2009.

[20]  Edmundas Kazimieras Zavadskas,et al.  Multi‐objective decision‐making for road design , 2008 .

[21]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .

[22]  L. Lasdon,et al.  On a bicriterion formation of the problems of integrated system identification and system optimization , 1971 .

[23]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[24]  Vincent Conitzer,et al.  Computing the optimal strategy to commit to , 2006, EC '06.

[25]  Alfred Inselberg,et al.  Parallel coordinates: a tool for visualizing multi-dimensional geometry , 1990 .

[26]  Alexander V. Lotov,et al.  Interactive Decision Maps: Approximation and Visualization of Pareto Frontier , 2004 .

[27]  Vincent Conitzer,et al.  Security Games with Multiple Attacker Resources , 2011, IJCAI.

[28]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[29]  K. Miettinen,et al.  Incorporating preference information in interactive reference point methods for multiobjective optimization , 2009 .

[30]  I. Y. Kim,et al.  Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , 2005 .

[31]  Lotfi A. Zadeh,et al.  Optimality and non-scalar-valued performance criteria , 1963 .

[32]  M. Lightner Multiple criterion optimization for the design of electronic circuits , 1981 .

[33]  Jian-Bo Yang,et al.  Quantitative parametric connections between methods for generating noninferior solutions in multiobjective optimization , 1999, Eur. J. Oper. Res..

[34]  João C. N. Clímaco,et al.  A review of interactive methods for multiobjective integer and mixed-integer programming , 2007, Eur. J. Oper. Res..

[35]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[36]  Andrea Toffolo,et al.  Evolutionary algorithms for multi-objective energetic and economic optimization in thermal system design , 2002 .

[37]  R. S. Laundy Multiple Criteria Optimisation: Theory, Computation and Application , 1988 .

[38]  John E. Renaud,et al.  Interactive Multiobjective Optimization Procedure , 1999 .

[39]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[40]  Vincent Conitzer,et al.  Commitment to Correlated Strategies , 2011, AAAI.

[41]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[42]  Jarke J. van Wijk,et al.  HyperSlice - Visualization of Scalar Functions of Many Variables , 1993, IEEE Visualization.

[43]  Ching-Lai Hwang,et al.  Methods for Multiple Objective Decision Making , 1979 .

[44]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[45]  Manish Jain,et al.  Software Assistants for Randomized Patrol Planning for the LAX Airport Police and the Federal Air Marshal Service , 2010, Interfaces.

[46]  Nicola Basilico,et al.  Leader-follower strategies for robotic patrolling in environments with arbitrary topologies , 2009, AAMAS.

[47]  C. Hwang Multiple Objective Decision Making - Methods and Applications: A State-of-the-Art Survey , 1979 .

[48]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.