Regret-Based Optimization and Preference Elicitation for Stackelberg Security Games with Uncertainty

Stackelberg security games (SSGs) have been deployed in a number of real-world domains. One key challenge in these applications is the assessment of attacker payoffs, which may not be perfectly known. Previous work has studied SSGs with uncertain payoffs modeled by interval uncertainty and provided maximin-based robust solutions. In contrast, in this work we propose the use of the less conservative minimax regret decision criterion for such payoff-uncertain SSGs and present the first algorithms for computing minimax regret for SSGs. We also address the challenge of preference elicitation, using minimax regret to develop the first elicitation strategies for SSGs. Experimental results validate the effectiveness of our approaches.

[1]  Craig Boutilier,et al.  Regret Minimizing Equilibria and Mechanisms for Games with Strict Type Uncertainty , 2004, UAI.

[2]  Milind Tambe,et al.  A unified method for handling discrete and continuous uncertainty in Bayesian Stackelberg games , 2012, AAMAS.

[3]  Manish Jain,et al.  Risk-Averse Strategies for Security Games with Execution and Observational Uncertainty , 2011, AAAI.

[4]  Dimitris Bertsimas,et al.  Robust game theory , 2006, Math. Program..

[5]  Craig Boutilier,et al.  Constraint-based optimization and utility elicitation using the minimax decision criterion , 2006, Artif. Intell..

[6]  Ludovic Renou,et al.  Minimax Regret and Strategic Uncertainty , 2008, J. Econ. Theory.

[7]  Raimo P. Hämäläinen,et al.  Preference ratios in multiattribute evaluation (PRIME)-elicitation and decision procedures under incomplete information , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[8]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[9]  J. Schreiber.  Foundations Of Statistics , 2016 .

[10]  B. Stengel,et al.  Leadership with commitment to mixed strategies , 2004 .

[11]  Benjamin Van Roy,et al.  On Constraint Sampling in the Linear Programming Approach to Approximate Dynamic Programming , 2004, Math. Oper. Res..

[12]  Juliane Hahn,et al.  Security And Game Theory Algorithms Deployed Systems Lessons Learned , 2016 .

[13]  Craig Boutilier,et al.  Computational Decision Support: Regret-based Models for Optimization and Preference Elicitation , 2012 .

[14]  Bo An,et al.  Security Games Applied to Real-World: Research Contributions and Challenges , 2013, Moving Target Defense.

[15]  S. French,et al.  Decision Theory: An Introduction to the Mathematics of Rationality. , 1988 .

[16]  K. McConway,et al.  Decision Theory: An Introduction to the Mathematics of Rationality , 1986 .

[17]  Milind Tambe,et al.  Approximation methods for infinite Bayesian Stackelberg games: modeling distributional payoff uncertainty , 2011, AAMAS.

[18]  Craig Boutilier,et al.  Regret-based Reward Elicitation for Markov Decision Processes , 2009, UAI.

[19]  Vladik Kreinovich,et al.  Security games with interval uncertainty , 2013, AAMAS.

[20]  Craig Boutilier,et al.  Assessing regret-based preference elicitation with the UTPREF recommendation system , 2010, EC '10.

[21]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[22]  Bo An,et al.  PROTECT: a deployed game theoretic system to protect the ports of the United States , 2012, AAMAS.

[23]  Manish Jain,et al.  Computing optimal randomized resource allocations for massive security games , 2009, AAMAS 2009.

[24]  Vincent Conitzer.  Computing Game-Theoretic Solutions and Applications to Security , 2012, AAAI.

[25]  Craig Boutilier,et al.  Eliciting Bid Taker Non-price Preferences in (Combinatorial) Auctions , 2004, AAAI.

[26]  Nicola Basilico,et al.  Leader-follower strategies for robotic patrolling in environments with arbitrary topologies , 2009, AAMAS.

[27]  A Gerodimos,et al.  Robust Discrete Optimization and its Applications , 1996, J. Oper. Res. Soc..