Computing a Pessimistic Stackelberg Equilibrium with Multiple Followers: The Mixed-Pure Case

The search problem of computing a Stackelberg (or leader-follower) equilibrium (also referred to as an optimal strategy to commit to ) has been widely investigated in the scientific literature in, almost exclusively, the single-follower setting. Although the optimistic and pessimistic versions of the problem, i.e., those where the single follower breaks any ties among multiple equilibria either in favour or against the leader, are solved with different methodologies, both cases allow for efficient, polynomial-time algorithms based on linear programming. The situation is different with multiple followers, where results are only sporadic and depend strictly on the nature of the followers’ game. In this paper, we investigate the setting of a normal-form game with a single leader and multiple followers who, after observing the leader’s commitment, play a Nash equilibrium. When both leader and followers are allowed to play mixed strategies, the corresponding search problem, both in the optimistic and pessimistic versions, is known to be inapproximable in polynomial time to within any multiplicative polynomial factor unless $$\textsf {P}=\textsf {NP}$$ P = NP . Exact algorithms are known only for the optimistic case. We focus on the case where the followers play pure strategies—a restriction that applies to a number of real-world scenarios and which, in principle, makes the problem easier—under the assumption of pessimism (the optimistic version of the problem can be straightforwardly solved in polynomial time). After casting this search problem (with followers playing pure strategies) as a pessimistic bilevel programming problem , we show that, with two followers, the problem is NP -hard and, with three or more followers, it cannot be approximated in polynomial time to within any multiplicative factor which is polynomial in the size of the normal-form game, nor, assuming utilities in [0, 1], to within any constant additive loss stricly smaller than 1 unless $$\textsf {P}=\textsf {NP}$$ P = NP . This shows that, differently from what happens in the optimistic version, hardness and inapproximability in the pessimistic problem are not due to the adoption of mixed strategies. We then show that the problem admits, in the general case, a supremum but not a maximum, and we propose a single-level mathematical programming reformulation which asks for the maximization of a nonconcave quadratic function over an unbounded nonconvex feasible region defined by linear and quadratic constraints. Since, due to admitting a supremum but not a maximum, only a restricted version of this formulation can be solved to optimality with state-of-the-art methods, we propose an exact ad hoc algorithm (which we also embed within a branch-and-bound scheme) capable of computing the supremum of the problem and, for cases where there is no leader’s strategy where such value is attained, also an $$\alpha $$ α -approximate strategy where $$\alpha > 0$$ α > 0 is an arbitrary additive loss (at most as large as the supremum). We conclude the paper by evaluating the scalability of our algorithms via computational experiments on a well-established testbed of game instances.

[1]  Nicola Gatti,et al.  Leadership in Congestion Games: Multiple User Classes and Non-Singleton Actions (Extended Version) , 2019, IJCAI.

[2]  Vincent Conitzer,et al.  Mixed-Integer Programming Methods for Finding Nash Equilibria , 2005, AAAI.

[3]  Alain B. Zemkoho,et al.  Solving Ill-posed Bilevel Programs , 2016 .

[4]  William Stanford,et al.  A Note on the Probability of k Pure Nash Equilibria in Matrix Games , 1995 .

[5]  Stefano Coniglio,et al.  Leadership in Singleton Congestion Games: What is Hard and What is Easy , 2018, Artif. Intell..

[6]  Vincent Conitzer,et al.  Computing the optimal strategy to commit to , 2006, EC '06.

[7]  Sarit Kraus,et al.  Playing games for security: an efficient exact algorithm for solving Bayesian Stackelberg games , 2008, AAMAS.

[8]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[9]  Gerhard J. Woeginger,et al.  Bilevel Knapsack with Interdiction Constraints , 2016, INFORMS J. Comput..

[10]  Tuomas Sandholm,et al.  Quasi-Perfect Stackelberg Equilibrium , 2018, AAAI.

[11]  L. Shapley,et al.  Potential Games , 1994 .

[12]  Bo An,et al.  GUARDS and PROTECT: next generation applications of security games , 2011, SECO.

[13]  Nicola Basilico,et al.  Adversarial patrolling with spatially uncertain alarm signals , 2015, Artif. Intell..

[14]  Bernhard von Stengel,et al.  Leadership games with convex strategy sets , 2010, Games Econ. Behav..

[15]  Tuomas Sandholm,et al.  Trembling-Hand Perfection in Extensive-Form Games with Commitment , 2018, IJCAI.

[16]  Yoav Shoham,et al.  Run the GAMUT: a comprehensive approach to evaluating game-theoretic algorithms , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[17]  Martin Skutella,et al.  Protection of flows under targeted attacks , 2017, Oper. Res. Lett..

[18]  Garth P. McCormick,et al.  Computability of global solutions to factorable nonconvex programs: Part I — Convex underestimating problems , 1976, Math. Program..

[19]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[20]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[21]  Manish Jain,et al.  Computing optimal randomized resource allocations for massive security games , 2009, AAMAS.

[22]  Martine Labbé Bilevel Programming and Price Setting Problems , 2006, OR.

[23]  Vincent Conitzer,et al.  Commitment to Correlated Strategies , 2011, AAAI.

[24]  Eric van Damme,et al.  Non-Cooperative Games , 2000 .

[25]  Stefano Coniglio,et al.  Pessimistic Leader-Follower Equilibria with Multiple Followers , 2017, IJCAI.

[26]  Stefano Coniglio,et al.  Bilevel programming methods for computing single-leader-multi-follower equilibria in normal-form and polymatrix games , 2020, EURO J. Comput. Optim..

[27]  Vincent Conitzer,et al.  Security Games with Multiple Attacker Resources , 2011, IJCAI.

[28]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[29]  Stefano Coniglio,et al.  Methods for Finding Leader-Follower Equilibria with Multiple Followers: (Extended Abstract) , 2016, AAMAS.

[30]  James E. Falk,et al.  Jointly Constrained Biconvex Programming , 1983, Math. Oper. Res..

[31]  Stefano Coniglio,et al.  Bilevel Programming Approaches to the Computation of Optimistic and Pessimistic Single-Leader-Multi-Follower Equilibria , 2017, SEA.

[32]  Stefano Coniglio,et al.  Leadership in Singleton Congestion Games , 2018, IJCAI.

[33]  Edoardo Amaldi,et al.  Network Optimization Problems Subject to Max-Min Fair Flow Allocation , 2013, IEEE Communications Letters.

[34]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.