Weak Subgame Perfect Equilibria and their Application to Quantitative Reachability

We study $n$-player turn-based games played on a finite directed graph. For each play, the players have to pay a cost that they want to minimize. Instead of the well-known notion of Nash equilibrium (NE), we focus on the notion of subgame perfect equilibrium (SPE), a refinement of NE well-suited in the framework of games played on graphs. We also study natural variants of SPE, named weak (resp. very weak) SPE, where players who deviate cannot use the full class of strategies but only a subclass with a finite number of (resp. a unique) deviation step(s). Our results are threefold. Firstly, we characterize in the form of a Folk theorem the set of all plays that are the outcome of a weak SPE. Secondly, for the class of quantitative reachability games, we prove the existence of a finite-memory SPE and provide an algorithm for computing it (only existence was known with no information regarding the memory). Moreover, we show that the existence of a constrained SPE, i.e. an SPE such that each player pays a cost less than a given constant, can be decided. The proofs rely on our Folk theorem for weak SPEs (which coincide with SPEs in the case of quantitative reachability games) and on the decidability of MSO logic on infinite words. Finally with similar techniques, we provide a second general class of games for which the existence of a (constrained) weak SPE is decidable.

[1]  Véronique Bruyère,et al.  Secure equilibria in weighted games , 2014, CSL-LICS.

[2]  D. Fudenberg,et al.  Subgame-perfect equilibria of finite- and infinite-horizon games , 1981 .

[3]  Véronique Bruyère,et al.  On (Subgame Perfect) Secure Equilibrium in Quantitative Reachability Games , 2012, 1205.6346.

[4]  A. Rubinstein COMMENTS ON THE INTERPRETATION OF GAME THEORY , 1991 .

[5]  Microeconomics-Charles W. Upton Repeated games , 2020, Game Theory.

[6]  Arno Pauly,et al.  Infinite sequential games with real-valued payoffs , 2014, CSL-LICS.

[7]  Krishnendu Chatterjee,et al.  Quantitative languages , 2008, TOCL.

[8]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Michael Ummels,et al.  Rational Behaviour and Strategy Construction in Infinite Multiplayer Games , 2006, FSTTCS.

[10]  H. W. Kuhn,et al.  11. Extensive Games and the Problem of Information , 1953 .

[11]  Wolfgang Thomas,et al.  Automata on Infinite Objects , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[12]  Kim G. Larsen,et al.  Nash Equilibria in Concurrent Priced Games , 2012, LATA.

[13]  János Flesch,et al.  Perfect-Information Games with Lower-Semicontinuous Payoffs , 2010, Math. Oper. Res..

[14]  Sven Schewe,et al.  Multiplayer Cost Games with Simple Nash Equilibria , 2012, LFCS.

[15]  N. Vieille,et al.  Deterministic Multi-Player Dynkin Games , 2003 .

[16]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[17]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.