Games Where You Can Play Optimally with Finite Memory

For decades, two-player (antagonistic) games on graphs have been a framework of choice for many important problems in theoretical computer science. A notorious one is controller synthesis, which can be rephrased through the game-theoretic metaphor as the quest for a winning strategy of the system in a game against its antagonistic environment. Depending on the specification, optimal strategies might be simple or quite complex, for example having to use (possibly infinite) memory. Hence, research strives to understand which settings allow for simple strategies. In 2005, Gimbert and Zielonka provided a complete characterization of preference relations (a formal framework to model specifications and game objectives) that admit memoryless optimal strategies for both players. In the last fifteen years however, practical applications have driven the community toward games with complex or multiple objectives, where memory --- finite or infinite --- is almost always required. Despite much effort, the exact frontiers of the class of preference relations that admit finite-memory optimal strategies still elude us. In this work, we establish a complete characterization of preference relations that admit optimal strategies using arena-independent finite memory, generalizing the work of Gimbert and Zielonka to the finite-memory case. We also prove an equivalent to their celebrated corollary of utmost practical interest: if both players have optimal (arena-independent-)finite-memory strategies in all one-player games, then it is also the case in all two-player games. Finally, we pinpoint the boundaries of our results with regard to the literature: our work completely covers the case of arena-independent memory (e.g., multiple parity objectives, lower- and upper-bounded energy objectives), and paves the way to the arena-dependent case (e.g., multiple lower-bounded energy objectives).

[1]  Hugo Gimbert,et al.  When Can You Play Positionally? , 2004, MFCS.

[2]  Kim G. Larsen,et al.  Average-energy games , 2015, Acta Informatica.

[3]  Hugo Gimbert,et al.  Pure Stationary Optimal Strategies in Markov Decision Processes , 2007, STACS.

[4]  Krishnendu Chatterjee,et al.  Generalized Parity Games , 2007, FoSSaCS.

[5]  Thomas Wilke,et al.  Automata logics, and infinite games: a guide to current research , 2002 .

[6]  Krishnendu Chatterjee,et al.  Looking at mean-payoff and total-payoff through windows , 2015, Inf. Comput..

[7]  Wieslaw Zielonka,et al.  Infinite Games on Finitely Coloured Graphs with Applications to Automata on Infinite Trees , 1998, Theor. Comput. Sci..

[8]  Véronique Bruyère,et al.  Window Parity Games: An Alternative Approach Toward Parity Games with Time Bounds (Full Version) , 2016, GandALF.

[9]  Hugo Gimbert,et al.  Games Where You Can Play Optimally Without Any Memory , 2005, CONCUR.

[10]  Mickael Randour,et al.  Automated synthesis of reliable and efficient systems through game theory: a case study , 2012, ArXiv.

[11]  Stéphane Le Roux Concurrent games and semi-random determinacy , 2018, MFCS.

[12]  Marcin Jurdziński,et al.  Deciding the Winner in Parity Games is in UP \cap co-Up , 1998, Inf. Process. Lett..

[13]  Krishnendu Chatterjee,et al.  The complexity of multi-mean-payoff and multi-energy games , 2012, Inf. Comput..

[14]  Krishnendu Chatterjee,et al.  Strategy synthesis for multi-dimensional quantitative objectives , 2012, Acta Informatica.

[15]  Krishnendu Chatterjee,et al.  Mean-payoff parity games , 2005, 20th Annual IEEE Symposium on Logic in Computer Science (LICS' 05).

[16]  E. Allen Emerson,et al.  The Complexity of Tree Automata and Logics of Programs , 1999, SIAM J. Comput..

[17]  Stéphane Le Roux,et al.  Infinite sequential Nash equilibrium , 2013, Log. Methods Comput. Sci..

[18]  Véronique Bruyère,et al.  Meet Your Expectations With Guarantees: Beyond Worst-Case Synthesis in Quantitative Games , 2013, STACS.

[19]  Mickael Randour,et al.  Life is Random, Time is Not: Markov Decision Processes with Window Objectives , 2019, CONCUR.

[20]  Krishnendu Chatterjee,et al.  Graph Games and Reactive Synthesis , 2018, Handbook of Model Checking.

[21]  Florian Horn,et al.  The surprizing complexity of reachability games , 2010, ArXiv.

[22]  Kim G. Larsen,et al.  Infinite Runs in Weighted Timed Automata with Energy Constraints , 2008, FORMATS.

[23]  A. Ehrenfeucht,et al.  Positional strategies for mean payoff games , 1979 .

[24]  Eryk Kopczynski,et al.  Half-Positional Determinacy of Infinite Games , 2006, ICALP.

[25]  Krishnendu Chatterjee,et al.  Energy Parity Games , 2010, ICALP.

[26]  Véronique Bruyère,et al.  Energy mean-payoff games , 2019, CONCUR.

[27]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[28]  Arno Pauly,et al.  Extending finite-memory determinacy by Boolean combination of winning conditions , 2018, FSTTCS.

[29]  Lorenzo Clemente,et al.  Non-Zero Sum Games for Reactive Synthesis , 2015, LATA.