Blackwell-Optimal Strategies in Priority Mean-Payoff Games

We examine perfect information stochastic mean-payoff games - a class of games containing as special sub-classes the usual mean-payoff games and parity games. We show that deterministic memoryless strategies that are optimal for discounted games with state-dependent discount factors close to 1 are optimal for priority mean-payoff games establishing a strong link between these two classes.

[1]  D. Blackwell.  Discrete Dynamic Programming , 1962 .

[2]  Hugo Gimbert,et al.  Perfect Information Stochastic Priority Games , 2007, ICALP.

[3]  Ali Esmaili,et al.  Probability and Random Processes , 2005, Technometrics.

[4]  Donald A. Martin,et al.  The determinacy of Blackwell games , 1998, Journal of Symbolic Logic.

[5]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[6]  Thomas A. Henzinger,et al.  Discounting the Future in Systems Theory , 2003, ICALP.

[7]  Julia Donaldson,et al.  The big match , 2008 .

[8]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[9]  Hugo Gimbert,et al.  Blackwell Optimal Strategies in Priority mean-Payoff Games , 2012, Int. J. Found. Comput. Sci..

[10]  Henrik Björklund,et al.  Memoryless determinacy of parity and mean payoff games: a simple proof , 2004, Theor. Comput. Sci..

[11]  Shashi M. Srivastava,et al.  A Course on Borel Sets , 1998, Graduate texts in mathematics.

[12]  Hugo Gimbert,et al.  Limits of Multi-Discounted Markov Decision Processes , 2007, 22nd Annual IEEE Symposium on Logic in Computer Science (LICS 2007).

[13]  J. Filar,et al.  Competitive Markov Decision Processes , 1996 .

[14]  Krishnendu Chatterjee,et al.  Mean-payoff parity games , 2005, 20th Annual IEEE Symposium on Logic in Computer Science (LICS' 05).

[15]  Hugo Gimbert,et al.  Deterministic Priority Mean-Payoff Games as Limits of Discounted Games , 2006, ICALP.

[16]  Hugo Gimbert,et al.  Applying Blackwell optimality: priority mean-payoff games as limits of multi-discounted games , 2007, Logic and Automata.

[18]  Hugo Gimbert,et al.  Pure Stationary Optimal Strategies in Markov Decision Processes , 2007, STACS.

[19]  D. Stroock.  An Introduction to Markov Processes , 2004 .