Optimality in different strategy classes in zero-sum stochastic games

Abstract. We present a complete picture of the relationship between the existence of 0-optimal strategies and ε-optimal strategies, ε>0, in the classes of stationary, Markov and history dependent strategies.

[1]  János Flesch,et al.  Markov Strategies are Better than stationary Strategies , 1999, IGTR.

[2]  Elon Kohlberg,et al.  On Stochastic Games with Stationary Optimal Strategies , 1978, Math. Oper. Res..

[3]  D. Blackwell,et al.  THE BIG MATCH , 1968, Classics in Game Theory.

[4]  Jerzy A. Filar,et al.  Nonlinear programming and stationary equilibria in stochastic games , 1991, Math. Program..

[5]  O. J. Vrieze,et al.  Simplifying Optimal Strategies in Stochastic Games , 1998 .

[6]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[7]  Dean Gillette,et al.  9. STOCHASTIC GAMES WITH ZERO STOP PROBABILITIES , 1958 .