The optimality equation and ε-optimal strategies in Markov games with average reward criterion

Abstract. In this paper we consider two-person zero-sum stochastic games with unbounded payoffs and the average reward criterion. State and action spaces are assumed to be Borel spaces. Under conditions which are more general than the ergodicity assumptions in related works [5], [7] and [12], we show that the optimality equation has a solution and that ε-optimal stationary strategies exist. Our proofs use a completely different approach compared to the above mentioned papers. We prove that operators of a parametrized class have fixed points, and then we use continuity and monotonicity properties of these fixed points with respect to the class parameter to show that the optimality equation has a solution.