Game Relations and Metrics

We consider two-player games played over finite state spaces for an infinite number of rounds. At each state, the players simultaneously choose moves; the moves determine a successor state. It is often advantageous for players to choose probability distributions over moves, rather than single moves. Given a goal (e.g., "reach a target state"), the question of winning is thus a probabilistic one: "what is the maximal probability of winning from a given state?". On these game structures, two fundamental notions are those of equivalences and metrics. Given a set of winning conditions, two states are equivalent if the players can win the same games with the same probability from both states. Metrics provide a bound on the difference in the probabilities of winning across states, capturing a quantitative notion of state "similarity". We introduce equivalences and metrics for two-player game structures, and we show that they characterize the difference in probability of winning games whose goals are expressed in the quantitative mu-calculus. The quantitative mu- calculus can express a large set of goals, including reachability, safety, and omega-regular properties. Thus, we claim that our relations and metrics provide the canonical extensions to games, of the classical notion of bisimulation for transition systems. We develop our results both for equivalences and metrics, which generalize bisimulation, and for asymmetrical versions, which generalize simulation.

[1]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[2]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 2002, JACM.

[3]  Thomas A. Henzinger,et al.  Symbolic algorithms for verification and control , 2003 .

[4]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 1999 .

[5]  Annabelle McIver,et al.  Abstraction, Refinement and Proof for Probabilistic Systems , 2004, Monographs in Computer Science.

[6]  Donald A. Martin,et al.  The determinacy of Blackwell games , 1998, Journal of Symbolic Logic.

[7]  Radha Jagadeesan,et al.  Metrics for Labeled Markov Systems , 1999, CONCUR.

[8]  Rupak Majumdar,et al.  Quantitative solution of omega-regular games , 2004, J. Comput. Syst. Sci..

[9]  Dexter Kozen,et al.  A probabilistic PDL , 1983, J. Comput. Syst. Sci..

[10]  G. Sacks A DECISION METHOD FOR ELEMENTARY ALGEBRA AND GEOMETRY , 2003 .

[11]  Radha Jagadeesan,et al.  Approximating labelled Markov processes , 2003, Inf. Comput..

[12]  Thomas A. Henzinger,et al.  Discounting the Future in Systems Theory , 2003, ICALP.

[13]  Nancy A. Lynch,et al.  Probabilistic Simulations for Probabilistic Processes , 1994, Nord. J. Comput..

[14]  Dexter Kozen,et al.  Results on the Propositional µ-Calculus , 1982, ICALP.

[15]  D. Kozen Results on the Propositional µ-Calculus , 1982 .

[16]  Robin Milner,et al.  Operational and Algebraic Semantics of Concurrent Processes , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[17]  Thomas A. Henzinger,et al.  Alternating Refinement Relations , 1998, CONCUR.

[18]  Thomas A. Henzinger,et al.  Concurrent reachability games , 2007, Theor. Comput. Sci..

[19]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[20]  Roberto Segala,et al.  Modeling and verification of randomized distributed real-time systems , 1996 .

[21]  Radha Jagadeesan,et al.  The metric analogue of weak bisimulation for probabilistic processes , 2002, Proceedings 17th Annual IEEE Symposium on Logic in Computer Science.

[22]  Dexter Kozen,et al.  RESULTS ON THE PROPOSITIONAL’p-CALCULUS , 2001 .

[23]  J. Kemeny,et al.  Denumerable Markov chains , 1969 .

[24]  Kim G. Larsen,et al.  Compositional Verification of Probabilistic Processes , 1992, CONCUR.

[25]  M. Sion On general minimax theorems , 1958 .

[26]  James Worrell,et al.  An Algorithm for Quantitative Verification of Probabilistic Transition Systems , 2001, CONCUR.

[27]  Cyrus Derman,et al.  Finite State Markovian Decision Processes , 1970 .

[28]  Scott A. Smolka,et al.  Equivalences, Congruences, and Complete Axiomatizations for Probabilistic Processes , 1990, CONCUR.

[29]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[30]  J. Filar,et al.  Competitive Markov Decision Processes , 1996 .