Nash Equilibrium and Bisimulation Invariance

Game theory provides a well-established framework for the analysis of concurrent and multi-agent systems. The basic idea is that concurrent processes (agents) can be understood as corresponding to players in a game; plays represent the possible computation runs of the system; and strategies define the behaviour of agents. Typically, strategies are modelled as functions from sequences of system states to player actions. Analysing a system in such a way involves computing the set of (Nash) equilibria in the game. However, we show that, with respect to the above model of strategies---the standard model in the literature---bisimilarity does not preserve the existence of Nash equilibria. Thus, two concurrent games which are behaviourally equivalent from a semantic perspective, and which from a logical perspective satisfy the same temporal formulae, nevertheless have fundamentally different properties from a game theoretic perspective. In this paper we explore the issues raised by this discovery, and investigate three models of strategies with respect to which the existence of Nash equilibria is preserved under bisimilarity. We also use some of these models of strategies to provide new semantic foundations for logics for strategic reasoning, and investigate restricted scenarios where bisimilarity can be shown to preserve the existence of Nash equilibria with respect to the conventional model of strategies in the literature.

[1]  Michael Wooldridge,et al.  EVE: A Tool for Temporal Equilibrium Analysis , 2018, ATVA.

[2]  Valentin Goranko,et al.  Temporal Logics in Computer Science: Finite-State Systems , 2016, Cambridge Tracts in Theoretical Computer Science.

[3]  Aniello Murano,et al.  Reasoning about Strategies: on the Satisfiability Problem , 2016, Log. Methods Comput. Sci..

[4]  Marta Z. Kwiatkowska,et al.  PRISM-Games 2.0: A Tool for Multi-objective Strategy Synthesis for Stochastic Games , 2016, TACAS.

[5]  Michael Wooldridge,et al.  Rational Verification: From Model Checking to Equilibrium Checking , 2016, AAAI.

[6]  Michael Wooldridge,et al.  From model checking to equilibrium checking: Reactive modules for rational verification , 2016, Artif. Intell..

[7]  Michael Wooldridge,et al.  A Tool for the Automated Verification of Nash Equilibria in Concurrent Games , 2015, ICTAC.

[8]  Patricia Bouyer,et al.  Pure Nash Equilibria in Concurrent Deterministic Games , 2015, Log. Methods Comput. Sci..

[9]  Michael Wooldridge,et al.  Reasoning about equilibria in game-like concurrent systems , 2014, Ann. Pure Appl. Log..

[10]  Michael Wooldridge,et al.  Equilibria of concurrent games on event structures , 2014, CSL-LICS.

[11]  Alessio Lomuscio,et al.  MCMAS-SLK: A Model Checker for the Verification of Strategy Logic Specifications , 2014, CAV.

[12]  Michael Wooldridge,et al.  Iterated Boolean games , 2013, Inf. Comput..

[13]  Romain Brenguier,et al.  PRALINE: A Tool for Computing Nash Equilibria in Concurrent Games , 2013, CAV.

[14]  Aniello Murano,et al.  Reasoning About Strategies: On the Model-Checking Problem , 2011, ArXiv.

[15]  Patricia Bouyer,et al.  Nash Equilibria in Concurrent Games with Büchi Objectives , 2011, FSTTCS.

[16]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[17]  M. Dufwenberg Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[18]  Bernd Finkbeiner,et al.  Coordination Logic , 2010, CSL.

[19]  Dana Fisman,et al.  Rational Synthesis , 2009, TACAS.

[20]  Davide Sangiorgi,et al.  On the origins of bisimulation and coinduction , 2009, TOPL.

[21]  Christel Baier,et al.  Principles of model checking , 2008 .

[22]  Krishnendu Chatterjee,et al.  Strategy logic , 2007, Inf. Comput..

[23]  Michael Wooldridge,et al.  On the complexity of practical ATL model checking , 2006, AAMAS '06.

[24]  Rohit Parikh,et al.  Game Logic - An Overview , 2003, Stud Logica.

[25]  Patrick Cousot,et al.  On Abstraction in Software Verification , 2002, CAV.

[26]  Johan van Benthem,et al.  Extensive Games as Process Models , 2002, J. Log. Lang. Inf..

[27]  Marc Pauly,et al.  A Modal Logic for Coalitional Power in Games , 2002, J. Log. Comput..

[28]  Thomas A. Henzinger,et al.  Alternating Refinement Relations , 1998, CONCUR.

[29]  Thomas A. Henzinger,et al.  MOCHA: Modularity in Model Checking , 1998, CAV.

[30]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[31]  Joseph Sifakis,et al.  Model checking , 1996, Handbook of Automated Reasoning.

[32]  Thomas A. Henzinger,et al.  Reactive Modules , 1996, Proceedings 11th Annual IEEE Symposium on Logic in Computer Science.

[33]  Rob J. van Glabbeek,et al.  Branching time and abstraction in bisimulation semantics , 1996, JACM.

[34]  Edmund M. Clarke,et al.  Model checking and abstraction , 1994, TOPL.

[35]  Randal E. Bryant,et al.  Symbolic Boolean manipulation with ordered binary-decision diagrams , 1992, CSUR.

[36]  Rocco De Nicola,et al.  Three logics for branching bisimulation , 1990, [1990] Proceedings. Fifth Annual IEEE Symposium on Logic in Computer Science.

[37]  C. A. R. Hoare,et al.  A Theory of Communicating Sequential Processes , 1984, JACM.

[38]  Edmund M. Clarke,et al.  Design and Synthesis of Synchronization Skeletons Using Branching-Time Temporal Logic , 1981, Logic of Programs.

[39]  Amir Pnueli,et al.  The temporal logic of programs , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[40]  Michael Wooldridge,et al.  Expresiveness and Complexity Results for Strategic Reasoning , 2015, CONCUR.

[41]  Orna Kupferman,et al.  Repairing Multi-Player Games , 2015, CONCUR.

[42]  Johan van Benthem,et al.  Reasoning about Strategies , 2013, Computation, Logic, Games, and Quantum Foundations.

[43]  Luca Aceto,et al.  Advanced Topics in Bisimulation and Coinduction , 2012, Cambridge tracts in theoretical computer science.

[44]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[45]  K. Vrieze,et al.  A course in game theory , 1992 .

[46]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[47]  Robin Milner,et al.  Algebraic laws for nondeterminism and concurrency , 1985, JACM.

[48]  Dexter Kozen,et al.  RESULTS ON THE PROPOSITIONAL’p-CALCULUS , 2001 .

[49]  Robin Milner,et al.  A Calculus of Communicating Systems , 1980, Lecture Notes in Computer Science.

[50]  J.F.A.K. van Benthem,et al.  Modal Correspondence Theory , 1977 .