Robust Cooperation in the Prisoner's Dilemma: Program Equilibrium via Provability Logic

We consider the one-shot Prisoner's Dilemma between algorithms with read-access to one anothers' source codes, and we use the modal logic of provability to build agents that can achieve mutual cooperation in a manner that is robust, in that cooperation does not require exact equality of the agents' source code, and unexploitable, meaning that such an agent never cooperates when its opponent defects. We construct a general framework for such "modal agents", and study their properties.

[1]  Anatol Rapoport,et al.  Two-person game theory , 1966 .

[2]  Balázs Szentes,et al.  Definable and Contractible Contracts , 2012 .

[3]  Ken Binmore,et al.  Modeling Rational Players: Part II , 1987, Economics and Philosophy.

[4]  Moshe Tennenholtz,et al.  Program equilibrium , 2004, Games Econ. Behav..

[5]  David Canning,et al.  Rationality, Computability, and Nash Equilibrium , 1992 .

[6]  John V. Howard,et al.  Cooperation in the Prisoner's Dilemma , 1988 .

[7]  M. H. Lob,et al.  Solution of a Problem of Leon Henkin , 1955, J. Symb. Log..

[8]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[9]  Moshe Tennenholtz,et al.  Strong mediated equilibrium , 2006, Artif. Intell..

[10]  Ken Binmore,et al.  Modeling Rational Players: Part I , 1987, Economics and Philosophy.

[11]  D.H.J. de Jongh,et al.  The logic of the provability , 1998 .

[12]  Lance Fortnow,et al.  Program equilibria and discounted computation time , 2009, TARK '09.

[13]  Adam Tauman Kalai,et al.  A commitment folk theorem , 2010, Games Econ. Behav..

[14]  Alex Altair,et al.  A Comparison of Decision Algorithms on Newcomblike Problems , 2023, ArXiv.

[15]  Michael Wooldridge,et al.  Program equilibrium—a program reasoning approach , 2011, International Journal of Game Theory.

[16]  Per Lindström,et al.  Provability logic—a short introduction , 2008 .

[17]  Luca Anderlini,et al.  Some notes on Church's thesis and the theory of games , 1990 .

[18]  Stephen Cole Kleene,et al.  On notation for ordinal numbers , 1938, Journal of Symbolic Logic.

[19]  G. Drescher.  Good and Real: Demystifying Paradoxes from Physics to Ethics , 2006 .

[20]  D. Hofstadter.  Metamagical Themas: Questing for the Essence of Mind and Pattern , 1985 .

[21]  Ken Binmore,et al.  Modeling rational players I , 1987 .