Limit Cycles Sparked by Mutation in the Repeated Prisoner's Dilemma

We explore a replicator-mutator model of the repeated Prisoner's Dilemma involving three strategies: always cooperate (ALLC), always defect (ALLD), and tit-for-tat (TFT). The dynamics resulting from single unidirectional mutations are considered, with detailed results presented for the mutations TFT $\rightarrow$ ALLC and ALLD $\rightarrow$ ALLC. For certain combinations of parameters, given by the mutation rate $\mu$ and the complexity cost $c$ of playing tit-for-tat, we find that the population settles into limit cycle oscillations, with the relative abundance of ALLC, ALLD, and TFT cycling periodically. Surprisingly, these oscillations can occur for unidirectional mutations between any two strategies. In each case, the limit cycles are created and destroyed by supercritical Hopf and homoclinic bifurcations, organized by a Bogdanov-Takens bifurcation. Our results suggest that stable oscillations are a robust aspect of a world of ALLC, ALLD, and costly TFT; the existence of cycles does not depend on the details of assumptions of how mutation is implemented.

[1]  Martin A Nowak,et al.  Chaos and language , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[2]  P. Richerson,et al.  Punishment allows the evolution of cooperation (or anything else) in sizable groups , 1992 .

[3]  W. Hamilton The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[4]  Naomi Ehrich Leonard,et al.  Limit cycles in replicator-mutator network dynamics , 2011, IEEE Conference on Decision and Control and European Control Conference.

[5]  R. Boyd,et al.  Indirect reciprocity can stabilize cooperation without the second-order free rider problem , 2004, Nature.

[6]  A. Rapoport,et al.  Prisoner's Dilemma: A Study in Conflict and Co-operation , 1970 .

[7]  Peter F. Stadler,et al.  Mutation in autocatalytic reaction networks , 1992 .

[8]  Attila Szolnoki,et al.  Phase transitions for rock-scissors-paper game on different networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[10]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[11]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[12]  Arne Traulsen,et al.  Human strategy updating in evolutionary games , 2010, Proceedings of the National Academy of Sciences.

[13]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[14]  Julián García,et al.  In and out of equilibrium I: Evolution of strategies in repeated games with discounting , 2007, J. Econ. Theory.

[15]  M. Nowak Evolutionary Dynamics: Exploring the Equations of Life , 2006 .

[16]  D. Fudenberg,et al.  Evolution and Cooperation in Noisy Repeated Games , 1990 .

[17]  D. Helbing,et al.  The outbreak of cooperation among success-driven individuals under noisy conditions , 2009, Proceedings of the National Academy of Sciences.

[18]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[19]  K Sigmund,et al.  A note on evolutionary stable strategies and game dynamics. , 1979, Journal of theoretical biology.

[20]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos , 2024 .

[21]  Alternate Models of Replicator Dynamics , 2013 .

[22]  Tobias Galla,et al.  Cycles of cooperation and defection in imperfect learning , 2011, ArXiv.

[23]  David G. Rand,et al.  Direct reciprocity in structured populations , 2012, Proceedings of the National Academy of Sciences.

[24]  R. May More evolution of cooperation , 1987, Nature.

[25]  Martin A. Nowak,et al.  Information, Irrationality and the Evolution of Trust , 2012 .

[26]  M. Nowak,et al.  Tit for tat in heterogeneous populations , 1992, Nature.

[27]  Y. Iwasa,et al.  The evolution of cooperation in a lattice-structured population. , 1997, Journal of theoretical biology.

[28]  C. Hauert,et al.  Volunteering as Red Queen Mechanism for Cooperation in Public Goods Games , 2002, Science.

[29]  Attila Szolnoki,et al.  Phase diagrams for three-strategy evolutionary prisoner's dilemma games on regular graphs. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  A. Houston,et al.  The coevolution of choosiness and cooperation , 2008, Nature.

[31]  M N,et al.  The Evolution of Cooperation in a Lattice-Structured Population , 1996 .

[32]  R. Boyd,et al.  No pure strategy is evolutionarily stable in the repeated Prisoner's Dilemma game , 1987, Nature.

[33]  James H Fowler,et al.  Altruistic Punishment and the Origin of Cooperation , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[34]  David G. Rand,et al.  Direct reciprocity with costly punishment: generous tit-for-tat prevails. , 2009, Journal of theoretical biology.

[35]  Martin A Nowak,et al.  Evolutionary dynamics in set structured populations , 2009, Proceedings of the National Academy of Sciences.

[36]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[37]  Naomi Ehrich Leonard,et al.  Hopf Bifurcations and Limit Cycles in Evolutionary Network Dynamics , 2012, SIAM J. Appl. Dyn. Syst..

[38]  M. Milinski,et al.  Cooperation through image scoring in humans. , 2000, Science.

[39]  David G. Rand,et al.  Evolutionary dynamics in finite populations can explain the full range of cooperative behaviors observed in the centipede game. , 2012, Journal of theoretical biology.

[40]  David G. Rand,et al.  Evolution of fairness in the one-shot anonymous Ultimatum Game , 2013, Proceedings of the National Academy of Sciences.

[41]  David G. Rand,et al.  Human cooperation , 2013, Trends in Cognitive Sciences.

[42]  D. Fudenberg,et al.  Evolutionary cycles of cooperation and defection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[43]  M. Nowak,et al.  Evolution of cooperation by multilevel selection. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Tobias Galla,et al.  Evolutionary dynamics, intrinsic noise, and cycles of cooperation. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  C. Hauert,et al.  Reputation-based partner choice promotes cooperation in social networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.