Evolutionary dynamics, intrinsic noise, and cycles of cooperation.

We use analytical techniques based on an expansion in the inverse system size to study the stochastic evolutionary dynamics of finite populations of players interacting in a repeated prisoner's dilemma game. We show that a mechanism of amplification of demographic noise can give rise to coherent oscillations in parameter regimes where deterministic descriptions converge to fixed points with complex eigenvalues. These quasicycles between cooperation and defection have previously been observed in computer simulations; here we provide a systematic and comprehensive analytical characterization of their properties. We are able to predict their power spectra as a function of the mutation rate and other model parameters and to compare the relative magnitude of the cycles induced by different types of underlying microscopic dynamics. We also extend our analysis to the iterated prisoner's dilemma game with a win-stay lose-shift strategy, appropriate in situations where players are subject to errors of the trembling-hand type.

[1]  C. Hauert,et al.  Coevolutionary dynamics: from finite to infinite populations. , 2004, Physical review letters.

[2]  T. Reichenbach,et al.  Mobility promotes and jeopardizes biodiversity in rock–paper–scissors games , 2007, Nature.

[3]  Mauro Mobilia,et al.  Oscillatory dynamics in rock-paper-scissors games with mutations. , 2009, Journal of theoretical biology.

[4]  A. Traulsen,et al.  Fixation times in evolutionary games under weak selection , 2008, 0812.0851.

[5]  Tobias Galla,et al.  Intrinsic fluctuations in stochastic delay systems: theoretical description and application to a simple model of gene regulation. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  A. McKane,et al.  Amplified Biochemical Oscillations in Cellular Systems , 2006, q-bio/0604001.

[7]  Elizabeth Pennisi,et al.  How Did Cooperative Behavior Evolve? , 2005, Science.

[8]  Arne Traulsen,et al.  Coevolutionary dynamics in large, but finite populations. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Arne Traulsen,et al.  Human strategy updating in evolutionary games , 2010, Proceedings of the National Academy of Sciences.

[10]  Arne Traulsen,et al.  Cyclic dominance and biodiversity in well-mixed populations. , 2008, Physical review letters.

[11]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[12]  Ulf Dieckmann,et al.  A tale of two cycles – distinguishing quasi-cycles and limit cycles in finite predator–prey populations , 2007 .

[13]  A. Traulsen,et al.  Deterministic evolutionary game dynamics in finite populations. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  M. Milinski TIT FOR TAT in sticklebacks and the evolution of cooperation , 1987, Nature.

[15]  J. Sprott Chaos and time-series analysis , 2001 .

[16]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[17]  Paul E. Turner,et al.  Prisoner's dilemma in an RNA virus , 1999, Nature.

[18]  D. Fudenberg,et al.  Tit-for-tat or win-stay, lose-shift? , 2007, Journal of theoretical biology.

[19]  A. Traulsen,et al.  Non-Gaussian fluctuations arising from finite populations: Exact results for the evolutionary Moran process. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[21]  P. A. P. Moran,et al.  Random processes in genetics , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[22]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[23]  D. Fanelli,et al.  Stochastic Turing patterns in the Brusselator model. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[25]  A J McKane,et al.  Predator-prey cycles from resonant amplification of demographic stochasticity. , 2005, Physical review letters.

[26]  B. M. Fulk MATH , 1992 .

[27]  Andrew J Black,et al.  Stochastic fluctuations in the susceptible-infective-recovered model with distributed infectious periods. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  C. W. Gardiner,et al.  Handbook of stochastic methods - for physics, chemistry and the natural sciences, Second Edition , 1986, Springer series in synergetics.

[29]  Arne Traulsen,et al.  Pairwise comparison and selection temperature in evolutionary game dynamics. , 2007, Journal of theoretical biology.

[30]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations with strong selection and weak mutation. , 2006, Theoretical population biology.

[31]  M. Milinski,et al.  Volunteering leads to rock–paper–scissors dynamics in a public goods game , 2003, Nature.

[32]  Jens Christian Claussen,et al.  Drift reversal in asymmetric coevolutionary conflicts: influence of microscopic processes and population size , 2007, 0712.4224.

[33]  L. Samuelson,et al.  Evolutionary stability in repeated games played by finite automata , 1992 .

[34]  Tobias Galla,et al.  Limit cycles, complex Floquet multipliers, and intrinsic noise. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  M A Nowak,et al.  Evolution of universal grammar. , 2001, Science.

[36]  Richard P Boland,et al.  How limit cycles and quasi-cycles are related in systems with intrinsic noise , 2008, 0805.1607.

[37]  M. Lombardo,et al.  Mutual Restraint in Tree Swallows: A Test of the TIT FOR TAT Model of Reciprocity , 1985, Science.

[38]  D. Fudenberg,et al.  Evolutionary cycles of cooperation and defection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[39]  R. Axelrod,et al.  The Further Evolution of Cooperation , 1988, Science.

[40]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[41]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[42]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[43]  S. Swain Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences , 1984 .

[44]  M. Pascual,et al.  Stochastic amplification in epidemics , 2007, Journal of The Royal Society Interface.

[45]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[46]  Thomas Butler,et al.  Robust ecological pattern formation induced by demographic noise. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Erwin Frey,et al.  Coexistence versus extinction in the stochastic cyclic Lotka-Volterra model. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  A. Nunes,et al.  Fluctuations and oscillations in a simple epidemic model. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Tobias Galla,et al.  Intrinsic noise in game dynamical learning. , 2009, Physical review letters.

[50]  M. Nowak,et al.  Tit for tat in heterogeneous populations , 1992, Nature.