Stationary Stability for Evolutionary Dynamics in Finite Populations

We demonstrate a vast expansion of the theory of evolutionary stability to finite populations with mutation, connecting the theory of the stationary distribution of the Moran process with the Lyapunov theory of evolutionary stability. We define the notion of stationary stability for the Moran process with mutation and generalizations, as well as a generalized notion of evolutionary stability that includes mutation called an incentive stable state (ISS) candidate. For sufficiently large populations, extrema of the stationary distribution are ISS candidates and we give a family of Lyapunov quantities that are locally minimized at the stationary extrema and at ISS candidates. In various examples, including for the Moran and Wright-Fisher processes, we show that the local maxima of the stationary distribution capture the traditionally-defined evolutionarily stable states. The classical stability theory of the replicator dynamic is recovered in the large population limit. Finally we include descriptions of possible extensions to populations of variable size and populations evolving on graphs.

[1]  Drew Fudenberg,et al.  Monotone Imitation Dynamics in Large Populations , 2007, J. Econ. Theory.

[2]  M. Nowak,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[3]  C. Hauert,et al.  Coevolutionary dynamics: from finite to infinite populations. , 2004, Physical review letters.

[4]  Drew Fudenberg,et al.  Stochastic Evolution as a Generalized Moran Process , 2004 .

[5]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[6]  P. A. P. Moran,et al.  Random processes in genetics , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[7]  William H. Sandholm,et al.  Simple formulas for stationary distributions and stochastically stable states , 2007, Games Econ. Behav..

[8]  Jordan B. Pollack,et al.  Effects of Finite Populations on Evolutionary Stable Strategies , 2000, GECCO.

[9]  Marc Harper,et al.  The Inherent Randomness of Evolving Populations , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  G. Szabó,et al.  Evolutionary potential games on lattices , 2015, 1508.03147.

[11]  Drew Fudenberg,et al.  Imitation Processes with Small Mutations , 2004, J. Econ. Theory.

[12]  Arne Traulsen,et al.  Strategy abundance in 2x2 games for arbitrary mutation rates. , 2008, Journal of theoretical biology.

[13]  Dashiell E. A. Fryer.  The Kullback-Liebler Divergence as a Lyapunov Function for Incentive Based Game Dynamics , 2012, ArXiv.

[14]  David B. Fogel,et al.  On the instability of evolutionary stable strategies in small populations , 1998 .

[15]  E. Akin,et al.  Evolutionary dynamics of zero-sum games , 1984, Journal of mathematical biology.

[16]  Arne Traulsen,et al.  Pairwise comparison and selection temperature in evolutionary game dynamics. , 2007, Journal of theoretical biology.

[17]  William H. Sandholm,et al.  An Introduction to Dynamo: Diagrams for Evolutionary Game Dynamics , 2013 .

[18]  H. Peyton Young,et al.  Stochastic Evolutionary Game Dynamics , 1990 .

[19]  M. Nowak,et al.  Evolutionary game dynamics in a Wright-Fisher process , 2006, Journal of mathematical biology.

[20]  W. Sandholm.  Stochastic Evolutionary Game Dynamics : Foundations , Deterministic Approximation , and Equilibrium Selection , 2010 .

[21]  W. Sandholm,et al.  Large Deviations and Stochastic Stability in the Small Noise Double Limit, I: Theory , 2014 .

[22]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[23]  Heinz Georg Schuster,et al.  Reviews of nonlinear dynamics and complexity , 2008 .

[24]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[25]  John Wakeley,et al.  Modeling Multiallelic Selection Using a Moran Model , 2009, Genetics.

[26]  W. Sandholm,et al.  Large deviations and stochastic stability in the small noise double limit , 2016 .

[27]  A. W. F. Edwards,et al.  The statistical processes of evolutionary theory , 1963 .

[28]  James P. Crutchfield,et al.  Stability and diversity in collective adaptation , 2004, nlin/0408039.

[29]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[30]  M. Nowak,et al.  A symmetry of fixation times in evoultionary dynamics. , 2006, Journal of theoretical biology.

[31]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[32]  William H. Sandholm.  Stochastic imitative game dynamics with committed agents , 2012, J. Econ. Theory.

[33]  Erwin Frey,et al.  Evolutionary game theory in growing populations. , 2010, Physical review letters.

[34]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[35]  Martin A Nowak,et al.  Multi-player games on the cycle. , 2012, Journal of theoretical biology.

[36]  W. Ewens.  Mathematical Population Genetics : I. Theoretical Introduction , 2004 .

[37]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[38]  P. Taylor,et al.  Fitness and evolutionary stability in game theoretic models of finite populations , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[39]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[40]  A. Hastings,et al.  Multivariate Moran process with Lotka-Volterra phenomenology. , 2011, Physical review letters.

[41]  Franziska Wulf,et al.  Mathematical Population Genetics , 2016 .

[42]  William H. Sandholm,et al.  Excess payoff dynamics and other well-behaved evolutionary dynamics , 2005, J. Econ. Theory.

[43]  Arne Traulsen,et al.  Coevolutionary dynamics in large, but finite populations. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[45]  Kshitij Khare,et al.  RATES OF CONVERGENCE OF SOME MULTIVARIATE MARKOV CHAINS WITH POLYNOMIAL EIGENFUNCTIONS , 2009, 0906.4242.

[46]  Erwin Frey,et al.  Entropy production of cyclic population dynamics. , 2010, Physical review letters.

[47]  K. Khare,et al.  Convergence analysis of some multivariate Markov chains using stochastic monotonicity , 2013, 1302.5606.

[48]  Abdolreza Sayyareh,et al.  A New Upper Bound for Kullback-Leibler Divergence , 2011 .

[49]  H. Qian,et al.  Fixation, transient landscape, and diffusion dilemma in stochastic evolutionary game dynamics. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  Marc Harper,et al.  Lyapunov Functions for Time-Scale Dynamics on Riemannian Geometries of the Simplex , 2015, Dyn. Games Appl..

[51]  T. Huillet.  On Discrete-Time Multiallelic Evolutionary Dynamics Driven by Selection , 2010 .

[52]  J. Hofbauer,et al.  Adaptive dynamics and evolutionary stability , 1990 .

[53]  William H. Sandholm,et al.  The projection dynamic and the replicator dynamic , 2008, Games Econ. Behav..

[54]  C. Shalizi.  Dynamics of Bayesian Updating with Dependent Data and Misspecified Models , 2009, 0901.1342.

[55]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations with strong selection and weak mutation. , 2006, Theoretical population biology.

[56]  Martin A Nowak,et al.  Evolutionary graph theory: breaking the symmetry between interaction and replacement. , 2007, Journal of theoretical biology.

[57]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[58]  Marc Harper,et al.  Inferring Fitness in Finite, Variably-sized, and Dynamically-structured Populations , 2013, ArXiv.

[59]  Dashiell E. A. Fryer.  On the Existence of General Equilibrium in Finite Games and General Game Dynamics , 2012, ArXiv.

[60]  Immanuel M. Bomze,et al.  Lotka-Volterra equation and replicator dynamics: new issues in classification , 1995, Biological Cybernetics.

[61]  Martin A Nowak,et al.  Evolutionary games on cycles , 2006, Proceedings of the Royal Society B: Biological Sciences.

[62]  I. Bomze.  Lotka-Volterra equation and replicator dynamics: A two-dimensional classification , 1983, Biological Cybernetics.

[63]  L. Imhof,et al.  Stochasticity and evolutionary stability. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[64]  Marc Harper,et al.  Escort Evolutionary Game Theory , 2009, ArXiv.

[65]  F. A. Chalub,et al.  The frequency-dependent Wright–Fisher model: diffusive and non-diffusive approximations , 2011, Journal of mathematical biology.

[66]  I. Bomze.  Cross entropy minimization in uninvadable states of complex populations , 1991 .

[67]  W. Ewens.  Mathematical Population Genetics , 1980 .

[68]  H. Ohtsuki,et al.  Mutation-selection equilibrium in games with multiple strategies. , 2008, Journal of theoretical biology.

[69]  Marc Harper,et al.  Inferring Fitness in Finite Populations with Moran-like dynamics , 2013, 1303.4566.

[70]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[71]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[72]  Corina E. Tarnita,et al.  Measures of success in a class of evolutionary models with fixed population size and structure , 2014, Journal of mathematical biology.

[73]  M. Nowak.  Evolutionary Dynamics: Exploring the Equations of Life , 2006 .

[74]  I. Mazin,et al.  Theory , 1934 .

[75]  Chaitanya S. Gokhale,et al.  Strategy abundance in evolutionary many-player games with multiple strategies. , 2011, Journal of theoretical biology.

[76]  A. Traulsen,et al.  Non-Gaussian fluctuations arising from finite populations: Exact results for the evolutionary Moran process. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[77]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations , 2004, Bulletin of mathematical biology.

[78]  Marc Harper,et al.  Incentive Processes in Finite Populations , 2013, 1306.2389.

[79]  A. Plastino,et al.  The workings of the maximum entropy principle in collective human behaviour , 2012, Journal of The Royal Society Interface.

[80]  Chaitanya S. Gokhale,et al.  Dynamic Properties of Evolutionary Multi-player Games in Finite Populations , 2013, Games.

[81]  Arne Traulsen,et al.  Correction: The Structure of Mutations and the Evolution of Cooperation , 2012, PLoS ONE.

[82]  D. M. V. Hesteren.  Evolutionary Game Theory , 2017 .

[83]  S. Shahshahani,et al.  A New Mathematical Framework for the Study of Linkage and Selection , 1979 .

[84]  R. Cressman.  Evolutionary Dynamics and Extensive Form Games , 2003 .