Evolutionary dynamics in structured populations

Evolutionary dynamics shape the living world around us. At the centre of every evolutionary process is a population of reproducing individuals. The structure of that population affects evolutionary dynamics. The individuals can be molecules, cells, viruses, multicellular organisms or humans. Whenever the fitness of individuals depends on the relative abundance of phenotypes in the population, we are in the realm of evolutionary game theory. Evolutionary game theory is a general approach that can describe the competition of species in an ecosystem, the interaction between hosts and parasites, between viruses and cells, and also the spread of ideas and behaviours in the human population. In this perspective, we review the recent advances in evolutionary game dynamics with a particular emphasis on stochastic approaches in finite sized and structured populations. We give simple, fundamental laws that determine how natural selection chooses between competing strategies. We study the well-mixed population, evolutionary graph theory, games in phenotype space and evolutionary set theory. We apply these results to the evolution of cooperation. The mechanism that leads to the evolution of cooperation in these settings could be called ‘spatial selection’: cooperators prevail against defectors by clustering in physical or other spaces.

[1]  M. Dufwenberg Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[2]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[3]  Christine Taylor,et al.  Evolutionary Games , 2010 .

[4]  H. Ohtsuki,et al.  Strategy selection in structured populations. , 2009, Journal of theoretical biology.

[5]  Martin A. Nowak,et al.  Evolution of cooperation by phenotypic similarity , 2008, Proceedings of the National Academy of Sciences.

[6]  Martin A Nowak,et al.  Evolutionary dynamics in set structured populations , 2009, Proceedings of the National Academy of Sciences.

[7]  Long Wang,et al.  Evolutionary dynamics on graphs: Efficient method for weak selection. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  H. Ohtsuki,et al.  Mutation-selection equilibrium in games with multiple strategies. , 2008, Journal of theoretical biology.

[9]  Arne Traulsen,et al.  Strategy abundance in 2x2 games for arbitrary mutation rates. , 2008, Journal of theoretical biology.

[10]  Matthijs van Veelen,et al.  Group selection, kin selection, altruism and cooperation: when inclusive fitness is right and when it can be wrong. , 2009, Journal of theoretical biology.

[11]  M. Nowak,et al.  Mutation-selection equilibrium in games with mixed strategies. , 2009, Journal of theoretical biology.

[12]  Michael Doebeli,et al.  A simple and general explanation for the evolution of altruism , 2009, Proceedings of the Royal Society B: Biological Sciences.

[13]  Redouan Bshary,et al.  Pairs of cooperating cleaner fish provide better service quality than singletons , 2008, Nature.

[14]  Wenjian Yu,et al.  Migration as a Mechanism to Promote Cooperation , 2008, Adv. Complex Syst..

[15]  F. C. Santos,et al.  Social diversity promotes the emergence of cooperation in public goods games , 2008, Nature.

[16]  H. Ohtsuki,et al.  Evolutionary game dynamics in phenotype space , 2008, 0806.2636.

[17]  H. Ohtsuki,et al.  Evolutionary stability on graphs. , 2008, Journal of theoretical biology.

[18]  Martin A. Nowak,et al.  Analytical Results for Individual and Group Selection of Any Intensity , 2008, Bulletin of mathematical biology.

[19]  E. Wilson,et al.  One Giant Leap: How Insects Achieved Altruism and Colonial Life , 2008 .

[20]  Troy Day,et al.  From inclusive fitness to fixation probability in homogeneous structured populations. , 2007, Journal of theoretical biology.

[21]  D. Sumpter,et al.  The evolution of helping and harming on graphs: the return of the inclusive fitness effect , 2007, Journal of evolutionary biology.

[22]  M. Nowak,et al.  TRANSFORMING THE DILEMMA , 2007, Evolution; international journal of organic evolution.

[23]  A. Griffin,et al.  Evolutionary Explanations for Cooperation , 2007, Current Biology.

[24]  Arne Traulsen,et al.  The different limits of weak selection and the evolutionary dynamics of finite populations. , 2007, Journal of theoretical biology.

[25]  C. Hauert,et al.  Via Freedom to Coercion: The Emergence of Costly Punishment , 2007, Science.

[26]  Martin A Nowak,et al.  Evolutionary graph theory: breaking the symmetry between interaction and replacement. , 2007, Journal of theoretical biology.

[27]  H. Reeve,et al.  The emergence of a superorganism through intergroup competition , 2007, Proceedings of the National Academy of Sciences.

[28]  Peter D. Taylor,et al.  Evolution of cooperation in a finite homogeneous graph , 2007, Nature.

[29]  Martin A. Nowak,et al.  Chromodynamics of Cooperation in Finite Populations , 2007, PloS one.

[30]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[31]  Arne Traulsen,et al.  Coevolution of strategy and structure in complex networks with dynamical linking. , 2006, Physical review letters.

[32]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[33]  H. Ohtsuki,et al.  The replicator equation on graphs. , 2006, Journal of theoretical biology.

[34]  J. Fletcher,et al.  What's wrong with inclusive fitness? , 2006, Trends in ecology & evolution.

[35]  Martin A Nowak,et al.  Evolutionary games on cycles , 2006, Proceedings of the Royal Society B: Biological Sciences.

[36]  L. Keller,et al.  The evolution of cooperation and altruism – a general framework and a classification of models , 2006, Journal of evolutionary biology.

[37]  M. Nowak,et al.  Evolution of cooperation by multilevel selection. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[38]  T. Killingback,et al.  Evolution in group-structured populations can resolve the tragedy of the commons , 2006, Proceedings of the Royal Society B: Biological Sciences.

[39]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[40]  V. Jansen,et al.  Altruism through beard chromodynamics , 2006, Nature.

[41]  Alan Grafen,et al.  Optimization of inclusive fitness. , 2006, Journal of theoretical biology.

[42]  K. Foster,et al.  Kin selection is the key to altruism. , 2006, Trends in ecology & evolution.

[43]  E. Wilson,et al.  Eusociality: origin and consequences. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Edward O. Wilson,et al.  Kin Selection as the Key to Altruism: Its Rise and Fall , 2005, Social Research: An International Quarterly.

[45]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[46]  P. Taylor Altruism in viscous populations — an inclusive fitness model , 1992, Evolutionary Ecology.

[47]  Y. Iwasa,et al.  The evolution of altruism by costly punishment in lattice-structured populations: score-dependent viability versus score-dependent fertility , 2005 .

[48]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations , 2004, Bulletin of mathematical biology.

[49]  Martin Zwick,et al.  Strong altruism can evolve in randomly formed groups. , 2004, Journal of theoretical biology.

[50]  A. Traulsen,et al.  Similarity-based cooperation and spatial segregation. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.

[52]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[53]  M. Higashi,et al.  Evolution of mutualism through spatial effects. , 2004, Journal of theoretical biology.

[54]  M. Nowak,et al.  Evolutionary Dynamics of Biological Games , 2004, Science.

[55]  F. Rousset Genetic Structure and Selection in Subdivided Populations (MPB-40) , 2004 .

[56]  Peter Schuster,et al.  A principle of natural self-organization , 1977, Naturwissenschaften.

[57]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[58]  M. Eigen,et al.  The Hypercycle , 2004, Naturwissenschaften.

[59]  R. Cressman Evolutionary Dynamics and Extensive Form Games , 2003 .

[60]  Benjamin Kerr,et al.  Individualist and Multi-level Perspectives on Selection in Structured Populations , 2002 .

[61]  Johan Paulsson,et al.  Multileveled selection on plasmid replication. , 2002, Genetics.

[62]  M. Feldman,et al.  Local dispersal promotes biodiversity in a real-life game of rock–paper–scissors , 2002, Nature.

[63]  P. Niyogi,et al.  Computational and evolutionary aspects of language , 2002, Nature.

[64]  C. Hauert,et al.  Volunteering as Red Queen Mechanism for Cooperation in Public Goods Games , 2002, Science.

[65]  Robert Boyd,et al.  Group beneficial norms can spread rapidly in a structured population. , 2002, Journal of theoretical biology.

[66]  V. Hutson,et al.  Backward and forward travelling waves in evolutionary games , 2002 .

[67]  R. Riolo,et al.  Evolution of cooperation without reciprocity , 2001, Nature.

[68]  Raymond J. O'Connor,et al.  Models of Adaptive Behaviour: An Approach Based on State. , 2001 .

[69]  S. Bonhoeffer,et al.  Cooperation and Competition in the Evolution of ATP-Producing Pathways , 2001, Science.

[70]  P. Taylor,et al.  Inclusive Fitness in Finite Deme-structured and Stepping-stone Populations , 2001 .

[71]  Rousset,et al.  A theoretical basis for measures of kin selection in subdivided populations: finite populations and localized dispersal , 2000 .

[72]  P. Bednekoff Models of Adaptive Behaviour: An Approach based on State , 2000, Animal Behaviour.

[73]  G. Szabó,et al.  Spatial evolutionary prisoner's dilemma game with three strategies and external constraints , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[74]  Alasdair I Houston,et al.  Incorporating rules for responding into evolutionary games , 1999, Nature.

[75]  Paul E. Turner,et al.  Prisoner's dilemma in an RNA virus , 1999, Nature.

[76]  S. Siller Foundations of Social Evolution , 1999, Heredity.

[77]  R. Michod Darwinian Dynamics: Evolutionary Transitions in Fitness and Individuality , 1999 .

[78]  Josef Hofbauer,et al.  The spatially dominant equilibrium of a game , 1999, Ann. Oper. Res..

[79]  Y. Iwasa,et al.  Score-dependent fertility model for the evolution of cooperation in a lattice. , 1998, Journal of theoretical biology.

[80]  M. Baalen,et al.  The Unit of Selection in Viscous Populations and the Evolution of Altruism. , 1998, Journal of theoretical biology.

[81]  M. Doebeli,et al.  The evolution of interspecific mutualisms. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[82]  G. Szabó,et al.  Evolutionary prisoner's dilemma game on a square lattice , 1997, cond-mat/9710096.

[83]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[84]  Peter Kareiva,et al.  Spatial ecology : the role of space in population dynamics and interspecific interactions , 1998 .

[85]  C. Goodnight,et al.  Experimental Studies of Group Selection: What Do They Tell US About Group Selection in Nature? , 1997, The American Naturalist.

[86]  L. Samuelson Evolutionary Games and Equilibrium Selection , 1997 .

[87]  M. Doebeli,et al.  Spatial evolutionary game theory: Hawks and Doves revisited , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[88]  Richard E. Michod,et al.  The Evolution of Cooperation in Spatially Heterogeneous Populations , 1996, The American Naturalist.

[89]  M N,et al.  The Evolution of Cooperation in a Lattice-Structured Population , 1996 .

[90]  Martin A. Nowak,et al.  Antigenic oscillations and shifting immunodominance in HIV-1 infections , 1995, Nature.

[91]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[92]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[93]  R. Durrett,et al.  The Importance of Being Discrete (and Spatial) , 1994 .

[94]  Martin A. Nowak,et al.  Mutation and the evolution of virulence , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[95]  K. Lindgren,et al.  Evolutionary dynamics of spatial games , 1994 .

[96]  A V Herz,et al.  Collective phenomena in spatially extended evolutionary games. , 1994, Journal of theoretical biology.

[97]  Robert M. May,et al.  Species coexistence and self-organizing spatial dynamics , 1994, Nature.

[98]  Simon A. Levin,et al.  Stochastic Spatial Models: A User's Guide to Ecological Applications , 1994 .

[99]  Martin A. Nowak,et al.  Superinfection and the evolution of parasite virulence , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[100]  M A Nowak,et al.  Superinfection and the evolution of parasite virulence. , 1994, Proceedings. Biological sciences.

[101]  Glenn Ellison Learning, Local Interaction, and Coordination , 1993 .

[102]  M. Nowak,et al.  THE SPATIAL DILEMMAS OF EVOLUTION , 1993 .

[103]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .

[104]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[105]  Peter D. Taylor,et al.  Inclusive fitness in a homogeneous environment , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[106]  M. Nowak,et al.  The evolution of stochastic strategies in the Prisoner's Dilemma , 1990 .

[107]  C. Goodnight,et al.  EXPERIMENTAL STUDIES OF COMMUNITY EVOLUTION II: THE ECOLOGICAL BASIS OF THE RESPONSE TO COMMUNITY SELECTION , 1990, Evolution; international journal of organic evolution.

[108]  Charles J Goodnight,et al.  EXPERIMENTAL STUDIES OF COMMUNITY EVOLUTION I: THE RESPONSE TO SELECTION AT THE COMMUNITY LEVEL , 1990, Evolution; international journal of organic evolution.

[109]  P. Richerson,et al.  The evolution of indirect reciprocity , 1989 .

[110]  John C. Harsanyi,et al.  Общая теория выбора равновесия в играх / A General Theory of Equilibrium Selection in Games , 1989 .

[111]  Josef Hofbauer,et al.  The theory of evolution and dynamical systems , 1988 .

[112]  E. Szathmáry,et al.  Group selection of early replicators and the origin of life. , 1987, Journal of theoretical biology.

[113]  R. May More evolution of cooperation , 1987, Nature.

[114]  M. Milinski TIT FOR TAT in sticklebacks and the evolution of cooperation , 1987, Nature.

[115]  Alan Grafen,et al.  A geometric view of relatedness , 1985 .

[116]  D. Wilson THE GROUP SELECTION CONTROVERSY: History and Current Status , 1983 .

[117]  R M May,et al.  Epidemiology and genetics in the coevolution of parasites and hosts , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[118]  E. Leigh When does the good of the group override the advantage of the individual? , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[119]  The evolution of altruism , 1983 .

[120]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[121]  J. Seger,et al.  Kinship and covariance. , 1981, Journal of theoretical biology.

[122]  S. Levin,et al.  Selection of Intermediate Rates of Increase in Parasite-Host Systems , 1981, The American Naturalist.

[123]  E. C. Zeeman,et al.  Population dynamics from game theory , 1980 .

[124]  K Sigmund,et al.  A note on evolutionary stable strategies and game dynamics. , 1979, Journal of theoretical biology.

[125]  M. Uyenoyama Evolution of altruism under group selection in large and small populations in fluctuating environments , 1979 .

[126]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[127]  Michael J. Wade,et al.  A Critical Review of the Models of Group Selection , 1978, The Quarterly Review of Biology.

[128]  R. May,et al.  Stability and Complexity in Model Ecosystems , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[129]  M. Eigen,et al.  The hypercycle. A principle of natural self-organization. Part A: Emergence of the hypercycle. , 1977, Die Naturwissenschaften.

[130]  M. Wade,et al.  AN EXPERIMENTAL STUDY OF GROUP SELECTION , 1977, Evolution; international journal of organic evolution.

[131]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[132]  R. May,et al.  Nonlinear Aspects of Competition Between Three Species , 1975 .

[133]  D. Wilson A theory of group selection. , 1975, Proceedings of the National Academy of Sciences of the United States of America.

[134]  R. Paine,et al.  Disturbance, patch formation, and community structure. , 1974, Proceedings of the National Academy of Sciences of the United States of America.

[135]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[136]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[137]  W. Hamilton The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[138]  V. Wynne-Edwards Animal dispersion in relation to social behaviour , 1962 .

[139]  P. A. P. Moran,et al.  Random processes in genetics , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[140]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[141]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.