Deconstructing Evolutionary Game Theory: Coevolution of Social Behaviors with Their Evolutionary Setting*

Evolution of social behaviors is one of the most fascinating and active fields of evolutionary biology. During the past half century, social evolution theory developed into a mature field with powerful tools to understand the dynamics of social traits such as cooperation under a wide range of conditions. In this article, I argue that the next stage in the development of social evolution theory should consider the evolution of the setting in which social behaviors evolve. To that end, I propose a conceptual map of the components that make up the evolutionary setting of social behaviors, review existing work that considers the evolution of each component, and discuss potential future directions. The theoretical work reviewed here illustrates how unexpected dynamics can happen when the setting of social evolution itself is evolving, such as cooperation sometimes being self-limiting. I argue that a theory of how the setting of social evolution itself evolves will lead to a deeper understanding of when cooperation and other social behaviors evolve and diversify.

[1]  Erol Akçay,et al.  The evolution of payoff matrices: providing incentives to cooperate , 2011, Proceedings of the Royal Society B: Biological Sciences.

[2]  A Kacelnik,et al.  The evolution of begging: signaling and sibling competition. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[3]  F. Rousset Genetic Structure and Selection in Subdivided Populations (MPB-40) , 2004 .

[4]  K. Laland,et al.  Cause and Effect in Biology Revisited: Is Mayr's Proximate-ultimate , 2011 .

[5]  T. Clutton‐Brock,et al.  Cooperative breeding and monogamy in mammalian societies , 2012, Proceedings of the Royal Society B: Biological Sciences.

[6]  Magnus Enquist,et al.  Neural networks and animal behavior , 2005 .

[7]  R. Johnstone,et al.  Negotiation over Offspring Care—how Should Parents Respond to Each Other's Efforts? , 2006 .

[8]  Peter D. Taylor,et al.  Inclusive fitness in a homogeneous environment , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[9]  A. J. Moore,et al.  INTERACTING PHENOTYPES AND THE EVOLUTIONARY PROCESS: I. DIRECT AND INDIRECT GENETIC EFFECTS OF SOCIAL INTERACTIONS , 1997, Evolution; international journal of organic evolution.

[10]  M. Feldman,et al.  A theory for the evolution of other-regard integrating proximate and ultimate perspectives , 2009, Proceedings of the National Academy of Sciences.

[11]  B. Kerr,et al.  Local migration promotes competitive restraint in a host–pathogen 'tragedy of the commons' , 2006, Nature.

[12]  M. Nowak,et al.  Evolution of cooperation in stochastic games , 2018, Nature.

[13]  Ronald Noë,et al.  A veto game played by baboons: a challenge to the use of the Prisoner's Dilemma as a paradigm for reciprocity and cooperation , 1990, Animal Behaviour.

[14]  J. Bull,et al.  Distinguishing mechanisms for the evolution of co-operation. , 1991, Journal of theoretical biology.

[15]  L. Lehmann,et al.  Natural Selection on Fecundity Variance in Subdivided Populations: Kin Selection Meets Bet Hedging , 2007, Genetics.

[16]  A. Houston,et al.  Is it better to give information, receive it, or be ignorant in a two-player game? , 2006 .

[17]  H. Godfray Signaling of Need between Parents and Young: Parent-Offspring Conflict and Sibling Rivalry , 1995, The American Naturalist.

[18]  Hanna Kokko,et al.  Models of social evolution: can we do better to predict ‘who helps whom to achieve what’? , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  J. Koella,et al.  The spatial spread of altruism versus the evolutionary response of egoists , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  C. Hauert,et al.  Social evolution in structured populations , 2014, Nature Communications.

[21]  S. Gandon,et al.  Habitat saturation and the spatial evolutionary ecology of altruism , 2009, Journal of evolutionary biology.

[22]  N. Tinbergen On aims and methods of Ethology , 2010 .

[23]  Laurent Lehmann,et al.  Synergy, partner choice and frequency dependence: their integration into inclusive fitness theory and their interpretation in terms of direct and indirect fitness effects , 2006 .

[24]  David McFarland,et al.  Defining motivation and cognition in animals , 1991 .

[25]  G. Brady Governing the Commons: The Evolution of Institutions for Collective Action , 1993 .

[26]  R. Johnstone Signaling of need, sibling competition, and the cost of honesty. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[27]  John M McNamara,et al.  Towards a richer evolutionary game theory , 2013, Journal of The Royal Society Interface.

[28]  L. Giraldeau,et al.  Exposing the behavioral gambit: the evolution of learning and decision rules , 2013 .

[29]  Mike Boots,et al.  Are parasites “prudent” in space? , 2010, Ecology letters.

[30]  Laurent Lehmann,et al.  How life history and demography promote or inhibit the evolution of helping behaviours , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  Alan H. Krakauer,et al.  Kin selection and cooperative courtship in wild turkeys , 2005, Nature.

[32]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[33]  A. Houston,et al.  The coevolution of choosiness and cooperation , 2008, Nature.

[34]  J. André,et al.  Perfect reciprocity is the only evolutionarily stable strategy in the continuous iterated prisoner's dilemma. , 2007, Journal of theoretical biology.

[35]  Tina W. Wey,et al.  Social network analysis of animal behaviour: a promising tool for the study of sociality , 2008, Animal Behaviour.

[36]  J. McNamara,et al.  The evolution of cooperation by negotiation in a noisy world , 2017, Journal of evolutionary biology.

[37]  Noldeke,et al.  How costly is the honest signaling of need? , 1999, Journal of theoretical biology.

[38]  M. West-Eberhard Phenotypic Plasticity and the Origins of Diversity , 1989 .

[39]  Maja Schlüter,et al.  The Survival of the Conformist: Social Pressure and Renewable Resource Management , 2010, Journal of theoretical biology.

[40]  A. J. Moore,et al.  INTERACTING PHENOTYPES AND THE EVOLUTIONARY PROCESS. III. SOCIAL EVOLUTION , 2010, Evolution; international journal of organic evolution.

[41]  S. Dridi,et al.  Learning to cooperate: The evolution of social rewards in repeated interactions , 2016, bioRxiv.

[42]  M. Enquist,et al.  Instability of signaling resolution models of parent-offspring conflict. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[43]  K. Parvinen,et al.  Joint evolution of altruistic cooperation and dispersal in a metapopulation of small local populations. , 2013, Theoretical population biology.

[44]  M. Feldman,et al.  Genetic and Cultural Inheritance of Continuous Traits , 1995 .

[45]  B. Charlesworth,et al.  Some models of the evolution of altruistic behaviour between siblings. , 1978, Journal of theoretical biology.

[46]  Barry R. Weingast,et al.  Biological Institutions: The Political Science of Animal Cooperation , 2013 .

[47]  Steven A. Frank,et al.  All of life is social , 2007, Current Biology.

[48]  Laurent Lehmann,et al.  The co-evolution of culturally inherited altruistic helping and cultural transmission under random group formation. , 2008, Theoretical population biology.

[49]  Robert M. May,et al.  Dispersal in stable habitats , 1977, Nature.

[50]  R. Myerson Incentive Compatibility and the Bargaining Problem , 1979 .

[51]  Dalton W. Chaffee,et al.  SEXUAL IMPRINTING: WHAT STRATEGIES SHOULD WE EXPECT TO SEE IN NATURE? , 2013, Evolution; international journal of organic evolution.

[52]  M J Wade,et al.  "Runaway" social evolution: reinforcing selection for inbreeding and altruism. , 1991, Journal of theoretical biology.

[53]  Andy Gardner,et al.  The Relation between Multilocus Population Genetics and Social Evolution Theory , 2006, The American Naturalist.

[54]  Joshua B. Plotkin,et al.  The Evolvability of Cooperation under Local and Non-Local Mutations , 2015, Games.

[55]  S. West,et al.  Host sanctions and the legume–rhizobium mutualism , 2003, Nature.

[56]  Richard McElreath,et al.  Increased Costs of Cooperation Help Cooperators in the Long Run , 2013, The American Naturalist.

[57]  Robert Boyd,et al.  Group beneficial norms can spread rapidly in a structured population. , 2002, Journal of theoretical biology.

[58]  David Sloan Wilson,et al.  ALTRUISM IN MENDELIAN POPULATIONS DERIVED FROM SIBLING GROUPS: THE HAYSTACK MODEL REVISITED , 1987, Evolution; international journal of organic evolution.

[59]  Arne Traulsen,et al.  Emergence of stable polymorphisms driven by evolutionary games between mutants , 2012, Nature Communications.

[60]  Ugne Klibaite,et al.  An unsupervised method for quantifying the behavior of paired animals , 2016, Physical biology.

[61]  Hanna Kokko,et al.  The tragedy of the commons in evolutionary biology. , 2007, Trends in ecology & evolution.

[62]  S. Dridi,et al.  A model for the evolution of reinforcement learning in fluctuating games , 2015, Animal Behaviour.

[63]  H. Klug,et al.  THE EVOLUTION OF SOCIAL INTERACTIONS CHANGES PREDICTIONS ABOUT INTERACTING PHENOTYPES , 2012, Evolution; international journal of organic evolution.

[64]  M. Feldman,et al.  The Co-evolution of Individual Behaviors and Social Institutions , 2022 .

[65]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[66]  Laurent Lehmann,et al.  THE ADAPTIVE DYNAMICS OF NICHE CONSTRUCTING TRAITS IN SPATIALLY SUBDIVIDED POPULATIONS: EVOLVING POSTHUMOUS EXTENDED PHENOTYPES , 2008, Evolution; international journal of organic evolution.

[67]  A. Griffin,et al.  Social semantics : altruism , cooperation , mutualism , strong reciprocity and group selection , 2007 .

[68]  Jorge Peña,et al.  Environmentally Mediated Social Dilemmas. , 2019, Trends in ecology & evolution.

[69]  Jeremy Van Cleve,et al.  Behavioral Responses in Structured Populations Pave the Way to Group Optimality* , 2011, The American Naturalist.

[70]  F. Rousset,et al.  Multilocus models in the infinite island model of population structure. , 2008, Theoretical population biology.

[71]  Cecilia Wong Extended Heredity: A New Understanding of Inheritance and Evolution , 2019, Leonardo.

[72]  J. Saltz,et al.  What, if anything, is a social niche? , 2016, Evolutionary Ecology.

[73]  K. Laland,et al.  More on how and why: cause and effect in biology revisited , 2013 .

[74]  Jeremy Van Cleve Cooperation, conformity, and the coevolutionary problem of trait associations. , 2016, Journal of theoretical biology.

[75]  M. Baalen,et al.  The Unit of Selection in Viscous Populations and the Evolution of Altruism. , 1998, Journal of theoretical biology.

[76]  L. Lehmann,et al.  Is Sociality Driven by the Costs of Dispersal or the Benefits of Philopatry? A Role for Kin‐Discrimination Mechanisms , 2001, The American Naturalist.

[77]  E. Simms,et al.  An empirical test of partner choice mechanisms in a wild legume–rhizobium interaction , 2006, Proceedings of the Royal Society B: Biological Sciences.

[78]  M. Wade,et al.  ORIGINS OF ALTRUISM DIVERSITY II: RUNAWAY COEVOLUTION OF ALTRUISTIC STRATEGIES VIA “RECIPROCAL NICHE CONSTRUCTION” , 2012, Evolution; international journal of organic evolution.

[79]  Alasdair I Houston,et al.  Incorporating rules for responding into evolutionary games , 1999, Nature.

[80]  Andrew Whiten,et al.  Cultural Evolution in Animals , 2019, Annual Review of Ecology, Evolution, and Systematics.

[81]  M. Nowak,et al.  Prosperity is associated with instability in dynamical networks. , 2011, Journal of theoretical biology.

[82]  Erol Akçay,et al.  Evolutionary games with environmental feedbacks , 2018, Nature Communications.

[83]  J. Gore,et al.  Feedback between Population and Evolutionary Dynamics Determines the Fate of Social Microbial Populations , 2013, PLoS biology.

[84]  Sam P. Brown,et al.  An oscillating tragedy of the commons in replicator dynamics with game-environment feedback , 2016, Proceedings of the National Academy of Sciences.

[85]  A. Houston,et al.  Integrating function and mechanism. , 2009, Trends in ecology & evolution.

[86]  T. Day,et al.  A Unified Approach to the Evolutionary Consequences of Genetic and Nongenetic Inheritance , 2011, The American Naturalist.

[87]  Stuart A. West,et al.  Promiscuity and the evolutionary transition to complex societies , 2010, Nature.

[88]  Rajiv Sethi,et al.  The Evolution of Social Norms in Common Property Resource Use , 1996 .

[89]  L M Wahl,et al.  The Continuous Prisoner:s Dilemma: I. Linear Reactive Strategies , 1999 .

[90]  G. Holton Sociobiology: the new synthesis? , 1977, Newsletter on science, technology & human values.

[91]  Luke McNally,et al.  Cooperation and the evolution of intelligence , 2012, Proceedings of the Royal Society B: Biological Sciences.

[92]  W. Hamilton,et al.  Altruism and Related Phenomena, Mainly in Social Insects , 1972 .

[93]  David G. Rand,et al.  Cyclical Population Dynamics of Automatic Versus Controlled Processing: An Evolutionary Pendulum , 2017, Psychological review.

[94]  J. Saltz,et al.  Natural Genetic Variation in Social Niche Construction: Social Effects of Aggression Drive Disruptive Sexual Selection in Drosophila melanogaster , 2011, The American Naturalist.

[95]  C. Hauert,et al.  Evolutionary games and population dynamics: maintenance of cooperation in public goods games , 2006, Proceedings of the Royal Society B: Biological Sciences.

[96]  Steven D. Prager,et al.  The dynamics of animal social networks: analytical, conceptual, and theoretical advances , 2014 .

[97]  R. Aharonov,et al.  Microbes can help explain the evolution of host altruism , 2017, Nature Communications.

[98]  S. Levin,et al.  Maintaining cooperation in social-ecological systems: , 2017, Theoretical Ecology.

[99]  Leticia Avilés,et al.  Solving the freeloaders paradox: Genetic associations and frequency-dependent selection in the evolution of cooperation among nonrelatives , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[100]  Michael E Hochberg,et al.  The coevolution of cooperation and dispersal in social groups and its implications for the emergence of multicellularity , 2008, BMC Evolutionary Biology.

[101]  R. Bshary,et al.  Game Structures in Mutualistic Interactions: What Can the Evidence Tell Us About the Kind of Models We Need? , 2004 .

[102]  M. Satterthwaite,et al.  Efficient Mechanisms for Bilateral Trading , 1983 .

[103]  Troy Day,et al.  Stability in negotiation games and the emergence of cooperation† , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[104]  G. Parker,et al.  Clutch size, fecundity and parent-offspring conflict , 1991 .

[105]  J. Purcell,et al.  Co-evolution between sociality and dispersal: the role of synergistic cooperative benefits. , 2012, Journal of theoretical biology.

[106]  L. Keller,et al.  Social polymorphism is favoured by the co-evolution of dispersal with social behaviour , 2017, Nature Ecology & Evolution.

[107]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[108]  Erol Akçay,et al.  Reproductive Social Behavior: Cooperative Games to Replace Sexual Selection , 2006, Science.

[109]  T. Day,et al.  Nongenetic Inheritance and Its Evolutionary Implications , 2009 .

[110]  J. Stamps Why Evolutionary Issues are Reviving Interest in Proximate Behavioral Mechanisms , 1991 .

[111]  Marcus W. Feldman,et al.  The Evolution of Helping Behavior in Large, Randomly Mixed Populations , 1986, American Naturalist.

[112]  P. Taylor,et al.  Modelling information exchange in worker–queen conflict over sex allocation , 2005, Proceedings of the Royal Society B: Biological Sciences.

[113]  S. Levin,et al.  Evolutionary escape from the prisoner's dilemma. , 2007, Journal of theoretical biology.

[114]  D J McFarland,et al.  The behavioural final common path. , 1975, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[115]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[116]  S. Vehrencamp Optimal Degree of Skew in Cooperative Societies , 1983 .

[117]  A. Grafen Natural selection, kin selection and group selection [Polistes fuscatus, wasps] , 1984 .

[118]  J. André Contingency in the Evolutionary Emergence of Reciprocal Cooperation , 2015, The American Naturalist.

[119]  Mark Kirkpatrick,et al.  The Evolution of Mate Choice Copying by Indirect Selection , 1996, The American Naturalist.

[120]  Madeleine Beekman,et al.  Ancestral Monogamy Shows Kin Selection Is Key to the Evolution of Eusociality , 2008, Science.

[121]  M. Doebeli,et al.  The evolution of interspecific mutualisms. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[122]  F. Rousset,et al.  POPULATION DEMOGRAPHY AND THE EVOLUTION OF HELPING BEHAVIORS , 2006, Evolution; international journal of organic evolution.

[123]  Ulf Dieckmann,et al.  Adaptive Evolution of Social Traits: Origin, Trajectories, and Correlations of Altruism and Mobility , 2004, The American Naturalist.

[124]  H. Ohtsuki,et al.  Strategy selection in structured populations. , 2009, Journal of theoretical biology.

[125]  M. Nowak,et al.  Evolutionary dynamics in structured populations , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[126]  Richard A. Watson,et al.  THE CONCURRENT EVOLUTION OF COOPERATION AND THE POPULATION STRUCTURES THAT SUPPORT IT , 2011, Evolution; international journal of organic evolution.

[127]  T. Uller,et al.  The Price equation and extended inheritance , 2010 .

[128]  G. B. Pollock,et al.  Can altruism evolve in purely viscous populations? , 1992, Evolutionary Ecology.

[129]  Alex Mesoudi,et al.  Beyond DNA: integrating inclusive inheritance into an extended theory of evolution , 2011, Nature Reviews Genetics.

[130]  Rousset,et al.  A theoretical basis for measures of kin selection in subdivided populations: finite populations and localized dispersal , 2000 .

[131]  M. Feldman,et al.  Cultural transmission and evolution: a quantitative approach. , 1981, Monographs in population biology.

[132]  Jeremy Van Cleve,et al.  Pathways to social evolution: reciprocity, relatedness, and synergy , 2012, bioRxiv.

[133]  J. Bever,et al.  Kin competition and the evolution of cooperation. , 2009, Trends in ecology & evolution.

[134]  M. Servedio,et al.  Evolution of Mate-Choice Imprinting: Competing Strategies , 2008, Evolution; international journal of organic evolution.

[135]  D. Réale,et al.  Social niche specialization under constraints: personality, social interactions and environmental heterogeneity , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.