Simple property of heterogeneous aspiration dynamics: Beyond weak selection

How individuals adapt their behavior in cultural evolution remains elusive. Theoretical studies have shown that the update rules chosen to model individual decision making can dramatically modify the evolutionary outcome of the population as a whole. This hints at the complexities of considering the personality of individuals in a population, where each one uses its own rule. Here, we investigate whether and how heterogeneity in the rules of behavior update alters the evolutionary outcome. We assume that individuals update behaviors by aspiration-based self-evaluation and they do so in their own ways. Under weak selection, we analytically reveal a simple property that holds for any two-strategy multiplayer games in well-mixed populations and on regular graphs: the evolutionary outcome in a population with heterogeneous update rules is the weighted average of the outcomes in the corresponding homogeneous populations, and the associated weights are the frequencies of each update rule in the heterogeneous population. Beyond weak selection, we show that this property holds for public goods games. Our finding implies that heterogeneous aspiration dynamics is additive. This additivity greatly reduces the complexity induced by the underlying individual heterogeneity. Our work thus provides an efficient method to calculate evolutionary outcomes under heterogeneous update rules.

[1]  Jochem Marotzke,et al.  The collective-risk social dilemma and the prevention of simulated dangerous climate change , 2008, Proceedings of the National Academy of Sciences.

[2]  Long Wang,et al.  Evolution of global cooperation driven by risks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  G. Szabó,et al.  Selection of dynamical rules in spatial Prisoner's Dilemma games , 2009, 0911.0661.

[4]  G. Szabó,et al.  Evolutionary prisoner's dilemma game on a square lattice , 1997, cond-mat/9710096.

[5]  Matjaz Perc,et al.  Evolutionary mixed games in structured populations: Cooperation and the benefits of heterogeneity , 2016, Physical review. E.

[6]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.

[7]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[8]  B. Galef,et al.  ‘Conformity’ in Norway rats? , 2008, Animal Behaviour.

[9]  Michael Doebeli,et al.  Consolidating Birth-Death and Death-Birth Processes in Structured Populations , 2013, PloS one.

[10]  R. Brown,et al.  Consideration of the origin of Herbert Simon's theory of “satisficing” (1933‐1947) , 2004 .

[11]  F. C. Santos,et al.  Climate policies under wealth inequality , 2014, Proceedings of the National Academy of Sciences.

[12]  Long Wang,et al.  Aspiration dynamics of multi-player games in finite populations , 2014, Journal of The Royal Society Interface.

[13]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[14]  M. Nowak,et al.  Evolutionary games on cycles with strong selection. , 2017, Physical review. E.

[15]  Lourdes Araujo,et al.  Social Experiments in the Mesoscale: Humans Playing a Spatial Prisoner's Dilemma , 2010, PloS one.

[16]  H. Ohtsuki,et al.  Mutation-selection equilibrium in games with multiple strategies. , 2008, Journal of theoretical biology.

[17]  Long Wang,et al.  Coevolution of nonlinear group interactions and strategies in well-mixed and structured populations. , 2018, Journal of theoretical biology.

[18]  M. Doebeli,et al.  Self-organized criticality in spatial evolutionary game theory. , 1998, Journal of theoretical biology.

[19]  G. Szabó,et al.  Phase diagrams for an evolutionary prisoner's dilemma game on two-dimensional lattices. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Lei Zhou,et al.  Supplementary Methods: Individualised aspiration dynamics: Calculation by proofs , 2018 .

[21]  Long Wang,et al.  Aspiration dynamics in structured population acts as if in a well-mixed one , 2015, Scientific Reports.

[22]  T. Groves,et al.  Optimal Allocation of Public Goods: A Solution to the 'Free Rider Problem' , 1977 .

[23]  Martin A Nowak,et al.  Evolutionary games on cycles , 2006, Proceedings of the Royal Society B: Biological Sciences.

[24]  Oliver Kirchkamp,et al.  Simultaneous Evolution of Learning Rules and Strategies , 1996 .

[25]  Clayton M. Hodges Bumble Bee Foraging: The Threshold Departure Rule , 1985 .

[26]  Arne Traulsen,et al.  Coevolutionary dynamics in large, but finite populations. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  H. Ohtsuki,et al.  Strategy selection in structured populations. , 2009, Journal of theoretical biology.

[28]  Long Wang,et al.  Evolutionary dynamics of synergistic and discounted group interactions in structured populations. , 2015, Journal of theoretical biology.

[29]  A. Sanchez,et al.  Co-evolution of strategies and update rules in the prisoner's dilemma game on complex networks , 2010, 1007.3626.

[30]  M. Nowak,et al.  Stochastic dynamics of invasion and fixation. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[32]  F. C. Santos,et al.  Climate change governance, cooperation and self-organization. , 2014, Physics of life reviews.

[33]  Franz J Weissing,et al.  Consistent individual differences in human social learning strategies , 2014, Nature Communications.

[34]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Darrell A. Worthy,et al.  Heterogeneity of strategy use in the Iowa gambling task: A comparison of win-stay/lose-shift and reinforcement learning models , 2013, Psychonomic bulletin & review.

[36]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[37]  Arne Traulsen,et al.  Extrapolating Weak Selection in Evolutionary Games , 2013, PLoS Comput. Biol..

[38]  W. Marsden I and J , 2012 .

[39]  Long Wang,et al.  Evolution of cooperation on complex networks with synergistic and discounted group interactions , 2015 .

[40]  Angel Sánchez,et al.  Evolving learning rules and emergence of cooperation in spatial prisoner's dilemma. , 2008, Journal of theoretical biology.

[41]  Attila Szolnoki,et al.  Selection of noise level in strategy adoption for spatial social dilemmas. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Charles M. Grinstead,et al.  Introduction to probability , 1999, Statistics for the Behavioural Sciences.

[43]  Long Wang,et al.  Promotion of cooperation induced by appropriate payoff aspirations in a small-world networked game. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Robert van Rooij,et al.  The Stag Hunt and the Evolution of Social Structure , 2007, Stud Logica.

[45]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[46]  Chaitanya S. Gokhale,et al.  Evolutionary games in the multiverse , 2010, Proceedings of the National Academy of Sciences.

[47]  Chaitanya S. Gokhale,et al.  Dynamic Properties of Evolutionary Multi-player Games in Finite Populations , 2013, Games.

[48]  Francis L. W. Ratnieks,et al.  Social learning strategies in honeybee foragers: do the costs of using private information affect the use of social information? , 2013, Animal Behaviour.

[49]  D. E. Matthews Evolution and the Theory of Games , 1977 .

[50]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[51]  C. Hauert,et al.  Coevolutionary dynamics: from finite to infinite populations. , 2004, Physical review letters.

[52]  J. Kagel,et al.  Handbook of Experimental Economics , 1997 .

[53]  Martin A Nowak,et al.  Multi-player games on the cycle. , 2012, Journal of theoretical biology.

[54]  C. Hauert,et al.  Synergy and discounting of cooperation in social dilemmas. , 2006, Journal of theoretical biology.

[55]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[56]  Franz J Weissing,et al.  Focus on the success of others leads to selfish behavior , 2015, Proceedings of the National Academy of Sciences.

[57]  H. Young,et al.  The Evolution of Conventions , 1993 .

[58]  F. C. Santos,et al.  Stochastic Dynamics through Hierarchically Embedded Markov Chains. , 2017, Physical review letters.

[59]  Long Wang,et al.  Evolutionary dynamics of general group interactions in structured populations. , 2016, Physical review. E.

[60]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[61]  Lucas Wardil,et al.  Cooperation in two-dimensional mixed-games , 2015, 1505.03875.

[62]  Marco Alberto Javarone,et al.  Heterogeneous update mechanisms in evolutionary games: Mixing innovative and imitative dynamics. , 2017, Physical review. E.

[63]  Arne Traulsen,et al.  Fitness-based models and pairwise comparison models of evolutionary games are typically different—even in unstructured populations , 2015 .