Benefits of memory for the evolution of tag-based cooperation in structured populations

We study the effects of working memory capacity and network rewiring probability on the evolution of cooperation in the standard and modified versions of an agent-based model of tag-mediated altruism. In our evolutionary model, computational agents populate a large complex network, engage into multiplayer Prisoner’s Dilemma-like interactions, and reproduce sexually. Agents carry discernible phenotypic traits subject to mutation, memorize their own experiences, and employ different strategies when interacting with different types of co-players. Choices made are selected from a pool of two conditional and two unconditional strategies, depending on the available memory contents and phenotypic similarity among interactors. For the dominating strategy in our standard model version, we found a strong dependence of cooperation on network structure and a weak one on memory, whereas in the modified version, the structural effect was weaker than that of memory. Most importantly, we found that the previously reported decline of cooperation in memory-based models, typically observed at a high memory capacity, is now prevented with the help of tags. This suggests that the evolutionary advantages of memory capacity limits may be far more complex than previously assumed. For much smaller systems, we observed a quasi-symmetric alternation of the two winning groups of strategists. This result provides an example of ingroup biased interactions that are characterized by bursts of intra-tag cooperation interspersed with periods of unconditional transient altruism. Such switches of strategies may represent a boosting mechanism necessary for the emergence and stability of global altruism in its early evolutionary stages.

[1]  W. Hamilton The genetical evolution of social behaviour. II. , 1964, Journal of theoretical biology.

[2]  W. Hamilton The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[3]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[4]  P. Richerson,et al.  The evolution of indirect reciprocity , 1989 .

[5]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[6]  L. Keller,et al.  Selfish genes: a green beard in the red fire ant , 1998, Nature.

[7]  Frans B. M. de Waal,et al.  Attitudinal reciprocity in food sharing among brown capuchin monkeys , 2000, Animal Behaviour.

[8]  R. Riolo,et al.  Evolution of cooperation without reciprocity , 2001, Nature.

[9]  M. Milinski,et al.  Cooperation through indirect reciprocity: image scoring or standing strategy? , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  R. R. Krausz Living in Groups , 2013 .

[11]  Alejandro D Sánchez,et al.  Nonequilibrium phase transitions in directed small-world networks. , 2002, Physical review letters.

[12]  J. Strassmann,et al.  Single-Gene Greenbeard Effects in the Social Amoeba Dictyostelium discoideum , 2003, Science.

[13]  J. Fewell Social Insect Networks , 2003, Science.

[14]  B. Sinervo,et al.  Morphs, Dispersal Behavior, Genetic Similarity, and the Evolution of Cooperation , 2003, Science.

[15]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.

[16]  M. Newman,et al.  Identifying the role that animals play in their social networks , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  David Hales,et al.  Change Your Tags Fast! - A Necessary Condition for Cooperation? , 2004, MABS.

[18]  Ross A Hammond,et al.  ALTRUISM VIA KIN‐SELECTION STRATEGIES THAT RELY ON ARBITRARY TAGS WITH WHICH THEY COEVOLVE , 2004, Evolution; international journal of organic evolution.

[19]  Dirk Semmann,et al.  Reputation is valuable within and outside one’s own social group , 2005, Behavioral Ecology and Sociobiology.

[20]  F. Marlowe Hunter‐gatherers and human evolution , 2005 .

[21]  B. Crespi,et al.  Cadherins in maternal–foetal interactions: red queen with a green beard? , 2005, Proceedings of the Royal Society B: Biological Sciences.

[22]  Ramón Alonso-Sanz,et al.  MEMORY BOOSTS COOPERATION , 2006 .

[23]  Gueorgi Kossinets,et al.  Empirical Analysis of an Evolving Social Network , 2006, Science.

[24]  Jean Clobert,et al.  Self-recognition, color signals, and cycles of greenbeard mutualism and altruism. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Ross A. Hammond,et al.  The Evolution of Ethnocentrism , 2006 .

[26]  F. C. Santos,et al.  A new route to the evolution of cooperation , 2006, Journal of evolutionary biology.

[27]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[28]  V. Jansen,et al.  Altruism through beard chromodynamics , 2006, Nature.

[29]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[30]  Ross A. Hammond,et al.  Evolution of contingent altruism when cooperation is expensive. , 2006, Theoretical population biology.

[31]  Samuel Bowles,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 and S2 Table S1 References and Notes the Coevolution of Parochial Altruism and War , 2022 .

[32]  Martin A. Nowak,et al.  Chromodynamics of Cooperation in Finite Populations , 2007, PloS one.

[33]  S. C. Winans,et al.  Cell–cell communication in the plant pathogen Agrobacterium tumefaciens , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  Alessandra Cassar,et al.  Coordination and Cooperation in Local, Random and Small World Networks: Experimental Evidence , 2002, Games Econ. Behav..

[35]  A. Griffin,et al.  Social semantics : altruism , cooperation , mutualism , strong reciprocity and group selection , 2007 .

[36]  Daniel Nettle,et al.  Cultural Diversity, Economic Development and Societal Instability , 2007, PloS one.

[37]  H. Ohtsuki,et al.  Evolutionary game dynamics in phenotype space , 2008, 0806.2636.

[38]  Pat Barclay,et al.  A cue of kinship promotes cooperation for the public good , 2008 .

[39]  William A. Cunningham,et al.  The Neural Substrates of In-Group Bias , 2008, Psychological science.

[40]  E. Fehr,et al.  The Coevolution of Cultural Groups and Ingroup Favoritism , 2008, Science.

[41]  Shao-Meng Qin,et al.  Effect of memory on the prisoner's dilemma game in a square lattice. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Christian Schulze,et al.  Agent‐based Computer Simulations of Language Choice Dynamics , 2009, Annals of the New York Academy of Sciences.

[43]  Martin A. Nowak,et al.  Evolution of cooperation by phenotypic similarity , 2008, Proceedings of the National Academy of Sciences.

[44]  G. Ruxton,et al.  Predation risk as a driving force for phenotypic assortment: a cross-population comparison , 2009, Proceedings of the Royal Society B: Biological Sciences.

[45]  Dietrich Stauffer,et al.  Evolution of ethnocentrism on undirected and directed Barabási-Albert networks , 2009, 0905.2672.

[46]  Ramón Alonso-Sanz,et al.  Spatial order prevails over memory in boosting cooperation in the iterated prisoner's dilemma. , 2009, Chaos.

[47]  Tibor Antala,et al.  Sympathy and similarity : The evolutionary dynamics of cooperation , 2009 .

[48]  D. Franks,et al.  Sampling animal association networks with the gambit of the group , 2009, Behavioral Ecology and Sociobiology.

[49]  Bernhard Voelkl,et al.  Social structure of primate interaction networks facilitates the emergence of cooperation , 2009, Biology Letters.

[50]  Jordi Bascompte,et al.  The architecture of mutualistic networks minimizes competition and increases biodiversity , 2009, Nature.

[51]  Richard James,et al.  Behavioural trait assortment in a social network: patterns and implications , 2009, Behavioral Ecology and Sociobiology.

[52]  George Sugihara,et al.  Complex systems: Cooperative network dynamics , 2009, Nature.

[53]  J. A. Marshall Ultimate causes and the evolution of altruism , 2011, Behavioral Ecology and Sociobiology.

[54]  Tian Qiu,et al.  Cooperation in the snowdrift game on directed small-world networks under self-questioning and noisy conditions , 2010, Comput. Phys. Commun..

[55]  Harry Eugene Stanley,et al.  Catastrophic cascade of failures in interdependent networks , 2009, Nature.

[56]  M. Nowak,et al.  Evolutionary dynamics in structured populations , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  Jae-Woo Kim,et al.  A Tag-Based Evolutionary Prisoner's Dilemma Game on Networks with Different Topologies , 2010, J. Artif. Soc. Soc. Simul..

[58]  Daniel W. Franks,et al.  Social networks and models for collective motion in animals , 2011, Behavioral Ecology and Sociobiology.

[59]  Arne Traulsen,et al.  Human strategy updating in evolutionary games , 2010, Proceedings of the National Academy of Sciences.

[60]  Lael J. Schooler,et al.  Forgetting Constrains the Emergence of Cooperative Decision Strategies , 2010, Front. Psychology.

[61]  Jeroen C.J.M. van den Bergh,et al.  Evolution of parochial altruism by multilevel selection , 2011 .

[62]  Robert A Laird,et al.  Green-beard effect predicts the evolution of traitorousness in the two-tag Prisoner's dilemma. , 2011, Journal of theoretical biology.

[63]  R I M Dunbar,et al.  Altruism in networks: the effect of connections , 2011, Biology Letters.

[64]  Jeffrey R. Stevens,et al.  The Good, the Bad, and the Rare: Memory for Partners in Social Interactions , 2011, PloS one.

[65]  Steven F. Railsback,et al.  Agent-Based and Individual-Based Modeling: A Practical Introduction , 2011 .

[66]  Y. Ihara,et al.  Evolution of culture-dependent discriminate sociality: a gene–culture coevolutionary model , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[67]  Shaul Shalvi,et al.  Oxytocin promotes human ethnocentrism , 2011, Proceedings of the National Academy of Sciences.

[68]  Emma Cohen,et al.  The Evolution of Tag-Based Cooperation in Humans , 2012, Current Anthropology.

[69]  A. Colman,et al.  Spontaneous similarity discrimination in the evolution of cooperation. , 2012, Journal of theoretical biology.

[70]  David G. Rand,et al.  Direct reciprocity in structured populations , 2012, Proceedings of the National Academy of Sciences.

[71]  J. Cuesta,et al.  Heterogeneous networks do not promote cooperation when humans play a Prisoner’s Dilemma , 2012, Proceedings of the National Academy of Sciences.

[72]  Martin A. Nowak,et al.  Evolution of in-group favoritism , 2012, Scientific Reports.

[73]  Dietrich Stauffer,et al.  Evolution of tag-mediated altruistic behavior in one-shot encounters on large-scale complex networks , 2012, Comput. Phys. Commun..

[74]  Robert A. Laird,et al.  Evolutionary Strategy Dynamics for Tag-Based Cooperation and Defection in the Spatial and Aspatial snowdrift Game , 2012, Int. J. Bifurc. Chaos.

[75]  Dirk Semmann Conditional cooperation can hinder network reciprocity , 2012, Proceedings of the National Academy of Sciences.

[76]  Friederike Mengel,et al.  Limited memory can be beneficial for the evolution of cooperation. , 2012, Journal of theoretical biology.

[77]  Naoki Masuda,et al.  Ingroup favoritism and intergroup cooperation under indirect reciprocity based on group reputation , 2012, Journal of theoretical biology.

[78]  Dietrich Stauffer,et al.  A Biased Review of Sociophysics , 2012, ArXiv.

[79]  David Hales,et al.  Tag-Mediated Altruism is Contingent on How Cheaters Are Defined , 2013, J. Artif. Soc. Soc. Simul..

[80]  D. Mcavity,et al.  Perception without self-matching in conditional tag based cooperation. , 2011, Journal of theoretical biology.

[81]  Long Wang,et al.  Adaptive tag switching reinforces the coevolution of contingent cooperation and tag diversity. , 2013, Journal of theoretical biology.

[82]  Fredrik Jansson,et al.  Pitfalls in Spatial Modelling of Ethnocentrism: A Simulation Analysis of the Model of Hammond and Axelrod , 2013, J. Artif. Soc. Soc. Simul..

[83]  Francisco C. Santos,et al.  Individual memory and the emergence of cooperation , 2013, Animal Behaviour.

[84]  Carolyn H. Declerck,et al.  When do people cooperate? The neuroeconomics of prosocial decision making , 2013, Brain and Cognition.

[85]  David G. Rand,et al.  Human cooperation , 2013, Trends in Cognitive Sciences.

[86]  C. D. De Dreu Human Cooperation , 2013, Psychological science in the public interest : a journal of the American Psychological Society.

[87]  Pascal Molenberghs,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[88]  Thomas R. Shultz,et al.  The Evolutionary Dominance of Ethnocentric Cooperation , 2013, J. Artif. Soc. Soc. Simul..

[89]  David G. Rand,et al.  Why We Cooperate , 2014 .