A novel route to cyclic dominance in voluntary social dilemmas

Cooperation is the backbone of modern human societies, making it a priority to understand how successful cooperation-sustaining mechanisms operate. Cyclic dominance, a non-transitive set-up comprising at least three strategies wherein the first strategy overrules the second, which overrules the third, which, in turn, overrules the first strategy, is known to maintain biodiversity, drive competition between bacterial strains, and preserve cooperation in social dilemmas. Here, we present a novel route to cyclic dominance in voluntary social dilemmas by adding to the traditional mix of cooperators, defectors and loners, a fourth player type, risk-averse hedgers, who enact tit-for-tat upon paying a hedging cost to avoid being exploited. When this cost is sufficiently small, cooperators, defectors and hedgers enter a loop of cyclic dominance that preserves cooperation even under the most adverse conditions. By contrast, when the hedging cost is large, hedgers disappear, consequently reverting to the traditional interplay of cooperators, defectors, and loners. In the interim region of hedging costs, complex evolutionary dynamics ensues, prompting transitions between states with two, three or four competing strategies. Our results thus reveal that voluntary participation is but one pathway to sustained cooperation via cyclic dominance.

[1]  Erik F. Gerding Code, Crash, and Open Source: The Outsourcing of Financial Regulation to Risk Models and the Global Financial Crisis , 2009 .

[2]  Joseph G. Eisenhauer,et al.  DEMOGRAPHY OF RISK AVERSION , 2001 .

[3]  J. Gore,et al.  Cellular cooperation: insights from microbes. , 2013, Trends in cell biology.

[4]  Erwin Frey,et al.  Coexistence versus extinction in the stochastic cyclic Lotka-Volterra model. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Francisco C. Santos,et al.  A bottom-up institutional approach to cooperative governance of risky commons , 2013 .

[6]  T. Derting,et al.  Immune Response, Not Immune Maintenance, Is Energetically Costly in Wild White‐Footed Mice (Peromyscus leucopus) , 2003, Physiological and Biochemical Zoology.

[7]  Mauro Mobilia,et al.  Oscillatory dynamics in rock-paper-scissors games with mutations. , 2009, Journal of theoretical biology.

[8]  H. Ohtsuki,et al.  Accumulation of driver and passenger mutations during tumor progression , 2009, Proceedings of the National Academy of Sciences.

[9]  Matjaz Perc,et al.  Statistical physics of crime: A review , 2014, Physics of life reviews.

[10]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[11]  S. Ciriacy-Wantrup,et al.  "Common Property" as a Concept in Natural Resources Policy * 1 , 2019, Natural Resource Economics: Selected Papers.

[12]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[13]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[14]  Michael Kosfeld,et al.  Conditional Cooperation and Costly Monitoring Explain Success in Forest Commons Management , 2010, Science.

[15]  Xingru Chen,et al.  Social Learning of Prescribing Behavior Can Promote Population Optimum of Antibiotic Use , 2018, Front. Phys..

[16]  Jürgen Kurths,et al.  Onymity promotes cooperation in social dilemma experiments , 2017, Science Advances.

[17]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[18]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[19]  Attila Szolnoki,et al.  Second-order freeriding on antisocial punishment restores the effectiveness of prosocial punishment , 2017, bioRxiv.

[20]  T. Gajewski,et al.  Cancer immunotherapy , 2012, Molecular oncology.

[21]  Eric D. Kelsic,et al.  Counteraction of antibiotic production and degradation stabilizes microbial communities , 2015, Nature.

[22]  Zhi-Xi Wu,et al.  Spatial prisoner's dilemma game with volunteering in Newman-Watts small-world networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Jeferson J Arenzon,et al.  Globally synchronized oscillations in complex cyclic games. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  David G. Rand,et al.  The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments. , 2012, Journal of theoretical biology.

[25]  David G. Rand,et al.  Cooperating with the future , 2014, Nature.

[26]  A. Griffin,et al.  Evolutionary Explanations for Cooperation , 2007, Current Biology.

[27]  S. Kokubo,et al.  Universal scaling for the dilemma strength in evolutionary games. , 2015, Physics of life reviews.

[28]  R. May,et al.  Systemic risk in banking ecosystems , 2011, Nature.

[29]  Joshua R. Nahum,et al.  Evolution of restraint in a structured rock–paper–scissors community , 2011, Proceedings of the National Academy of Sciences.

[30]  Jennifer Couzin-Frankel,et al.  Breakthrough of the year 2013. Cancer immunotherapy. , 2013, Science.

[31]  Elizabeth Pennisi,et al.  How Did Cooperative Behavior Evolve? , 2005, Science.

[32]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Christoph Hauert,et al.  Effects of Space in 2 × 2 Games , 2002, Int. J. Bifurc. Chaos.

[34]  Levin,et al.  Allelopathy in Spatially Distributed Populations , 1997, Journal of theoretical biology.

[35]  Mauro Mobilia,et al.  Fluctuations and correlations in lattice models for predator-prey interaction. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Long Wang,et al.  Imperfect Vaccine Aggravates the Long-Standing Dilemma of Voluntary Vaccination , 2011, PloS one.

[37]  C. Hauert,et al.  Game theory and physics , 2005 .

[38]  B. Frey,et al.  Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment , 2004 .

[39]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[40]  Stefan Bringezu,et al.  Multi-Scale Governance of Sustainable Natural Resource Use—Challenges and Opportunities for Monitoring and Institutional Development at the National and Global Level , 2016 .

[41]  Xingru Chen,et al.  Imperfect vaccine and hysteresis , 2019, Proceedings of the Royal Society B.

[42]  Martin A. Nowak,et al.  Evolution of cooperation on large networks with community structure , 2019, Journal of the Royal Society Interface.

[43]  György Szabó,et al.  Evolutionary prisoner's dilemma games with voluntary participation. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Tao Zhou,et al.  Effects of competition on pattern formation in the rock-paper-scissors game. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Matjaz Perc,et al.  Grand Challenges in Social Physics: In Pursuit of Moral Behavior , 2018, Front. Phys..

[46]  Ben-Naim,et al.  Segregation in a One-Dimensional Model of Interacting Species. , 1996, Physical review letters.

[47]  M. Feldman,et al.  Local dispersal promotes biodiversity in a real-life game of rock–paper–scissors , 2002, Nature.

[48]  Attila Szolnoki,et al.  Dynamically Generated Cyclic Dominance in Spatial Prisoner's Dilemma Games , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[50]  Marcus Frean,et al.  Rock–scissors–paper and the survival of the weakest , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[51]  A. Griffin,et al.  Social semantics : altruism , cooperation , mutualism , strong reciprocity and group selection , 2007 .

[52]  Jun Tanimoto,et al.  To vaccinate or not to vaccinate: A comprehensive study of vaccination-subsidizing policies with multi-agent simulations and mean-field modeling. , 2019, Journal of theoretical biology.

[53]  Matjaž Perc,et al.  Evolutionary and dynamical coherence resonances in the pair approximated prisoner's dilemma game , 2006 .

[54]  Attila Szolnoki,et al.  Resolving social dilemmas on evolving random networks , 2009, 0910.1905.

[55]  David G. Rand,et al.  Third-party punishment as a costly signal of trustworthiness , 2016, Nature.

[56]  Margaret A. Riley,et al.  Antibiotic-mediated antagonism leads to a bacterial game of rock–paper–scissors in vivo , 2004, Nature.

[57]  Susan K. Jacobson,et al.  Training Idiot Savants: The Lack of Human Dimensions in Conservation Biology , 1998 .

[58]  Valerio Capraro,et al.  Social setting, intuition and experience in laboratory experiments interact to shape cooperative decision-making , 2015, Proceedings of the Royal Society B: Biological Sciences.

[59]  S. Lion,et al.  Moment equations in spatial evolutionary ecology. , 2016, Journal of theoretical biology.

[60]  Alex Arenas,et al.  Stability and robustness analysis of cooperation cycles driven by destructive agents in finite populations. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[61]  Dawei Zhao,et al.  Statistical physics of vaccination , 2016, ArXiv.

[62]  Manfred Milinski,et al.  The Calculus of Selfishness , 2011 .

[63]  David G. Rand,et al.  Promoting cooperation in the field , 2015, Current Opinion in Behavioral Sciences.

[64]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[65]  Attila Szolnoki,et al.  Correlation of positive and negative reciprocity fails to confer an evolutionary advantage: Phase transitions to elementary strategies , 2013, ArXiv.

[66]  C. Maley,et al.  Cancer is a disease of clonal evolution within the body1–3. This has profound clinical implications for neoplastic progression, cancer prevention and cancer therapy. Although the idea of cancer as an evolutionary problem , 2006 .

[67]  Eizo Akiyama,et al.  Neural basis of conditional cooperation. , 2011, Social cognitive and affective neuroscience.

[68]  T. Reichenbach,et al.  Mobility promotes and jeopardizes biodiversity in rock–paper–scissors games , 2007, Nature.

[69]  Attila Szolnoki,et al.  Phase diagrams for three-strategy evolutionary prisoner's dilemma games on regular graphs. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[70]  Piet Van Mieghem,et al.  Epidemic processes in complex networks , 2014, ArXiv.

[71]  Dirk Helbing,et al.  Saving Human Lives: What Complexity Science and Information Systems can Contribute , 2014, Journal of statistical physics.

[72]  J. Salk Clonal evolution in cancer , 2010 .

[73]  Edna Maria Vissoci Reiche,et al.  Stress, depression, the immune system, and cancer. , 2004, The Lancet. Oncology.

[74]  M. Milinski,et al.  Volunteering leads to rock–paper–scissors dynamics in a public goods game , 2003, Nature.

[75]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[76]  Martin A. Nowak,et al.  Evolutionary dynamics on any population structure , 2016, Nature.

[77]  U. Fischbacher,et al.  Social norms and human cooperation , 2004, Trends in Cognitive Sciences.

[78]  Attila Szolnoki,et al.  Cyclic dominance in evolutionary games: a review , 2014, Journal of The Royal Society Interface.

[79]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..

[80]  Francisco C. Santos Climate Change Governance, Cooperation and Self-organization , 2016 .

[81]  G. Szabó,et al.  Defense mechanisms of empathetic players in the spatial ultimatum game. , 2012, Physical review letters.

[82]  O. Finn,et al.  Immuno-oncology: understanding the function and dysfunction of the immune system in cancer. , 2012, Annals of oncology : official journal of the European Society for Medical Oncology.

[83]  Dennis Hasselquist,et al.  Costs of immunity: immune responsiveness reduces survival in a vertebrate , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[84]  David G. Rand,et al.  Human cooperation , 2013, Trends in Cognitive Sciences.