Punishment in public goods games leads to meta-stable phase transitions and hysteresis

The evolution of cooperation has been a perennial problem in evolutionary biology because cooperation can be undermined by selfish cheaters who gain an advantage in the short run, while compromising the long-term viability of the population. Evolutionary game theory has shown that under certain conditions, cooperation nonetheless evolves stably, for example if players have the opportunity to punish cheaters that benefit from a public good yet refuse to pay into the common pool. However, punishment has remained enigmatic because it is costly and difficult to maintain. On the other hand, cooperation emerges naturally in the public goods game if the synergy of the public good (the factor multiplying the public good investment) is sufficiently high. In terms of this synergy parameter, the transition from defection to cooperation can be viewed as a phase transition with the synergy as the critical parameter. We show here that punishment reduces the critical value at which cooperation occurs, but also creates the possibility of meta-stable phase transitions, where populations can 'tunnel' into the cooperating phase below the critical value. At the same time, cooperating populations are unstable even above the critical value, because a group of defectors that are large enough can 'nucleate' such a transition. We study the mean-field theoretical predictions via agent-based simulations of finite populations using an evolutionary approach where the decisions to cooperate or to punish are encoded genetically in terms of evolvable probabilities. We recover the theoretical predictions and demonstrate that the population shows hysteresis, as expected in systems that exhibit super-heating and super-cooling. We conclude that punishment can stabilize populations of cooperators below the critical point, but it is a two-edged sword: it can also stabilize defectors above the critical point.

[1]  R. Boyd,et al.  Coordinated Punishment of Defectors Sustains Cooperation and Can Proliferate When Rare , 2010, Science.

[2]  Arend Hintze,et al.  Evolution and stability of altruist strategies in microbial games. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  A. W. F. Edwards,et al.  The statistical processes of evolutionary theory , 1963 .

[4]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[5]  Attila Szolnoki,et al.  Probabilistic sharing solves the problem of costly punishment , 2014, ArXiv.

[6]  Tatsuo Unemi,et al.  Replicator dynamics in public goods games with reward funds. , 2011, Journal of theoretical biology.

[7]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[8]  Arend Hintze,et al.  Darwinian Evolution of Cooperation via Punishment in the "Public Goods" Game , 2010, ALIFE.

[9]  M. Olson,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups. , 1973 .

[10]  J. Ledyard Public Goods: A Survey of Experimental Research , 1994 .

[11]  David G. Rand,et al.  The evolution of antisocial punishment in optional public goods games. , 2011, Nature communications.

[12]  Attila Szolnoki,et al.  Phase Diagrams for the Spatial Public Goods Game with Pool-Punishment , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations , 2004, Bulletin of mathematical biology.

[14]  Hanna Kokko,et al.  The tragedy of the commons in evolutionary biology. , 2007, Trends in ecology & evolution.

[15]  György Szabó,et al.  Phase transitions and volunteering in spatial public goods games. , 2002, Physical review letters.

[16]  C. Adami,et al.  Impact of epistasis and pleiotropy on evolutionary adaptation , 2009, Proceedings of the Royal Society B: Biological Sciences.

[17]  Colin Camerer,et al.  When Does "Economic Man" Dominate Social Behavior? , 2006, Science.

[18]  S. Frank Foundations of Social Evolution , 2019 .

[19]  R Boyd,et al.  Why people punish defectors. Weak conformist transmission can stabilize costly enforcement of norms in cooperative dilemmas. , 2001, Journal of theoretical biology.

[20]  S. P. Brown,et al.  Cooperation and conflict in host–manipulating parasites , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  Oliver P Hauser,et al.  Punishment does not promote cooperation under exploration dynamics when anti-social punishment is possible. , 2014, Journal of theoretical biology.

[22]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[23]  M. Perc,et al.  Self-organization of punishment in structured populations , 2012, 1203.6900.

[24]  Steven A. Frank,et al.  Models of Parasite Virulence , 1996, The Quarterly Review of Biology.

[25]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[26]  T. Yamagishi The provision of a sanctioning system as a public good , 1986 .

[27]  C. Hauert,et al.  Reward and punishment , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[28]  R. MacLean,et al.  The tragedy of the commons in microbial populations: insights from theoretical, comparative and experimental studies , 2008, Heredity.

[29]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[30]  E. M.,et al.  Statistical Mechanics , 2021, Manual for Theoretical Chemistry.

[31]  Arne Traulsen,et al.  Social learning promotes institutions for governing the commons , 2010, Nature.

[32]  L. Dugatkin Cooperation Among Animals: An Evolutionary Perspective , 1997 .

[33]  Z. Tu Challenges in the theoretical investigations of lipid membrane configurations , 2013 .

[34]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[35]  Attila Szolnoki,et al.  Evolutionary Establishment of Moral and Double Moral Standards through Spatial Interactions , 2010, PLoS Comput. Biol..

[36]  Robert T. Pennock,et al.  The evolutionary origin of complex features , 2003, Nature.

[37]  Y. Imry,et al.  Influence of quenched impurities on first-order phase transitions , 1979 .

[38]  Mike Mesterton-Gibbons,et al.  Genetic and cultural evolution of cooperation , 2004 .

[39]  Attila Szolnoki,et al.  Correlation of positive and negative reciprocity fails to confer an evolutionary advantage: Phase transitions to elementary strategies , 2013, ArXiv.

[40]  Attila Szolnoki,et al.  Effectiveness of conditional punishment for the evolution of public cooperation. , 2013, Journal of theoretical biology.

[41]  Attila Szolnoki,et al.  Evolutionary advantages of adaptive rewarding , 2012, 1208.3457.

[42]  O. Public Goods: A Survey of Experimental Research , 2005 .

[43]  P. Moran,et al.  The statistical processes of evolutionary theory. , 1963 .

[44]  M. A. Cayless Statistical Mechanics (2nd edn) , 1977 .

[45]  B. Rockenbach,et al.  The Competitive Advantage of Sanctioning Institutions , 2006, Science.

[46]  C. Hauert,et al.  Punishment and reputation in spatial public goods games , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[47]  David G. Rand,et al.  Anti-social Punishment Can Prevent the Co-evolution of Punishment and Cooperation , 2010 .

[48]  E. Zeeman Dynamics of the evolution of animal conflicts , 1981 .

[49]  C. Hauert,et al.  Via Freedom to Coercion: The Emergence of Costly Punishment , 2007, Science.

[50]  C. Hauert,et al.  Models of cooperation based on the Prisoner's Dilemma and the Snowdrift game , 2005 .

[51]  Attila Szolnoki,et al.  Punish, but not too hard: how costly punishment spreads in the spatial public goods game , 2010, 1007.0431.

[52]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[53]  Arend Hintze,et al.  Critical Dynamics in the Evolution of Stochastic Strategies for the Iterated Prisoner's Dilemma , 2010, PLoS Comput. Biol..

[54]  U. Fischbacher,et al.  The nature of human altruism , 2003, Nature.

[55]  Michael Doebeli,et al.  A simple and general explanation for the evolution of altruism , 2009, Proceedings of the Royal Society B: Biological Sciences.

[56]  张谷 实验经济学(Experimental Economics)研究思路及成果应用简述 , 1994 .

[57]  Arne Traulsen,et al.  Freedom, enforcement, and the social dilemma of strong altruism , 2010 .

[58]  James H Fowler,et al.  Altruistic Punishment and the Origin of Cooperation , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[59]  M. Olson,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups , 1969 .

[60]  Yoh Iwasa,et al.  The coevolution of altruism and punishment: role of the selfish punisher. , 2006, Journal of theoretical biology.