A synergy of costly punishment and commitment in cooperation dilemmas

To ensure cooperation in the Prisoner’s Dilemma, individuals may require prior commitments from others, subject to compensations when agreements to cooperate are violated. Alternatively, individuals may prefer to behave reactively, without arranging prior commitments, by simply punishing those who misbehave. These two mechanisms have been shown to promote the emergence of cooperation, yet are complementary in the way they aim to promote cooperation. Although both mechanisms have their specific limitations, either one of them can overcome the problems of the other. On one hand, costly punishment requires an excessive effect-to-cost ratio to be successful, and this ratio can be significantly reduced by arranging a prior commitment with a more limited compensation. On the other hand, commitment-proposing strategies can be suppressed by free-riding strategies that commit only when someone else is paying the cost to arrange the deal, whom in turn can be dealt with more effectively by reactive punishers. Using methods from Evolutionary Game Theory, we present here an analytical model showing that there is a wide range of settings for which the combined strategy outperforms either strategy by itself, leading to significantly higher levels of cooperation. Interestingly, the improvement is most significant when the cost of arranging commitments is sufficiently high and the penalty reaches a certain threshold, thereby overcoming the weaknesses of both mechanisms.

[1]  M. Nowak,et al.  Stochastic dynamics of invasion and fixation. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Daniel Taylor,et al.  Evolution of the social contract , 2014 .

[3]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[4]  M. Nowak Evolutionary Dynamics: Exploring the Equations of Life , 2006 .

[5]  Rino Falcone,et al.  Trust Theory: A Socio-Cognitive and Computational Model , 2010 .

[6]  F. Guala Reciprocity: Weak or strong? What punishment experiments do (and do not) demonstrate , 2010, Behavioral and Brain Sciences.

[7]  T. Schelling,et al.  The Strategy of Conflict. , 1961 .

[8]  Michael Winikoff,et al.  Implementing commitment-based interactions , 2007, AAMAS '07.

[9]  G. Szabó,et al.  Evolutionary prisoner's dilemma game on a square lattice , 1997, cond-mat/9710096.

[10]  Nikos Nikiforakis,et al.  A Comparative Statics Analysis of Punishment in Public-Good Experiments , 2005 .

[11]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[12]  M. Perc,et al.  Self-organization of punishment in structured populations , 2012, 1203.6900.

[13]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[14]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[15]  Francisco C. Santos,et al.  Intention recognition promotes the emergence of cooperation , 2011, Adapt. Behav..

[16]  Attila Szolnoki,et al.  Effectiveness of conditional punishment for the evolution of public cooperation. , 2013, Journal of theoretical biology.

[17]  Clyde H. Coombs,et al.  A reparameterization of the prisoner's dilemma game , 1973 .

[18]  Arne Traulsen,et al.  Sanctions as honest signals – The evolution of pool punishment by public sanctioning institutions , 2014, Journal of theoretical biology.

[19]  Francisco C. Santos,et al.  Why Is It So Hard to Say Sorry? Evolution of Apology with Commitments in the iterated Prisoner's Dilemma , 2013, IJCAI.

[20]  Francisco C. Santos,et al.  The emergence of commitments and cooperation , 2012, AAMAS.

[21]  Francisco C. Santos,et al.  Synergy between intention recognition and commitments in cooperation dilemmas , 2015, Scientific Reports.

[22]  Yi Tao,et al.  Costly punishment does not always increase cooperation , 2009, Proceedings of the National Academy of Sciences.

[23]  E. Fehr,et al.  Cooperation and Punishment in Public Goods Experiments , 1999, SSRN Electronic Journal.

[24]  Attila Szolnoki,et al.  Phase Diagrams for the Spatial Public Goods Game with Pool-Punishment , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Torsten Röhl,et al.  An economic experiment reveals that humans prefer pool punishment to maintain the commons , 2012, Proceedings of the Royal Society B: Biological Sciences.

[26]  Attila Szolnoki,et al.  Punish, but not too hard: how costly punishment spreads in the spatial public goods game , 2010, 1007.0431.

[27]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[28]  F. C. Santos,et al.  Good Agreements Make Good Friends , 2013, Scientific Reports.

[29]  Corinna Elsenbroich Trust Theory: A Socio-Cognitive and Computational Model (Wiley Series in Agent Technology) by Cristiano Castelfranchi and Rino Falcone , 2011, J. Artif. Soc. Soc. Simul..

[30]  Attila Szolnoki,et al.  Probabilistic sharing solves the problem of costly punishment , 2014, ArXiv.

[31]  David G. Rand,et al.  Anti-social Punishment Can Prevent the Co-evolution of Punishment and Cooperation , 2010 .

[32]  M. Schlossberg Passions Within Reason: The Strategic Role of the Emotions. , 1990 .

[33]  A. Riedl,et al.  The economics of altruistic punishment and the maintenance of cooperation , 2008, Proceedings of the Royal Society B: Biological Sciences.

[34]  J. Henrich,et al.  Costly Punishment Across Human Societies , 2006, Science.

[35]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[36]  Luís Moniz Pereira,et al.  Apology and forgiveness evolve to resolve failures in cooperative agreements , 2015, Scientific Reports.

[37]  Ulf Dieckmann,et al.  The take-it-or-leave-it option allows small penalties to overcome social dilemmas , 2012, Proceedings of the National Academy of Sciences.

[38]  Ram Ramamoorthy,et al.  Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012) , 2012, AAMAS 2012.

[39]  Shuichi Matsumura,et al.  The evolution of punishment and apology: an iterated prisoner's dilemma model , 2004, Evolutionary Ecology.

[40]  Francisco C. Santos,et al.  Corpus-Based Intention Recognition in Cooperation Dilemmas , 2012, Artificial Life.

[41]  Anke Gerber,et al.  Providing Public Goods in the Absence of Strong Institutions , 2008 .

[42]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..

[43]  Todd L. Cherry,et al.  Enforcing Compliance with Environmental Agreements in the Absence of Strong Institutions: An Experimental Analysis , 2013 .

[44]  Jeffrey P. Carpenter,et al.  The Demand for Punishment , 2007 .

[45]  Mirko Farina The Evolved Apprentice , 2012 .

[46]  G. Brady Governing the Commons: The Evolution of Institutions for Collective Action , 1993 .

[47]  Louis Putterman,et al.  Do Non-Strategic Sanctions Obey the Law of Demand? The Demand for Punishment in the Voluntary Contribution Mechanism , 2003, Games Econ. Behav..

[48]  Nicholas R. Jennings,et al.  The Cooperative Problem-solving Process , 1999, J. Log. Comput..

[49]  Arne Traulsen,et al.  Emergence of responsible sanctions without second order free riders, antisocial punishment or spite , 2012, Scientific Reports.

[50]  Arne Traulsen,et al.  Social learning promotes institutions for governing the commons , 2010, Nature.

[51]  Drew Fudenberg,et al.  Imitation Processes with Small Mutations , 2004, J. Econ. Theory.

[52]  Attila Szolnoki,et al.  Evolutionary Establishment of Moral and Double Moral Standards through Spatial Interactions , 2010, PLoS Comput. Biol..

[53]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[54]  Jean-Robert Karl Public Goods and Voting on Formal Sanction Schemes , 2015 .

[55]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[56]  Han The Anh Emergence of Social Punishment and Cooperation through Prior Commitments , 2016, AAAI.

[57]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[58]  Hawaii,et al.  Supporting Online Material Materials and Methods Figs. S1 to S6 Tables S1 and S2 Database S1 Antisocial Punishment across Societies , 2022 .

[59]  David G. Rand,et al.  The evolution of antisocial punishment in optional public goods games. , 2011, Nature communications.

[60]  R. Nesse Evolution and the capacity for commitment , 2001 .

[61]  C. Hauert,et al.  Via Freedom to Coercion: The Emergence of Costly Punishment , 2007, Science.

[62]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[63]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[64]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .

[65]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[66]  Manfred Milinski,et al.  The Calculus of Selfishness , 2011 .

[67]  C. Hauert,et al.  Reward and punishment , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[68]  C. Hauert,et al.  Punishment and reputation in spatial public goods games , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[69]  D. Fudenberg,et al.  Evolutionary cycles of cooperation and defection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[70]  Arne Traulsen,et al.  Democratic decisions establish stable authorities that overcome the paradox of second-order punishment , 2013, Proceedings of the National Academy of Sciences.

[71]  A. Griffin,et al.  Evolutionary Explanations for Cooperation , 2007, Current Biology.

[72]  Tom Lenaerts,et al.  Avoiding or restricting defectors in public goods games? , 2015, Journal of The Royal Society Interface.

[73]  S. Komorita,et al.  The Effects of Communication and Commitment in a Public Goods Social Dilemma , 1994 .

[74]  Y. Iwasa,et al.  The evolution of altruism by costly punishment in lattice-structured populations: score-dependent viability versus score-dependent fertility , 2005 .

[75]  R. Boyd,et al.  Coordinated Punishment of Defectors Sustains Cooperation and Can Proliferate When Rare , 2010, Science.

[76]  Francisco C. Santos,et al.  Emergence of cooperation via intention recognition, commitment and apology - A research summary , 2015, AI Commun..

[77]  G. Szabó,et al.  Competition of individual and institutional punishments in spatial public goods games. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[78]  Topi Miettinen,et al.  Promises and conventions - An approach to pre-play agreements , 2013, Games Econ. Behav..

[79]  Tatsuya Sasaki,et al.  Commitment to Cooperation and Peer Punishment: Its Evolution , 2015, Games.