First carrot, then stick: how the adaptive hybridization of incentives promotes cooperation

Social institutions often use rewards and penalties to promote cooperation. Providing incentives tends to be costly, so it is important to find effective and efficient policies for the combined use of rewards and penalties. Most studies of cooperation, however, have addressed rewarding and punishing in isolation and have focused on peer-to-peer sanctioning as opposed to institutional sanctioning. Here, we demonstrate that an institutional sanctioning policy we call ‘first carrot, then stick’ is unexpectedly successful in promoting cooperation. The policy switches the incentive from rewarding to punishing when the frequency of cooperators exceeds a threshold. We find that this policy establishes and recovers full cooperation at lower cost and under a wider range of conditions than either rewards or penalties alone, in both well-mixed and spatial populations. In particular, the spatial dynamics of cooperation make it evident how punishment acts as a ‘booster stage’ that capitalizes on and amplifies the pro-social effects of rewarding. Together, our results show that the adaptive hybridization of incentives offers the ‘best of both worlds’ by combining the effectiveness of rewarding in establishing cooperation with the effectiveness of punishing in recovering it, thereby providing a surprisingly inexpensive and widely applicable method of promoting cooperation.

[1]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[2]  Matthias Sutter,et al.  Choosing the Carrot or the Stick? Endogenous Institutional Choice in Social Dilemma Situations , 2010 .

[3]  Thilo Gross,et al.  Shared rewarding overcomes defection traps in generalized volunteer's dilemmas. , 2013, Journal of theoretical biology.

[4]  Arne Traulsen,et al.  Social learning promotes institutions for governing the commons , 2010, Nature.

[5]  Ulf Dieckmann,et al.  The take-it-or-leave-it option allows small penalties to overcome social dilemmas , 2012, Proceedings of the National Academy of Sciences.

[6]  William T. Harbaugh,et al.  The Carrot or the Stick: Rewards, Punishments and Cooperation , 2002 .

[7]  F. Herold Carrot or Stick? The Evolution of Reciprocal Preferences in a Haystack Model∗ , 2004 .

[8]  F. Schmidt Meta-Analysis , 2008 .

[9]  Francisco C. Santos,et al.  A bottom-up institutional approach to cooperative governance of risky commons , 2013 .

[10]  J. Falkinger,et al.  Efficient private provision of public goods by rewarding deviations from average , 1996 .

[11]  Karl Sigmund,et al.  Punish or perish? Retaliation and collaboration among humans. , 2007, Trends in ecology & evolution.

[12]  Tatsuya Sasaki,et al.  The Evolution of Cooperation Through Institutional Incentives and Optional Participation , 2013, Dyn. Games Appl..

[13]  J A Cuesta,et al.  The shared reward dilemma. , 2007, Journal of theoretical biology.

[14]  Feng Fu,et al.  Invasion and expansion of cooperators in lattice populations: prisoner's dilemma vs. snowdrift games. , 2010, Journal of theoretical biology.

[15]  G. Brady Governing the Commons: The Evolution of Institutions for Collective Action , 1993 .

[16]  C. Hauert,et al.  Synergy and discounting of cooperation in social dilemmas. , 2006, Journal of theoretical biology.

[17]  L. Felkins The Social Dilemmas , 2015 .

[18]  Yi Tao,et al.  Cooperation and evolutionary dynamics in the public goods game with institutional incentives. , 2012, Journal of theoretical biology.

[19]  Stephanie Thornton,et al.  Carrot or stick , 2010 .

[20]  R Boyd,et al.  Why people punish defectors. Weak conformist transmission can stabilize costly enforcement of norms in cooperative dilemmas. , 2001, Journal of theoretical biology.

[21]  Michael Kosfeld,et al.  Institution Formation in Public Goods Games , 2006 .

[22]  T. Schelling Hockey Helmets, Concealed Weapons, and Daylight Saving , 1973 .

[23]  Attila Szolnoki,et al.  Evolutionary advantages of adaptive rewarding , 2012, 1208.3457.

[24]  Simon Gächter,et al.  Social science: Carrot or stick? , 2012, Nature.

[25]  Hawaii,et al.  Supporting Online Material Materials and Methods Figs. S1 to S6 Tables S1 and S2 Database S1 Antisocial Punishment across Societies , 2022 .

[26]  Daniel Balliet,et al.  Reward, punishment, and cooperation: a meta-analysis. , 2011, Psychological bulletin.

[27]  Robert Shupp,et al.  The Effect of Rewards and Sanctions in Provision of Public Goods , 2006 .

[28]  C. Hauert,et al.  Replicator dynamics for optional public good games. , 2002, Journal of theoretical biology.

[29]  Iyad Rahwan,et al.  Corruption drives the emergence of civil society , 2013, Journal of The Royal Society Interface.

[30]  P. Oliver,et al.  Rewards and Punishments as Selective Incentives , 1984 .

[31]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[32]  Ángel Sánchez,et al.  Effect of spatial structure on the evolution of cooperation , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[34]  R. Cressman,et al.  Game Experiments on Cooperation Through Reward and Punishment , 2013 .

[35]  Weighing reward and punishment. , 2009, Science.

[36]  Arne Traulsen,et al.  Democratic decisions establish stable authorities that overcome the paradox of second-order punishment , 2013, Proceedings of the National Academy of Sciences.

[37]  HuiYou Chang,et al.  Effect of Spatial Structure on the Evolution of Cooperation in the N-Choice Iterated Prisoner's Dilemma , 2013, Trans. Comput. Sci..

[38]  Marco Casari,et al.  Cooperation under alternative punishment institutions: An experiment , 2009 .

[39]  Christian Hilbe,et al.  Incentives and opportunism: from the carrot to the stick , 2010, Proceedings of the Royal Society B: Biological Sciences.

[40]  C. Hauert,et al.  Reward and punishment , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Thomas Dietz,et al.  Nonlinear effects of group size on collective action and resource outcomes , 2013, Proceedings of the National Academy of Sciences.

[42]  Yasuhiko Fukumoto,et al.  Replicator dynamics with Pigovian subsidy and capitation tax , 2009 .

[43]  P. Richerson,et al.  The evolution of reciprocity in sizable groups. , 1988, Journal of theoretical biology.

[44]  Dirk Helbing,et al.  Cooperation in Social Dilemmas , 2012 .

[45]  Henry Hamburger,et al.  N‐person Prisoner's Dilemma† , 1973 .

[46]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[47]  P. Richerson,et al.  Punishment allows the evolution of cooperation (or anything else) in sizable groups , 1992 .

[48]  W C Bornemeier,et al.  The carrot or the stick. , 1973, JAMA.

[49]  B. Rockenbach,et al.  Motivating teammates: The leader's choice between positive and negative incentives , 2009 .