Evolution of Groupwise Cooperation: Generosity, Paradoxical Behavior, and Non-Linear Payoff Functions

Evolution of cooperation by reciprocity has been studied using two-player and n-player repeated prisoner’s dilemma games. An interesting feature specific to the n-player case is that players can vary in generosity, or how many defections they tolerate in a given round of a repeated game. Reciprocators are quicker to detect defectors to withdraw further cooperation when less generous, and better at maintaining a long-term cooperation in the presence of rare defectors when more generous. A previous analysis on a stochastic evolutionary model of the n-player repeated prisoner’s dilemma has shown that the fixation probability of a single reciprocator in a population of defectors can be maximized for a moderate level of generosity. However, the analysis is limited in that it considers only tit-for-tat-type reciprocators within the conventional linear payoff assumption. Here we extend the previous study by removing these limitations and show that, if the games are repeated sufficiently many times, considering non-tit-for-tat type strategies does not alter the previous results, while the introduction of non-linear payoffs sometimes does. In particular, under certain conditions, the fixation probability is maximized for a “paradoxical” strategy, which cooperates in the presence of fewer cooperating opponents than in other situations in which it defects.

[1]  M. Nowak,et al.  The evolution of stochastic strategies in the Prisoner's Dilemma , 1990 .

[2]  Todd L. Cherry,et al.  Conditional cooperation on three continents , 2008 .

[3]  R. Boyd,et al.  No pure strategy is evolutionarily stable in the repeated Prisoner's Dilemma game , 1987, Nature.

[4]  C. Hauert,et al.  Effects of increasing the number of players and memory size in the iterated Prisoner's Dilemma: a numerical approach , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[5]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[6]  F. C. Santos,et al.  Evolutionary dynamics of collective action in N-person stag hunt dilemmas , 2009, Proceedings of the Royal Society B: Biological Sciences.

[7]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[8]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[9]  S. Kurokawa,et al.  Evolution of group-wise cooperation: Is direct reciprocity insufficient? , 2017, Journal of theoretical biology.

[10]  S. Kurokawa,et al.  Emergence of cooperation in public goods games , 2009, Proceedings of the Royal Society B: Biological Sciences.

[11]  Leticia Avilés,et al.  Cooperative capture of large prey solves scaling challenge faced by spider societies , 2008, Proceedings of the National Academy of Sciences.

[12]  Arne Traulsen,et al.  Partners or rivals? Strategies for the iterated prisoner's dilemma☆ , 2015, Games Econ. Behav..

[13]  A. Diekmann Volunteer's Dilemma , 1985 .

[14]  Rick Durrett,et al.  Extrapolating weak selection in evolutionary games , 2018, bioRxiv.

[15]  Naoki Masuda,et al.  Win-stay lose-shift strategy in formation changes in football , 2015, EPJ Data Science.

[16]  S. Kurokawa Imperfect information facilitates the evolution of reciprocity. , 2016, Mathematical biosciences.

[17]  M. Nowak Stochastic strategies in the Prisoner's Dilemma , 1990 .

[18]  C. Packer,et al.  Why Lions Form Groups: Food is Not Enough , 1990, The American Naturalist.

[19]  K. N. Rabenold Cooperative Enhancement Of Reproductive Success in Tropical Wren Societies , 1984 .

[20]  M. Nowak,et al.  The evolution of eusociality , 2010, Nature.

[21]  L A Bach,et al.  The evolution of n-player cooperation-threshold games and ESS bifurcations. , 2006, Journal of theoretical biology.

[22]  Julián García,et al.  In and out of equilibrium I: Evolution of strategies in repeated games with discounting , 2007, J. Econ. Theory.

[23]  P. Richerson,et al.  The evolution of reciprocity in sizable groups. , 1988, Journal of theoretical biology.

[24]  David G. Rand,et al.  Direct reciprocity in structured populations , 2012, Proceedings of the National Academy of Sciences.

[25]  S. Kurokawa Evolution of cooperation: The analysis of the case wherein a different player has a different benefit and a different cost , 2016 .

[26]  M. Nowak,et al.  Limitations of inclusive fitness , 2013, Proceedings of the National Academy of Sciences.

[27]  S. Kurokawa Payoff non-linearity sways the effect of mistakes on the evolution of reciprocity. , 2016, Mathematical biosciences.

[28]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[29]  Jochem Marotzke,et al.  Stabilizing the earth's climate is not a losing game: supporting evidence from public goods experiments. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Chaitanya S. Gokhale,et al.  Evolutionary games in the multiverse , 2010, Proceedings of the National Academy of Sciences.

[31]  Shun Kurokawa,et al.  Unified and simple understanding for the evolution of conditional cooperators. , 2016, Mathematical biosciences.

[32]  Zhijian Wang,et al.  Social cycling and conditional responses in the Rock-Paper-Scissors game , 2014, Scientific Reports.

[33]  Kris De Jaegher,et al.  Harsh environments and the evolution of multi-player cooperation. , 2017 .

[34]  S. Kurokawa Persistence extends reciprocity. , 2017, Mathematical biosciences.

[35]  D. Fudenberg,et al.  Evolutionary Dynamics with Aggregate Shocks , 1992 .

[36]  Benedikt Herrmann,et al.  Measuring conditional cooperation: a replication study in Russia , 2009 .

[37]  S. Creel Cooperative hunting and group size: assumptions and currencies , 1997, Animal Behaviour.

[38]  M. Nowak,et al.  Partners and rivals in direct reciprocity , 2018, Nature Human Behaviour.

[39]  U. Fischbacher,et al.  Are People Conditionally Cooperative? Evidence from a Public Goods Experiment , 2001 .

[40]  J. Bednarz,et al.  Cooperative Hunting Harris' Hawks (Parabuteo unicinctus) , 1988, Science.

[41]  H. Gintis,et al.  A Cooperative Species: Human Reciprocity and Its Evolution , 2011 .

[42]  F. C. Santos,et al.  Evolution of cooperation under N-person snowdrift games. , 2009, Journal of theoretical biology.

[43]  Alexander J. Stewart,et al.  From extortion to generosity, evolution in the Iterated Prisoner’s Dilemma , 2013, Proceedings of the National Academy of Sciences.

[44]  Christina Pawlowitsch,et al.  One-third rules with equality: Second-order evolutionary stability conditions in finite populations. , 2008, Journal of theoretical biology.

[45]  Shun Kurokawa,et al.  Evolution of social behavior in finite populations: a payoff transformation in general n-player games and its implications. , 2013, Theoretical population biology.

[46]  P. Stander Foraging dynamics of lions in a semi-arid environment , 1992 .

[47]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[48]  S. Kurokawa The extended reciprocity: Strong belief outperforms persistence. , 2017, Journal of theoretical biology.

[49]  W. Press,et al.  Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent , 2012, Proceedings of the National Academy of Sciences.

[50]  M. Doebeli,et al.  Self-organized criticality in spatial evolutionary game theory. , 1998, Journal of theoretical biology.

[51]  Michael Taylor,et al.  Anarchy and cooperation , 1976 .

[52]  Chunyan Zhang,et al.  The public goods game with a new form of shared reward , 2016 .

[53]  Masanori Takezawa,et al.  Revisiting "The evolution of reciprocity in sizable groups": continuous reciprocity in the repeated n-person prisoner's dilemma. , 2010, Journal of theoretical biology.

[54]  S. Kurokawa Evolutionary stagnation of reciprocators , 2016, Animal Behaviour.

[55]  Laurent Lehmann,et al.  Gains from switching and evolutionary stability in multi-player matrix games. , 2013, Journal of theoretical biology.

[56]  N. V. Joshi,et al.  Evolution of cooperation by reciprocation within structured demes , 1987, Journal of Genetics.

[57]  S. Kurokawa Does imperfect information always disturb the evolution of reciprocity , 2016 .

[58]  P. Todd,et al.  Expectations of clumpy resources influence predictions of sequential events , 2011 .

[59]  P. A. P. Moran,et al.  Random processes in genetics , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[60]  Matthijs van Veelen,et al.  Robustness against indirect invasions , 2012, Games Econ. Behav..

[61]  P. Kollock SOCIAL DILEMMAS: The Anatomy of Cooperation , 1998 .

[62]  Alexander J. Stewart,et al.  Extortion and cooperation in the Prisoner’s Dilemma , 2012, Proceedings of the National Academy of Sciences.

[63]  M. Nowak,et al.  Games among relatives revisited. , 2015, Journal of theoretical biology.

[64]  M. Nowak,et al.  TRANSFORMING THE DILEMMA , 2007, Evolution; international journal of organic evolution.

[65]  J. Wakano,et al.  Generous cooperators can outperform non-generous cooperators when replacing a population of defectors. , 2010, Theoretical population biology.

[66]  M. Nowak,et al.  Tit for tat in heterogeneous populations , 1992, Nature.

[67]  P. Martinsson,et al.  Conditional cooperation and disclosure in developing countries , 2013 .

[68]  Tianguang Chu,et al.  Rare but severe concerted punishment that favors cooperation. , 2012, Theoretical population biology.

[69]  J. Hirshleifer From weakest-link to best-shot: The voluntary provision of public goods , 1983 .

[70]  R. Boyd Mistakes allow evolutionary stability in the repeated prisoner's dilemma game. , 1989, Journal of theoretical biology.

[71]  Alexander J. Stewart,et al.  Collapse of cooperation in evolving games , 2014, Proceedings of the National Academy of Sciences.

[72]  M. Archetti,et al.  Review: Game theory of public goods in one-shot social dilemmas without assortment. , 2012, Journal of theoretical biology.

[73]  B. Hayden,et al.  Gambling for Gatorade: risk-sensitive decision making for fluid rewards in humans , 2008, Animal Cognition.