Punishment Leads to Cooperative Behavior in Structured Societies

Altruistic punishment occurs when an agent incurs a cost to punish another but receives no material benefit for doing so. Despite the seeming irrationality of such behavior, humans in laboratory settings routinely pay to punish others even in anonymous, one-shot settings. Costly punishment is ubiquitous among social organisms in general and is increasingly accepted as a mechanism for the evolution of cooperation. Yet if it is true that punishment explains cooperation, the evolution of altruistic punishment remains a mystery. In a series of computer simulations I give agents the ability to punish one another while playing a continuous prisoner's dilemma. In simulations without social structure, expected behavior evolves—agents do not punish and consequently no cooperation evolves. Likewise, in simulations with social structure but no ability to punish, no cooperation evolves. However, in simulations where agents are both embedded in a social structure and have the option to inflict costly punishment, cooperation evolves quite readily. This suggests a simple and broadly applicable explanation of cooperation for social organisms that have nonrandom social structure and a predisposition to punish one another. Results with scale-free networks further suggest that nodal degree distribution plays an important role in determining whether cooperation will evolve in a structured population.

[1]  C. Hauert,et al.  The Evolutionary Origin of Cooperators and Defectors , 2004, Science.

[2]  M. Travisano,et al.  Strategies of microbial cheater control. , 2004, Trends in microbiology.

[3]  Thomas N. Sherratt,et al.  Behavioural evolution (Communication arising): Does similarity breed cooperation? , 2002, Nature.

[4]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[5]  Richard E. Michod,et al.  Cooperation and Conflict in the Evolution of Individuality. I. Multilevel Selection of the Organism , 1997, The American Naturalist.

[6]  W. Hamilton The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[7]  Shade T. Shutters,et al.  Strong reciprocity, social structure, and the evolution of fair allocations in a simulated ultimatum game , 2009, Comput. Math. Organ. Theory.

[8]  Margarita Ifti,et al.  Effects of neighbourhood size and connectivity on the spatial Continuous Prisoner's Dilemma. , 2004, Journal of theoretical biology.

[9]  I. Bizjak,et al.  Measurement of the wrong-sign decays D0 --> K+ pi- pi0 and D0 --> K+ pi- pi+ pi-, and search for CP violation. , 2005, Physical review letters.

[10]  Marco Casari On the Design of Peer Punishment Experiments , 2005 .

[11]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[12]  Peter D. Taylor,et al.  Evolution of cooperation in a finite homogeneous graph , 2007, Nature.

[13]  James H Fowler,et al.  Altruistic Punishment and the Origin of Cooperation , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[14]  M A Nowak,et al.  Spatial games and the maintenance of cooperation. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[15]  E. Fehr,et al.  Cooperation and Punishment in Public Goods Experiments , 1999, SSRN Electronic Journal.

[16]  J. Henrich,et al.  More ‘altruistic’ punishment in larger societies , 2008, Proceedings of the Royal Society B: Biological Sciences.

[17]  F. C. Santos,et al.  A new route to the evolution of cooperation , 2006, Journal of evolutionary biology.

[18]  M. Nowak,et al.  The evolution of eusociality , 2010, Nature.

[19]  H. Gintis,et al.  The evolution of strong reciprocity: cooperation in heterogeneous populations. , 2004, Theoretical population biology.

[20]  Francis L. W. Ratnieks,et al.  Convergent evolution of worker policing by egg eating in the honeybee and common wasp , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[22]  A. Bird Themajor transitions in evolution , 1995 .

[23]  Steven A. Frank,et al.  Mutual policing and repression of competition in the evolution of cooperative groups , 1995, Nature.

[24]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[25]  Long Wang,et al.  Prisoner's Dilemma on community networks , 2007 .

[26]  R. DePinho,et al.  Cancer: Crime and punishment , 2005, Nature.

[27]  David G. Rand,et al.  Positive Interactions Promote Public Cooperation , 2009, Science.

[28]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[29]  J. Fewell Social Insect Networks , 2003, Science.

[30]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[31]  E. Wilson,et al.  Rethinking the Theoretical Foundation of Sociobiology , 2007, The Quarterly Review of Biology.

[32]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[33]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[34]  M. Doebeli,et al.  The Continuous Prisoner’s Dilemma and the Evolution of Cooperation through Reciprocal Altruism with Variable Investment , 2002, The American Naturalist.

[35]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[36]  M. Nowak,et al.  Evolution of indirect reciprocity , 2005, Nature.

[37]  Thomas C. Schelling,et al.  Dynamic models of segregation , 1971 .

[38]  T. Clutton‐Brock,et al.  Punishment in animal societies , 1995, Nature.

[39]  David C. Parkes,et al.  Learning and Adaption in Multi-Agent Systems , 2006, Lecture Notes in Computer Science.

[40]  William E. Rees,et al.  An Ecological Economics Perspective on Sustainability and Prospects for Ending Poverty , 2002 .

[41]  H E Stanley,et al.  Classes of small-world networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[42]  A. Griffin,et al.  Social semantics : altruism , cooperation , mutualism , strong reciprocity and group selection , 2007 .

[43]  Gilbert Roberts,et al.  Behaviorial evolution: does similarity breed cooperation? , 2002, Nature.

[44]  Robert Costanza,et al.  Overcoming systemic roadblocks to sustainability: The evolutionary redesign of worldviews, institutions, and technologies , 2009, Proceedings of the National Academy of Sciences.

[45]  Lee Spector,et al.  Genetic Stability and Territorial Structure Facilitate the Evolution of Tag-Mediated Altruism , 2006, Artificial Life.

[46]  E. Wilson,et al.  The Superorganism: The Beauty, Elegance, and Strangeness of Insect Societies , 2008 .

[47]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[48]  D. Wilson,et al.  Population viscosity and the evolution of altruism. , 2000, Journal of theoretical biology.

[49]  David Hales,et al.  Change Your Tags Fast! - A Necessary Condition for Cooperation? , 2004, MABS.

[50]  K. Opp,et al.  Dissident Groups, Personal Networks, and Spontaneous Cooperation: The East German Revolution of 1989 , 1993 .

[51]  Roger V. Gould Collective Action and Network Structure , 1993 .

[52]  P. Oliver "IF YOU DON'T DO IT, NOBODY ELSE WILL": ACTIVE AND TOKEN CONTRIBUTORS TO LOCAL COLLECTIVE ACTION* , 1984 .

[53]  Károly Takács,et al.  Collective action and network change , 2008, Soc. Networks.

[54]  Robert Boyd,et al.  Group beneficial norms can spread rapidly in a structured population. , 2002, Journal of theoretical biology.

[55]  Rick L. Riolo,et al.  Behavioural evolution (Communication arising): Does similarity breed cooperation? , 2002, Nature.

[56]  L. Dugatkin Cooperation Among Animals: An Evolutionary Perspective , 1997 .

[57]  M. Newman,et al.  Identifying the role that animals play in their social networks , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[58]  E. Ostrom,et al.  Covenants with and without a Sword: Self-Governance Is Possible , 1992, American Political Science Review.

[59]  D. Queller,et al.  Does population viscosity promote kin selection? , 1992, Trends in ecology & evolution.

[60]  Scott Barrett,et al.  Environment and Statecraft: The Strategy of Environmental Treaty‐making , 2003 .

[61]  F. C. Santos,et al.  Social diversity promotes the emergence of cooperation in public goods games , 2008, Nature.

[62]  Elinor Ostrom,et al.  tragedy of the commons , 2010 .

[63]  Ezequiel A. Di Paolo,et al.  A Little More than Kind and Less than Kin: The Unwarranted Use of Kin Selection in Spatial Models of Communication , 1999, ECAL.

[64]  Michael X Cohen,et al.  Does similarity breed cooperation? Authors' reply , 2002 .

[65]  R. Riolo,et al.  Evolution of cooperation without reciprocity , 2001, Nature.

[66]  William T. Harbaugh,et al.  The Carrot or the Stick: Rewards, Punishments and Cooperation , 2002 .

[67]  Bruce Edmonds,et al.  Applying a socially inspired technique (tags) to improve cooperation in P2P networks , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[68]  Ernst Fehr,et al.  Third Party Punishment and Social Norms , 2004 .

[69]  M. Chwe Communication and Coordination in Social Networks , 2000 .

[70]  H. Gintis Strong reciprocity and human sociality. , 2000, Journal of theoretical biology.

[71]  Inge Kaul,et al.  Providing Global Public Goods: Managing Globalization , 2003 .

[72]  M. Doebeli,et al.  Spatial evolutionary game theory: Hawks and Doves revisited , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[73]  Brian Logan,et al.  Proceedings of the 2004 international conference on Multi-Agent and Multi-Agent-Based Simulation , 2004 .

[74]  O. Leimar,et al.  Evolution of cooperation through indirect reciprocity , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[75]  A. Flache The rational weakness of strong ties: Failure of group solidarity in a highly cohesive group of rational agents , 2002 .

[76]  Sergey N. Dorogovtsev,et al.  Evolution of Networks: From Biological Nets to the Internet and WWW (Physics) , 2003 .

[77]  Andy Gardner,et al.  Cooperation and Punishment, Especially in Humans , 2004, The American Naturalist.

[78]  G. Marwell,et al.  Social Networks and Collective Action: A Theory of the Critical Mass. III , 1988, American Journal of Sociology.

[79]  S. Barrett International Cooperation and the International Commons , 1999 .

[80]  Sandip Sen,et al.  The Success and Failure of Tag-Mediated Evolution of Cooperation , 2005, LAMAS.

[81]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[82]  G. Marwell,et al.  The critical mass in collective action , 1993 .

[83]  F. C. Santos,et al.  Graph topology plays a determinant role in the evolution of cooperation , 2006, Proceedings of the Royal Society B: Biological Sciences.

[84]  J. Fowler,et al.  Egalitarian Motive and Altruistic Punishment , 2005 .

[85]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[86]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[87]  U. Fischbacher,et al.  The Neural Signature of Social Norm Compliance , 2007, Neuron.

[88]  R E Michod,et al.  Cooperation and conflict in the evolution of individuality. II. Conflict mediation , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[89]  B. Rockenbach,et al.  The Competitive Advantage of Sanctioning Institutions , 2006, Science.

[90]  I. Kaul,et al.  Advancing the Concept of Public Goods , 2003 .

[91]  Matthew O. Jackson,et al.  The Evolution of Social and Economic Networks , 2002, J. Econ. Theory.

[92]  Michael W. Macy,et al.  The weakness of strong ties: Collective action failure in a highly cohesive group* , 1996 .

[93]  E. Wilson,et al.  Eusociality: origin and consequences. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[94]  M. Chwe Structure and Strategy in Collective Action1 , 1999, American Journal of Sociology.

[95]  M. Macy,et al.  The evolution of trust and cooperation between strangers: A computational model. , 1998 .

[96]  Albert-László Barabási,et al.  Evolution of Networks: From Biological Nets to the Internet and WWW , 2004 .

[97]  D. Wilson A theory of group selection. , 1975, Proceedings of the National Academy of Sciences of the United States of America.

[98]  D. D. de Quervain,et al.  The Neural Basis of Altruistic Punishment , 2004, Science.

[99]  D. Krakauer,et al.  Policing stabilizes construction of social niches in primates , 2006, Nature.

[100]  Rajiv Sethi,et al.  Neighborhood structure and the evolution of cooperation , 2007 .