Spatial prisoner's dilemma with heterogeneous agents: Cooperation, learning and co-evolution

In the evolutionary Prisoner’s Dilemma (PD) game, agents play with each other and update their strategies in every generation according to some microscopic dynamical rule. In its spatial version, agents do not play with every other but, instead, interact only with their neighbors, thus mimicking the existing of a social or contact network that defines who interacts with whom. In this work, we explore evolutionary, spatial PD systems consisting of two types of agents, each with a certain update (reproduction, learning) rule. We investigate two different scenarios: in the first case, update rules remain fixed for the entire evolution of the system; in the second case, agents update both strategy and update rule in every generation. Our results show that, for an important range of the parameters of the game, the final state of the system is largely different from that arising from the usual setup of a single, fixed dynamical rule. Furthermore, the results are also very different if update rules are fixed or evolve with the strategies. In these respect, we have studied representative update rules, finding that some of them may become extinct while others prevail. We describe the new and rich variety of final outcomes that arise from this coevolutionary dynamics. Our results pave the way to an evolutionary rationale for modelling social interactions through game theory with a preferred set of update rules.

[1]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[2]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[3]  J. Gómez-Gardeñes,et al.  Natural selection of cooperation and degree hierarchy in heterogeneous populations. , 2008, Journal of theoretical biology.

[4]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[5]  Robert Boyd,et al.  Genetic and Cultural Evolution of Cooperation , 2003 .

[6]  Oliver Kirchkamp,et al.  Simultaneous Evolution of Learning Rules and Strategies , 1996 .

[7]  M. Nowak,et al.  THE SPATIAL DILEMMAS OF EVOLUTION , 1993 .

[8]  F. C. Santos,et al.  Graph topology plays a determinant role in the evolution of cooperation , 2006, Proceedings of the Royal Society B: Biological Sciences.

[9]  P. Kollock SOCIAL DILEMMAS: The Anatomy of Cooperation , 1998 .

[10]  J. Cuesta,et al.  Emergence and resilience of cooperation in the spatial prisoner's dilemma via a reward mechanism. , 2007, Journal of theoretical biology.

[11]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[12]  Martin A Nowak,et al.  Spatial invasion of cooperation. , 2008, Journal of theoretical biology.

[13]  L. Dugatkin,et al.  Cooperation among unrelated individuals: reciprocal altruism, by-product mutualism and group selection in fishes. , 1996, Bio Systems.

[14]  K. Kaski,et al.  Spatial snowdrift game with myopic agents , 2005 .

[15]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[16]  Herbert Gintis,et al.  Game Theory Evolving: A Problem-Centered Introduction to Modeling Strategic Interaction - Second Edition , 2009 .

[17]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[18]  B. Crespi The evolution of social behavior in microorganisms. , 2001, Trends in ecology & evolution.

[19]  Angel Sánchez,et al.  Mesoscopic Structure Conditions the Emergence of Cooperation on Social Networks , 2006, PloS one.

[20]  A. Rapoport,et al.  Prisoner's Dilemma , 1965 .

[21]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[22]  S. Schuster,et al.  An example of the prisoner's dilemma in biochemistry , 2003, Naturwissenschaften.

[23]  Christoph Hauert,et al.  Effects of Space in 2 × 2 Games , 2002, Int. J. Bifurc. Chaos.

[24]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[25]  Christoph Hauert,et al.  Spatial effects in social dilemmas. , 2006, Journal of theoretical biology.

[26]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.