Learning Algorithm and the Cooperation Behavior of Continuous Prisoner's Dilemma Game on Complex Networks ⋆

The standard evolutionary Prisoner’s Dilemma Game (PDG), which is the most widely used model for investigating the evolution of cooperation, does not allow for changeable degrees of cooperation and the players can either cooperate or defect in each time. In this paper, we study Continuous Prisoner’s Dilemma Games (CPDG) on complex networks (or Spatial Continuous Prisoner’s Dilemma Games (SCPDG)); in which each agent locates on a vertex of the network and interacts with all his neighboring agents by making an investment. Each agent’s investment will benefit all its neighbors and incur a cost to the focus agent. The investment which can be varied continuously exhibits variable degrees of cooperation. The cooperative level of the group is characterized by the average investment of the population. Unlike the imitation of the best neighbors learning rule, the probability based imitation learning rule and the Moran process based learning rule that usually used in the standard evolutionary SPDG, we propose a new learning algorithm in the continuous condition. Three parameters to describe the imitation ability of the best neighbors, the memory length of the individual and uncertainty effect of the environment are introduced. We investigate the co-effect of these parameters on the cooperation level of the population on the Barabasi-Albert (BA) scale-free networks, the nearest-neighbor coupled networks and the Newman-Watts (NW) small-world networks. Our results may provide some new conclusion on the study of evolutionary games on networks.

[1]  M. Newman,et al.  Scaling and percolation in the small-world network model. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[3]  Yongkui Liu,et al.  Memory-based prisoner’s dilemma on square lattices , 2010 .

[4]  M. Doebeli,et al.  The Continuous Prisoner’s Dilemma and the Evolution of Cooperation through Reciprocal Altruism with Variable Investment , 2002, The American Naturalist.

[5]  R. Jiménez,et al.  Gradual learning and the evolution of cooperation in the spatial Continuous Prisoner’s Dilemma , 2009 .

[6]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[7]  J Gómez-Gardeñes,et al.  Dynamical organization of cooperation in complex topologies. , 2007, Physical review letters.

[8]  RAMÓN ALONSO-SANZ,et al.  The Effect of Memory in the Spatial continuous-Valued Prisoner's Dilemma , 2001, Int. J. Bifurc. Chaos.

[9]  L M Wahl,et al.  The Continuous Prisoner:s Dilemma: I. Linear Reactive Strategies , 1999 .

[10]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[11]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[12]  S. J. Cox,et al.  Group Size, Memory, and Interaction Rate in the Evolution of Cooperation1 , 1999, Current Anthropology.

[13]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[14]  Long Wang,et al.  Social dilemmas in an online social network: The structure and evolution of cooperation , 2007, physics/0701323.

[15]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[17]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[18]  Shao-Meng Qin,et al.  Effect of memory on the prisoner's dilemma game in a square lattice. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[20]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[21]  Elizabeth Pennisi,et al.  How Did Cooperative Behavior Evolve? , 2005, Science.

[22]  Stephen Devlin,et al.  Evolution of cooperation through the heterogeneity of random networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  M. Doebeli,et al.  Variable investment, the Continuous Prisoner's Dilemma, and the origin of cooperation , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[24]  M. Nowak,et al.  The continuous Prisoner's dilemma: II. Linear reactive strategies with noise. , 1999, Journal of theoretical biology.

[25]  H. Ezoe,et al.  Dual lattice model of the evolution of facultative symbiosis with continuous Prisoner's Dilemma game. , 2009, Journal of theoretical biology.

[26]  Margarita Ifti,et al.  Effects of neighbourhood size and connectivity on the spatial Continuous Prisoner's Dilemma. , 2004, Journal of theoretical biology.

[27]  M. Perc,et al.  Social diversity and promotion of cooperation in the spatial prisoner's dilemma game. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[29]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[30]  István Scheuring,et al.  The iterated continuous prisoner's dilemma game cannot explain the evolution of interspecific mutualism in unstructured populations. , 2005, Journal of theoretical biology.

[31]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[32]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[33]  K. Aihara,et al.  Spatial prisoner's dilemma optimally played in small-world networks , 2003 .

[34]  Ángel Sánchez,et al.  Effect of spatial structure on the evolution of cooperation , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  M. Kuperman,et al.  Social games in a social network. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Ramón Alonso-Sanz,et al.  Memory versus spatial disorder in the support of cooperation , 2009, Biosyst..

[37]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .