The link weight adjustment considering historical strategy promotes the cooperation in the spatial prisoner’s dilemma game

Abstract Nothing remains the same in social networks, especially the closeness of relationships between selfish individuals. With the passage of time, this relationship may change dynamically and have an important impact on cooperation. In this paper, we propose a new evolutionary game model to investigate the evolution of cooperation, in which the link weight is adaptively adjusted by comparing the individual payoff with her/his surrounding environment, and the learning ability of individual is affected by his historical strategies at the same time. To be specific, if the focal individual’s payoff is greater than the average one of his nearest neighbors, the link weight between the focal individual and nearest neighbors will be increased by one unit; however, if the focal individual’s payoff is smaller than the average one of his nearest neighbors, the link weight between them will be reduced by one unit; otherwise, the link weight between them will be unchanged. In addition, we use a specific parameter e to determine the link weight adjustment range. Meanwhile, the focal individual will decide how to learn from her/his neighbor’s strategy according to his strategy of the last M game rounds when she/he updates the current strategy. Through extensive Monte Carlo simulations, we find that dynamic adjustment of link weights can significantly promote the evolution of cooperation. Particularly, the parameter δ determining the intensity of weight adjustment has an optimal value regarding the level of cooperation, and then the cooperation has significantly been improved with the growth of e . Also, there is an optimal memory length M as far as the emergence and persistence of cooperation is concerned. The current results are extremely conducive to understanding how selfish individuals in social dilemma dynamically adjust their relationships to promote the collective cooperation.

[1]  Long Wang,et al.  Promotion of cooperation induced by appropriate payoff aspirations in a small-world networked game. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Hao Guo,et al.  Adaptive willingness resolves social dilemma in network populations. , 2019, Chaos.

[3]  Chao Zhai,et al.  Effective usage of credit records promotes cooperation on weighted networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Zengqiang Chen,et al.  Risk Analysis and Enhancement of Cooperation Yielded by the Individual Reputation in the Spatial Public Goods Game , 2017, IEEE Systems Journal.

[5]  Mao-Bin Hu,et al.  Asymmetric cost in snowdrift game on scale-free networks , 2009 .

[6]  Attila Szolnoki,et al.  Probabilistic sharing solves the problem of costly punishment , 2014, ArXiv.

[7]  Aya Hagishima,et al.  Effect of a large gaming neighborhood and a strategy adaptation neighborhood for bolstering network reciprocity in a prisoner's dilemma game , 2014 .

[8]  Xiaoping Zheng,et al.  Understanding Cooperative Behavior Based on the Coevolution of Game Strategy and Link Weight , 2015, Scientific Reports.

[9]  Jun Tanimoto,et al.  Dynamic noise from action errors enhances network reciprocity in the prisoner's dilemma game , 2015 .

[10]  Wenzhong Guo,et al.  Promotion of cooperation based on swarm intelligence in spatial public goods games , 2018, Appl. Math. Comput..

[11]  G. Szabó,et al.  Evolutionary prisoner's dilemma game on a square lattice , 1997, cond-mat/9710096.

[12]  V. P. Afanas'ev,et al.  Energy loss of kilovolt electrons in thin films , 1993 .

[13]  P. Hui,et al.  Spatial structure enhanced cooperation in dissatisfied adaptive snowdrift game , 2013 .

[14]  Xiaopeng Li,et al.  Reputation-based adaptive adjustment of link weight among individuals promotes the cooperation in spatial social dilemmas , 2019, Appl. Math. Comput..

[15]  Wei Chen,et al.  Coevolution of aspirations and cooperation in spatial prisoner's dilemma game , 2015 .

[16]  H. Ohtsuki,et al.  Evolution of cooperation on adaptively weighted networks. , 2011, Journal of theoretical biology.

[17]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[18]  G. Szabó,et al.  Cooperation enhanced by inhomogeneous activity of teaching for evolutionary Prisoner's Dilemma games , 2006, q-bio/0610001.

[19]  C. Hauert,et al.  Models of cooperation based on the Prisoner's Dilemma and the Snowdrift game , 2005 .

[20]  Attila Szolnoki,et al.  Rewarding evolutionary fitness with links between populations promotes cooperation , 2014, Journal of theoretical biology.

[21]  Attila Szolnoki,et al.  Reward and cooperation in the spatial public goods game , 2010, ArXiv.

[22]  C. Hauert,et al.  Punishment and reputation in spatial public goods games , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[23]  César A. Hidalgo,et al.  Scale-free networks , 2008, Scholarpedia.

[24]  F. C. Santos,et al.  Social diversity promotes the emergence of cooperation in public goods games , 2008, Nature.

[25]  C. Hauert,et al.  Reputation-based partner choice promotes cooperation in social networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Jun Tanimoto,et al.  Relationship between dilemma occurrence and the existence of a weakly dominant strategy in a two-player symmetric game , 2007, Biosyst..

[27]  Jun Tanimoto.  Simultaneously selecting appropriate partners for gaming and strategy adaptation to enhance network reciprocity in the prisoner's dilemma. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Long Wang,et al.  Effects of heterogeneous wealth distribution on public cooperation with collective risk. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[30]  Long Wang,et al.  Evolutionary Prisoner's Dilemma on heterogeneous Newman-Watts small-world network , 2006, math/0609626.

[31]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[32]  Chengyi Xia,et al.  Inferring Reputation Promotes the Evolution of Cooperation in Spatial Social Dilemma Games , 2012, PloS one.

[33]  Lin Wang,et al.  Evolutionary games on multilayer networks: a colloquium , 2015, The European Physical Journal B.

[34]  Marco Tomassini,et al.  Supercooperation in Evolutionary Games on Correlated Weighted Networks , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Zhen Wang,et al.  Heterogeneous Coupling between Interdependent Lattices Promotes the Cooperation in the Prisoner’s Dilemma Game , 2015, PloS one.

[36]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[37]  G. Szabó,et al.  Impact of aging on the evolution of cooperation in the spatial prisoner's dilemma game. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Wei Wang,et al.  Evolution of cooperation on independent networks: The influence of asymmetric information sharing updating mechanism , 2019, Appl. Math. Comput..

[39]  Attila Szolnoki,et al.  Self-organization towards optimally interdependent networks by means of coevolution , 2014, ArXiv.

[40]  M. Perc,et al.  Social diversity and promotion of cooperation in the spatial prisoner's dilemma game. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Jun Tanimoto,et al.  How does resolution of strategy affect network reciprocity in spatial prisoner's dilemma games? , 2017, Appl. Math. Comput..

[42]  Juan Wang,et al.  Impact of individual difference and investment heterogeneity on the collective cooperation in the spatial public goods game , 2017, Knowl. Based Syst..

[43]  Shao-Meng Qin,et al.  Effect of memory on the prisoner's dilemma game in a square lattice. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[45]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[46]  Juan Wang,et al.  Role of memory effect in the evolution of cooperation based on spatial prisoner's dilemma game , 2018, Physics Letters A.

[47]  Elizabeth Pennisi,et al.  How Did Cooperative Behavior Evolve? , 2005, Science.

[48]  Mao-Bin Hu,et al.  EVOLUTIONARY GAMES IN MULTI-AGENT SYSTEMS OF WEIGHTED SOCIAL NETWORKS , 2009 .

[49]  Jun Tanimoto,et al.  Fundamentals of Evolutionary Game Theory and its Applications , 2015 .

[50]  Juan Wang,et al.  Inferring the reputation enhances the cooperation in the public goods game on interdependent lattices , 2017, Appl. Math. Comput..

[51]  Attila Szolnoki,et al.  Making new connections towards cooperation in the prisoner's dilemma game , 2008, 0811.4372.

[52]  Attila Szolnoki,et al.  Topology-independent impact of noise on cooperation in spatial public goods games. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Ruguo Fan,et al.  Promotion of cooperation induced by heterogeneity of both investment and payoff allocation in spatial public goods game , 2017 .

[54]  Chen Shen,et al.  Reputation-based coevolution of link weights promotes cooperation in spatial prisoner's dilemma game , 2018 .

[55]  M. Nowak,et al.  Evolutionary Dynamics of Biological Games , 2004, Science.

[56]  Yu Kang,et al.  Social diversity promotes cooperation in spatial multigames , 2017 .

[57]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[58]  Juan Wang,et al.  Evolution of cooperation in the spatial public goods game with adaptive reputation assortment , 2016 .

[59]  Han-Xin Yang,et al.  Promoting cooperation by punishing minority , 2018, Appl. Math. Comput..

[60]  Xianbin Cao,et al.  Integrating neighborhoods in the evaluation of fitness promotes cooperation in the spatial prisoner's dilemma game , 2010, ArXiv.

[61]  Jun Tanimoto,et al.  Evolutionary Games with Sociophysics: Analysis of Traffic Flow and Epidemics , 2018 .

[62]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[63]  Zhaojin Xu,et al.  Evolutionary Public Goods Game on Evolving Random Networks , 2018 .

[64]  S. Kokubo,et al.  Insight into the so-called spatial reciprocity. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  Hong Liu,et al.  Cooperation in memory-based prisoner's dilemma game on interdependent networks , 2016 .

[66]  Attila Szolnoki,et al.  Selection of noise level in strategy adoption for spatial social dilemmas. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[67]  S. Kokubo,et al.  Universal scaling for the dilemma strength in evolutionary games. , 2015, Physics of life reviews.

[68]  G. Szabó,et al.  Cooperation in the noisy case: Prisoner's dilemma game on two types of regular random graphs. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  G. Szabó,et al.  Cooperation in spatial prisoner's dilemma with two types of players for increasing number of neighbors. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[70]  György Szabó,et al.  Evolutionary prisoner's dilemma games with voluntary participation. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[71]  M. Perc.  Double resonance in cooperation induced by noise and network variation for an evolutionary prisoner's dilemma , 2006 .

[72]  Changwei Huang,et al.  Preferential selection based on strategy persistence and memory promotes cooperation in evolutionary prisoner’s dilemma games , 2018, Physica A: Statistical Mechanics and its Applications.

[73]  K. M. Ariful Kabir,et al.  Impact of awareness in metapopulation epidemic model to suppress the infected individuals for different graphs , 2019, The European Physical Journal B.

[74]  M. Perc.  Coherence resonance in a spatial prisoner's dilemma game , 2006 .

[75]  Cheng Hong-Yan,et al.  Evolutionary Prisoner's Dilemma on a Weighted Scale-Free Network , 2010 .

[76]  Beom Jun Kim,et al.  Dynamic instabilities induced by asymmetric influence: prisoners' dilemma game in small-world networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[77]  Tom Lenaerts,et al.  A synergy of costly punishment and commitment in cooperation dilemmas , 2016, Adapt. Behav..

[78]  M. Perc,et al.  Doubly effects of information sharing on interdependent network reciprocity , 2018, New Journal of Physics.

[79]  Markus Porto,et al.  Impact of topology on the dynamical organization of cooperation in the prisoner's dilemma game. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[80]  Guangming Xie,et al.  Inertia in strategy switching transforms the strategy evolution. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[81]  Run-Ran Liu,et al.  Effects of Inertia on Evolutionary Prisoner's Dilemma Game , 2012 .

[82]  Jun Tanimoto,et al.  Scaling the phase-planes of social dilemma strengths shows game-class changes in the five rules governing the evolution of cooperation , 2018, Royal Society Open Science.

[83]  Long Wang,et al.  EFFECTS OF LEARNING ACTIVITY ON COOPERATION IN EVOLUTIONARY PRISONER'S DILEMMA GAME , 2008 .

[84]  Aya Hagishima,et al.  Acquisition of the field measurement data relating to lane change actions , 2015 .

[85]  S. Assenza,et al.  Enhancement of cooperation in highly clustered scale-free networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[86]  Alasdair I. Houston,et al.  Variation in behaviour promotes cooperation in the Prisoner's Dilemma game , 2004, Nature.

[87]  Hiromu Ito,et al.  A single ‘weight-lifting’ game covers all kinds of games , 2019, Royal Society Open Science.

[88]  Jun Tanimoto,et al.  Coevolution of discrete, mixed, and continuous strategy systems boosts in the spatial prisoner's dilemma and chicken games , 2017, Appl. Math. Comput..

[89]  M. Perc,et al.  Promoting cooperation in social dilemmas via simple coevolutionary rules , 2008, 0812.1122.

[90]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.