Spatial public goods game with continuous contributions based on Particle Swarm Optimization learning and the evolution of cooperation

Abstract How to explain the evolution of cooperation in social dilemmas has plagued the theorists of various disciplines. In this paper, we study the public goods game on two structured populations, assuming that each individual can make a continuous contribution in its strategy space. In our model, individuals have memory and imitation ability. They can remember their best history strategy and learn their best neighbors by obtaining the local information. We use the particle swarm optimization (PSO) algorithm to simulate the learning process of individuals. Two network structures of the square lattice and the nearest-neighbor coupled network are considered respectively. We investigate the combined effects of memory, the invest enhancement and the network structure on the average cooperation level of the population. By simulation experiments, we find that the PSO learning mechanism can promote the evolution of cooperation in a large range of parameters under both of the two kinds of networks. Compared with the square lattice network, the nearest-neighbor coupled network can promote the evolution of cooperation in a larger parameter scope. Compared with the Fermi rule and the Genetic Algorithm learning, the PSO learning can induce the population achieve a wider range of cooperation level, which makes it possible to achieve a higher level of cooperation. These results are conducive to a better understanding of the emergence of cooperation in the real world.

[1]  Matjaz Perc,et al.  Directional learning and the provisioning of public goods , 2015, Scientific Reports.

[2]  Xinxin Fan,et al.  Optimism when winning and cautiousness when losing promote cooperation in the spatial prisoner’s dilemma game , 2014 .

[3]  Soon-Hyung Yook,et al.  Spatial evolutionary public goods game on complete graph and dense complex networks , 2015, Scientific Reports.

[4]  Wei Liu,et al.  Stochastic evolutionary voluntary public goods game with punishment in a Quasi-birth-and-death process , 2017, Scientific Reports.

[5]  Zhaojin Xu,et al.  Self-adjusting rule in spatial voluntary public goods games , 2010 .

[6]  Zhihai Rong,et al.  Effects of aspiration on public cooperation in structured populations , 2012 .

[7]  Run-Ran Liu,et al.  Emergence of cooperation in spatial public goods game with conditional participation , 2013 .

[8]  Matjaz Perc,et al.  Does strong heterogeneity promote cooperation by group interactions? , 2011, ArXiv.

[9]  Attila Szolnoki,et al.  Topology-independent impact of noise on cooperation in spatial public goods games. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Soon-Hyung Yook,et al.  Reciprocity in spatial evolutionary public goods game on double-layered network , 2016, Scientific Reports.

[11]  Ruguo Fan,et al.  Promotion of cooperation induced by heterogeneity of both investment and payoff allocation in spatial public goods game , 2017 .

[12]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[13]  Zhen Wang,et al.  Effects of neighborhood type and size in spatial public goods game on diluted lattice , 2013 .

[14]  Chengbin Peng,et al.  Cooperation and charity in spatial public goods game under different strategy update rules , 2010 .

[15]  James H Fowler,et al.  Altruistic Punishment and the Origin of Cooperation , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Wolfgang J. Luhan,et al.  Cedex Discussion Paper Series , 2022 .

[17]  Yixiao Li,et al.  The coevolution of partner switching and strategy updating in non-excludable public goods game , 2013 .

[18]  Attila Szolnoki,et al.  Phase Diagrams for the Spatial Public Goods Game with Pool-Punishment , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[20]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[21]  F. C. Santos,et al.  Social diversity promotes the emergence of cooperation in public goods games , 2008, Nature.

[22]  Long Wang,et al.  Tolerance-based punishment in continuous public goods game , 2012 .

[23]  Long Wang,et al.  Do not aim too high nor too low: Moderate expectation-based group formation promotes public cooperation on networks , 2014 .

[24]  Long Wang,et al.  Promoting cooperation by local contribution under stochastic win-stay-lose-shift mechanism , 2008 .

[25]  M. Milinski,et al.  Reputation helps solve the ‘tragedy of the commons’ , 2002, Nature.

[26]  Il Hong Suh,et al.  Network topology control strategy based on spatial evolutionary public goods game , 2015 .

[27]  Long Wang,et al.  Social influence promotes cooperation in the public goods game , 2014 .

[28]  M. Perc,et al.  Resolution of the Stochastic Strategy Spatial Prisoner's Dilemma by Means of Particle Swarm Optimization , 2011, PloS one.

[29]  Matjaz Perc,et al.  Success-Driven Distribution of Public Goods Promotes Cooperation but Preserves Defection , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Weini Huang,et al.  Learning process in public goods games , 2015 .

[31]  Zhihai Rong,et al.  The evolutionary public goods game on scale-free networks with heterogeneous investment , 2010 .

[32]  M. Janssen,et al.  Learning, Signaling, and Social Preferences in Public-Good Games , 2006 .

[33]  M. Kirley,et al.  Culture and cooperation in a spatial public goods game. , 2016, Physical review. E.

[34]  M. Perc,et al.  Group-Size Effects on the Evolution of Cooperation in the Spatial Public Goods Game , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Xianjia Wang,et al.  The evolution of cooperation in the Prisoner’s Dilemma and the Snowdrift game based on Particle Swarm Optimization , 2017 .

[36]  Penghui Liu,et al.  Contribution diversity and incremental learning promote cooperation in public goods games , 2017 .

[37]  Hao Wang,et al.  An improved public goods game model with reputation effect on the spatial lattices , 2016 .

[38]  T. Chu,et al.  The evolution of cooperation in spatial groups , 2011 .

[39]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[40]  Long Wang,et al.  Impact of generalized benefit functions on the evolution of cooperation in spatial public goods games with continuous strategies. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  C. Hauert,et al.  Volunteering as Red Queen Mechanism for Cooperation in Public Goods Games , 2002, Science.

[42]  Xianjia Wang,et al.  Evolution of Cooperation in Continuous Prisoner's Dilemma Games on Barabasi—Albert Networks with Degree-Dependent Guilt Mechanism , 2012 .

[43]  Yichuan Jiang,et al.  The maintenance of cooperation in multiplex networks with limited and partible resources of agents , 2017 .

[44]  Yongjie Wang,et al.  Heuristics guide cooperative behaviors in public goods game , 2015 .

[45]  Chengyi Xia,et al.  Enhancement of cooperation in prisoner’s dilemma game on weighted lattices , 2011 .

[46]  Tong Chen,et al.  Emotional decisions in structured populations for the evolution of public cooperation , 2017 .

[47]  Pei Li,et al.  Evolution of cooperation driven by incremental learning , 2015 .

[48]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[49]  Elizabeth Pennisi,et al.  How Did Cooperative Behavior Evolve? , 2005, Science.

[50]  B. Wang,et al.  Critical mass of public goods and its coevolution with cooperation , 2017 .

[51]  Pavel Stopka,et al.  Sociology: The puzzle of human cooperation. , 2003, Nature.

[52]  C. Hauert,et al.  Reward and punishment , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Attila Szolnoki,et al.  Competition of tolerant strategies in the spatial public goods game , 2016, 1607.08600.

[54]  Attila Szolnoki,et al.  Competition and cooperation among different punishing strategies in the spatial public goods game , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[55]  M. Kocher,et al.  The role of beliefs, trust, and risk in contributions to a public good , 2015 .

[56]  Attila Szolnoki,et al.  Decelerated invasion and waning moon patterns in public goods games with delayed distribution , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  Long Wang,et al.  Reputation-based mutual selection rule promotes cooperation in spatial threshold public goods games , 2013 .

[58]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[59]  Zhihai Rong,et al.  Mutual punishment promotes cooperation in the spatial public goods game , 2015 .

[60]  Juan Wang,et al.  Evolution of cooperation in the spatial public goods game with adaptive reputation assortment , 2016 .

[61]  Martin A. Nowak,et al.  Evolutionary dynamics on any population structure , 2016, Nature.

[62]  Matjaž Perc,et al.  Phase transitions in models of human cooperation , 2016 .

[63]  Xianjia Wang,et al.  An evolutionary game based particle swarm optimization algorithm , 2008 .

[64]  Yuan Cheng,et al.  Effect of Heterogeneous Investments on the Evolution of Cooperation in Spatial Public Goods Game , 2015, PloS one.

[65]  Cheng-Yi Xia,et al.  Role of Investment Heterogeneity in the Cooperation on Spatial Public Goods Game , 2014, PloS one.