Promote of cooperation in networked multiagent system based on fitness control

Abstract How did cooperative strategy evolve remains an open question across disciplines. In most previous studies, they mainly consider the analyzing of game dynamics on the networked multiagent system under different mechanisms. However, there often exists a “government” who regulates the strategies of agents centralized or decentralized in reality. Motivated by this fact, we introduce a fitness control method in this paper, and investigate the strength of external fitness control on the game dynamics in networked multiagent system. According to the classic Monte Carlo simulation, we found that the fitness control rule can significantly enhance the cooperation level in networked multiagent system. In particular, we found that the stronger the local fitness control is, the more widespread cooperative strategy becomes. More interestingly, we found that although the local fitness control is less information needed, it is more powerful in cooperation promotion than that of global fitness control rule. Thus, it is practically significant and will provide a new insight into the control of game dynamics in networked multiagent system for the further research.

[1]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[2]  Xiaoping Zheng,et al.  Cooperative behavior evolution of small groups on interconnected networks , 2015 .

[3]  M. Perc,et al.  Aspiration-based coevolution of link weight promotes cooperation in the spatial prisoner's dilemma game , 2018, Royal Society Open Science.

[4]  C. Hauert,et al.  Reputation-based partner choice promotes cooperation in social networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[6]  Huijia Li,et al.  Punishment diminishes the benefits of network reciprocity in social dilemma experiments , 2017, Proceedings of the National Academy of Sciences.

[7]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[8]  Xiaoping Zheng,et al.  Effect of heterogeneous sub-populations on the evolution of cooperation , 2015, Appl. Math. Comput..

[9]  Francisco C. Santos,et al.  Social Norms of Cooperation With Costly Reputation Building , 2018, AAAI.

[10]  Yamir Moreno,et al.  Reputation drives cooperative behaviour and network formation in human groups , 2015, Scientific Reports.

[11]  Minjie Zhang,et al.  Emotional Multiagent Reinforcement Learning in Spatial Social Dilemmas , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Joel Z. Leibo,et al.  Multi-agent Reinforcement Learning in Sequential Social Dilemmas , 2017, AAMAS.

[13]  Lin Wang,et al.  Evolutionary games on multilayer networks: a colloquium , 2015, The European Physical Journal B.

[14]  Chen Chu,et al.  Coevolution of Vertex Weights Resolves Social Dilemma in Spatial Networks , 2017, Scientific Reports.

[15]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[16]  Gaoxi Xiao,et al.  Opinion formation on multiplex scale-free networks , 2018 .

[17]  Jürgen Kurths,et al.  Onymity promotes cooperation in social dilemma experiments , 2017, Science Advances.

[18]  Matjaž Perc,et al.  Stochastic win-stay-lose-shift strategy with dynamic aspirations in evolutionary social dilemmas. , 2016, Physical review. E.

[19]  Guozhen Tan,et al.  Modelling Adaptive Learning Behaviours for Consensus Formation in Human Societies , 2016, Scientific Reports.

[20]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[21]  Attila Szolnoki,et al.  Second-order freeriding on antisocial punishment restores the effectiveness of prosocial punishment , 2017, bioRxiv.

[22]  Yaonan Wang,et al.  Analysis and Control of Networked Game Dynamics via A Microscopic Deterministic Approach , 2016, IEEE Transactions on Automatic Control.

[23]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[24]  Franz J Weissing,et al.  Consistent individual differences in human social learning strategies , 2014, Nature Communications.

[25]  Long Wang,et al.  Social dilemmas in an online social network: The structure and evolution of cooperation , 2007, physics/0701323.

[26]  Y. Moreno,et al.  Dynamic instability of cooperation due to diverse activity patterns in evolutionary social dilemmas , 2015, 1502.07724.

[27]  Christian Hilbe,et al.  Humans choose representatives who enforce cooperation in social dilemmas through extortion , 2016, Nature Communications.

[28]  Changyin Sun,et al.  An adaptive strategy via reinforcement learning for the prisoner U+02BC s dilemma game , 2018, IEEE/CAA Journal of Automatica Sinica.

[29]  J. J. Arenzon,et al.  Does mobility decrease cooperation? , 2006, Journal of theoretical biology.

[30]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[31]  Brahim Chaib-draa,et al.  Trends in distributed artificial intelligence , 1992, Artificial Intelligence Review.

[32]  Weihua Gui,et al.  Heterogeneous cooperative belief for social dilemma in multi-agent system , 2018, Appl. Math. Comput..

[33]  F C Santos,et al.  Epidemic spreading and cooperation dynamics on homogeneous small-world networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Swami Iyer,et al.  Evolution of Cooperation in Social Dilemmas on Complex Networks , 2016, PLoS Comput. Biol..

[35]  Attila Szolnoki,et al.  Stability of cooperation under image scoring in group interactions , 2015, Scientific Reports.

[36]  S. Kokubo,et al.  Universal scaling for the dilemma strength in evolutionary games. , 2015, Physics of life reviews.

[37]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[38]  Juan Wang,et al.  Evolution of cooperation in the spatial public goods game with adaptive reputation assortment , 2016 .

[39]  Attila Szolnoki,et al.  Reward and cooperation in the spatial public goods game , 2010, ArXiv.

[40]  Long Wang,et al.  Spatial structure favors cooperative behavior in the snowdrift game with multiple interactive dynamics , 2017 .

[41]  Zhen Wang,et al.  Heterogeneous Coupling between Interdependent Lattices Promotes the Cooperation in the Prisoner’s Dilemma Game , 2015, PloS one.

[42]  Cheng-Yi Xia,et al.  Cooperation and strategy coexistence in a tag-based multi-agent system with contingent mobility , 2016, Knowl. Based Syst..

[43]  M. Perc.  Evolution of cooperation on scale-free networks subject to error and attack , 2009, 0902.4661.

[44]  Xiaoping Zheng,et al.  Understanding Cooperative Behavior Based on the Coevolution of Game Strategy and Link Weight , 2015, Scientific Reports.

[45]  Shuai Ding,et al.  Evolution of cooperation in the traveler's dilemma game on two coupled lattices , 2014, Appl. Math. Comput..