Effects of strategy switching and network topology on decision-making in multi-agent systems

Abstract To study why the altruistic cooperation can emerge and maintain among self-interested individuals, researchers across several disciplines have made contributions for the solutions of this fascinating problem. Among this, a most-often used framework to describe cooperative dilemma is the evolutionary game theory. In traditional settings, an ideal hypothesis that individuals can feasibly obtain related partners' pay-offs for strategy updating is often adopted. However, considering the impracticality in acquiring accurate pay-offs of referential objects at each round of interaction, we propose switching probability which is independent of pay-offs and denotes the willingness of any individual shifts to another strategy. Here we provide results for the evolutionary dynamics driven by the switching probability in a three-strategy game model, played by the fully connected populations. The findings inform the befitting design of switching probabilities which maximally promote cooperation. We also derive general results that characterise the interaction of the three strategies: coexistence of multiple strategies or domination by some strategy.

[1]  Nicholas R. Jennings,et al.  On cooperation in multi-agent systems , 1997, The Knowledge Engineering Review.

[2]  F. Mengel,et al.  Cooperation Through Imitation and Exclusion In Networks , 2011 .

[3]  T. Chu,et al.  The evolution of cooperation in spatial groups , 2011 .

[4]  M. Nowak,et al.  Evolution of cooperation by multilevel selection. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Tobias Galla,et al.  Imitation, internal absorption and the reversal of local drift in stochastic evolutionary games. , 2010, Journal of theoretical biology.

[6]  Steven H. Kim,et al.  Coordination of multiagent systems through explicit valuation of action , 1991 .

[7]  Tianguang Chu,et al.  Elimination mechanism promotes cooperation in coevolutionary prisoner’s dilemma games , 2010 .

[8]  Yutao Tang,et al.  Robust consensus tracking of heterogeneous multi-agent systems under switching topologies , 2015, J. Syst. Sci. Complex..

[9]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[10]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[11]  Jeferson J. Arenzon,et al.  Spatial social dilemmas: Dilution, mobility and grouping effects with imitation dynamics , 2014, 1511.07740.

[12]  A. Colman Game Theory and its Applications: In the Social and Biological Sciences , 1995 .

[13]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[14]  C. Hauert,et al.  Coevolutionary dynamics: from finite to infinite populations. , 2004, Physical review letters.

[15]  Daniele Vilone,et al.  Social imitation versus strategic choice, or consensus versus cooperation, in the networked Prisoner's Dilemma. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Giulio Cimini,et al.  Learning dynamics explains human behaviour in Prisoner's Dilemma on networks , 2014, Journal of The Royal Society Interface.

[17]  Shade T. Shutters,et al.  Punishment Leads to Cooperative Behavior in Structured Societies , 2012, Evolutionary Computation.

[18]  Graham Kendall,et al.  A Strategy with Novel Evolutionary Features for the Iterated Prisoner's Dilemma , 2009, Evolutionary Computation.

[19]  Immanuel M. Bomze,et al.  Lotka-Volterra equation and replicator dynamics: new issues in classification , 1995, Biological Cybernetics.

[20]  Fernando A. C. Gomide,et al.  Design of coordination strategies in multiagent systems via genetic fuzzy systems , 2006, Soft Comput..

[21]  Karl H. Schlag,et al.  Which One Should I Imitate , 1999 .

[22]  G. Szabó,et al.  Defense mechanisms of empathetic players in the spatial ultimatum game. , 2012, Physical review letters.

[23]  L. Blume The Statistical Mechanics of Best-Response Strategy Revision , 1995 .

[24]  Guanghui Wen,et al.  Consensus Tracking of Multi-Agent Systems With Lipschitz-Type Node Dynamics and Switching Topologies , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Chunyan Zhang,et al.  Fixation of strategies driven by switching probabilities in evolutionary games , 2016 .

[26]  Mohamed S. Kamel,et al.  Learning Coordination Strategies for Cooperative Multiagent Systems , 1998, Machine Learning.

[27]  P. Sengottuvelan,et al.  An Approach for CMA Coordination behavior in Teamwork of Multi-Agent System , 2009 .

[28]  Shakti Lamba,et al.  Social learning in cooperative dilemmas , 2014, Proceedings of the Royal Society B: Biological Sciences.

[29]  Soon-Hyung Yook,et al.  Reciprocity in spatial evolutionary public goods game on double-layered network , 2016, Scientific Reports.

[30]  Jianlei Zhang,et al.  Contact-based model for strategy updating and evolution of cooperation , 2016 .

[31]  Garrison W. Greenwood,et al.  The $N$ -Player Trust Game and its Replicator Dynamics , 2016, IEEE Transactions on Evolutionary Computation.

[32]  Toshio Fukuda,et al.  Evolutionary Coordinative Behavior in Multi-agent System Through Learning with Genetic Algorithm , 1993 .

[33]  Franz J Weissing,et al.  Focus on the success of others leads to selfish behavior , 2015, Proceedings of the National Academy of Sciences.

[34]  G. Szabó,et al.  Selection of dynamical rules in spatial Prisoner's Dilemma games , 2009, 0911.0661.

[35]  Ken Nakayama,et al.  Unintended imitation affects success in a competitive game , 2013, Proceedings of the National Academy of Sciences.

[36]  C. Hauert,et al.  Game theory and physics , 2005 .

[37]  A. Griffin,et al.  Cooperation and competition in pathogenic bacteria , 2004, Nature.

[38]  H. Ohtsuki,et al.  Breaking the symmetry between interaction and replacement in evolutionary dynamics on graphs. , 2007, Physical review letters.

[39]  Jianlei Zhang,et al.  Crucial role of strategy updating for coexistence of strategies in interaction networks. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Mehdi Gati,et al.  Analysis of coordination in multi-agent systems through partial difference equationsߞPart I: T , 2005 .

[41]  Jianlei Zhang,et al.  Group penalty on the evolution of cooperation in spatial public goods games , 2010 .