Evolutionary Dynamics Under Periodic Switching of Update Rules on Regular Networks

Microscopic strategy update rules play an important role in the evolutionary dynamics of cooperation among interacting agents on complex networks. Many previous related works only consider one \emph{fixed} rule, while in the real world, individuals may switch, sometimes periodically, between rules. It is of particular theoretical interest to investigate under what conditions the periodic switching of strategy update rules facilitates the emergence of cooperation. To answer this question, we study the evolutionary prisoner's dilemma game on regular networks where agents can periodically switch their strategy update rules. We accordingly develop a theoretical framework of this periodically switched system, where the replicator equation corresponding to each specific microscopic update rule is used for describing the subsystem, and all the subsystems are activated in sequence. By utilizing switched system theory, we identify the theoretical condition for the emergence of cooperative behavior. Under this condition, we have proved that the periodically switched system with different switching rules can converge to the full cooperation state. Finally, we consider an example where two strategy update rules, that is, the imitation and pairwise-comparison updating, are periodically switched, and find that our numerical calculations validate our theoretical results.

[1]  Feng Fu,et al.  Eco-evolutionary dynamics of bimatrix games , 2022, Proceedings of the Royal Society A.

[2]  James R. Riehl,et al.  The lower convergence tendency of imitators compared to best responders , 2022, Autom..

[3]  E. Tegling,et al.  Population Games on Dynamic Community Networks , 2022, IEEE Control Systems Letters.

[4]  J. Plotkin,et al.  Evolution of cooperation with contextualized behavior , 2022, Science advances.

[5]  Chengyi Xia,et al.  Adaptive Reputation Promotes Trust in Social Networks , 2021, IEEE Transactions on Network Science and Engineering.

[6]  Pouria Ramazi,et al.  Rationality, Imitation, and Rational Imitation in Spatial Public Goods Games , 2021, IEEE Transactions on Control of Network Systems.

[7]  D. M. V. Hesteren,et al.  Evolutionary Game Theory , 2021, Encyclopedia of Evolutionary Psychological Science.

[8]  Lorenzo Zino,et al.  On imitation dynamics in population games with Markov switching , 2021, 2021 European Control Conference (ECC).

[9]  Feng Fu,et al.  Evolutionary Dynamics of Gig Economy Labor Strategies under Technology, Policy and Market Influence , 2021, Games.

[10]  J. Plotkin,et al.  Evolution of prosocial behaviours in multilayer populations , 2020, Nature Human Behaviour.

[11]  Giacomo Como,et al.  Imitation Dynamics in Population Games on Community Networks , 2020, IEEE Transactions on Control of Network Systems.

[12]  Chen Shen,et al.  Recovering Network Structures Based on Evolutionary Game Dynamics via Secure Dimensional Reduction , 2020, IEEE Transactions on Network Science and Engineering.

[13]  Jianlei Zhang,et al.  Strategy Competition Dynamics of Multi-Agent Systems in the Framework of Evolutionary Game Theory , 2020, IEEE Transactions on Circuits and Systems II: Express Briefs.

[14]  Attila Szolnoki,et al.  Seasonal payoff variations and the evolution of cooperation in social dilemmas , 2019, Scientific Reports.

[15]  Xin Wang,et al.  Steering eco-evolutionary game dynamics with manifold control , 2019, Proceedings of the Royal Society A.

[16]  Martin A. Nowak,et al.  Evolutionary dynamics with game transitions , 2019, Proceedings of the National Academy of Sciences.

[17]  Xiang Li,et al.  Temporal Stable Community in Time-Varying Networks , 2018, IEEE Transactions on Network Science and Engineering.

[18]  M. Nowak,et al.  Evolution of cooperation in stochastic games , 2018, Nature.

[19]  Marco Alberto Javarone,et al.  Heterogeneous update mechanisms in evolutionary games: Mixing innovative and imitative dynamics. , 2017, Physical review. E.

[20]  Feng Fu,et al.  Risk-aware multi-armed bandit problem with application to portfolio selection , 2017, Royal Society Open Science.

[21]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[22]  Nicanor Quijano,et al.  Distributed Population Dynamics: Optimization and Control Applications , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Long Wang,et al.  Evolution of cooperation on temporal networks , 2016, Nature Communications.

[24]  Martin A. Nowak,et al.  Evolutionary dynamics on any population structure , 2016, Nature.

[25]  Francisco C. Santos,et al.  Cooperation dynamics of polycentric climate governance , 2015 .

[26]  D. Floreano,et al.  Evolving Cooperation: From Biology to Engineering , 2014 .

[27]  Francisco C. Santos,et al.  A bottom-up institutional approach to cooperative governance of risky commons , 2013 .

[28]  Ulrik Brandes,et al.  What is network science? , 2013, Network Science.

[29]  A. Denis Rationality , 2012, Encyclopedia of Evolutionary Psychological Science.

[30]  Daniel I. S. Rosenbloom,et al.  Imitation dynamics of vaccination behaviour on social networks , 2011, Proceedings of the Royal Society B: Biological Sciences.

[31]  Long Wang,et al.  Promotion of cooperation induced by appropriate payoff aspirations in a small-world networked game. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  M. Perc,et al.  Social diversity and promotion of cooperation in the spatial prisoner's dilemma game. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Robert van Rooij,et al.  The Stag Hunt and the Evolution of Social Structure , 2007, Stud Logica.

[34]  H. Ohtsuki,et al.  The replicator equation on graphs. , 2006, Journal of theoretical biology.

[35]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[36]  J. Fletcher Evolutionary Game Theory, Natural Selection, and Darwinian Dynamics , 2006, Journal of Mammalian Evolution.

[37]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[38]  M. Perc Coherence resonance in a spatial prisoner's dilemma game , 2006 .

[39]  C. Hauert,et al.  Models of cooperation based on the Prisoner's Dilemma and the Snowdrift game , 2005 .

[40]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[41]  G. Szabó,et al.  Evolutionary prisoner's dilemma game on a square lattice , 1997, cond-mat/9710096.

[42]  L. Blume The Statistical Mechanics of Best-Response Strategy Revision , 1995 .

[43]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[44]  T. Fleming,et al.  Seasonal Foraging Behavior of the Frugivorous Bat Carollia perspicillata , 1986 .

[45]  R. L. Hutto Seasonal Variation in the Foraging Behavior of Some Migratory Western Wood Warblers , 1981 .

[46]  R. Conner Seasonal Changes in Woodpecker Foraging Patterns , 1981 .

[47]  Reginald A. Banez,et al.  Mean Field Game and its Applications in Wireless Networks , 2021, Wireless Networks.

[48]  Ming Cao,et al.  A survey on the analysis and control of evolutionary matrix games , 2018, Annu. Rev. Control..

[49]  Daniel Liberzon,et al.  Switched Systems , 2005, Handbook of Networked and Embedded Control Systems.

[50]  David J. Hill,et al.  Adaptive passification of nonlinear systems , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[51]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[52]  Richard M. Cruse,et al.  Crop rotations for the 21st century , 1994 .

[53]  Colin W. Clark,et al.  Restricted Access to Common-Property Fishery Resources: A Game-Theoretic Analysis , 1980 .