A survey on the analysis and control of evolutionary matrix games

Abstract In support of the growing interest in how to efficiently influence complex systems of interacting self-interested agents, we present this review of fundamental concepts, emerging research, and open problems related to the analysis and control of evolutionary matrix games, with particular emphasis on applications in social, economic, and biological networks.

[1]  Mark S. Granovetter.  Threshold Models of Collective Behavior , 1978, American Journal of Sociology.

[2]  H. Ohtsuki,et al.  The replicator equation on graphs. , 2006, Journal of theoretical biology.

[3]  Ming Cao,et al.  Towards Optimal Control of Evolutionary Games on Networks , 2017, IEEE Transactions on Automatic Control.

[4]  Josef Hofbauer,et al.  The theory of evolution and dynamical systems , 1988 .

[5]  Hildeberto Jardón-Kojakhmetov,et al.  Limit sets within curves where trajectories converge to , 2017, Appl. Math. Lett..

[6]  Immanuel M. Bomze,et al.  Lotka-Volterra equation and replicator dynamics: new issues in classification , 1995, Biological Cybernetics.

[7]  Jason R. Marden,et al.  Game Theory and Distributed Control , 2015 .

[8]  I. Gilboa,et al.  Social Stability and Equilibrium , 1991 .

[9]  Yasuhiko Fukumoto,et al.  A control method of selfish routing based on replicator dynamics with capitation tax and subsidy , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[10]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[11]  Nicanor Quijano,et al.  Distributed Population Dynamics: Optimization and Control Applications , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Franz J. Weissing,et al.  Evolutionary stability and dynamic stability in a class of evolutionary normal form games , 1991 .

[13]  John Nachbar.  “Evolutionary” selection dynamics in games: Convergence and limit properties , 1990 .

[14]  Zhen Liu,et al.  THE EFFECT OF PINNING CONTROL ON EVOLUTIONARY PRISONER'S DILEMMA GAME , 2010 .

[15]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[16]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[17]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Josef Hofbauer,et al.  A general cooperation theorem for hypercycles , 1981 .

[19]  Daizhan Cheng,et al.  Modeling, Analysis and Control of Networked Evolutionary Games , 2015, IEEE Transactions on Automatic Control.

[20]  Eitan Altman,et al.  Evolutionary Games in Wireless Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Ming Cao,et al.  Control of Stochastic Evolutionary Games on Networks , 2015 .

[22]  I. Bomze.  Non-cooperative two-person games in biology: A classification , 1986 .

[23]  E. C. Zeeman,et al.  Population dynamics from game theory , 1980 .

[24]  Xiaohua Xia,et al.  Evolutionary game theoretic demand-side management and control for a class of networked smart grid , 2016, Autom..

[25]  Ronald Aylmer Sir Fisher,et al.  The genetical theory of natural selection: a complete variorum edition. , 1999 .

[26]  Ming Cao,et al.  Stability analysis for replicator dynamics of evolutionary snowdrift games , 2014, 53rd IEEE Conference on Decision and Control.

[27]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[28]  Akihiko Matsui,et al.  Best response dynamics and socially stable strategies , 1992 .

[29]  Josef Hofbauer,et al.  Refined best reply correspondence and dynamics , 2013 .

[30]  Eduardo Ramírez-Llanos,et al.  A distributed dynamics for virus-spread control , 2017, Autom..

[31]  Bahman Gharesifard,et al.  On the Convergence of Piecewise Linear Strategic Interaction Dynamics on Networks , 2016, IEEE Transactions on Automatic Control.

[32]  Yasuhiko Fukumoto,et al.  Replicator dynamics with Pigovian subsidy and capitation tax , 2009 .

[33]  Pouria Ramazi,et al.  Convergence analysis and control of evolutionary matrix-game dynamics , 2017 .

[34]  Yuzhen Wang,et al.  Algebraic formulation and strategy optimization for a class of evolutionary networked games via semi-tensor product method , 2013, Autom..

[35]  Yi Tao,et al.  The replicator equation and other game dynamics , 2014, Proceedings of the National Academy of Sciences.

[36]  Nicanor Quijano,et al.  The Role of Population Games and Evolutionary Dynamics in Distributed Control Systems: The Advantages of Evolutionary Game Theory , 2017, IEEE Control Systems.

[37]  Nicanor Quijano,et al.  Shahshahani gradient-like extremum seeking , 2015, Autom..

[38]  K. Schlag.  Why Imitate, and If So, How?, : A Boundedly Rational Approach to Multi-armed Bandits , 1998 .

[39]  Lacra Pavel,et al.  Game Theory for Control of Optical Networks , 2012 .

[40]  William H. Sandholm,et al.  Evolutionary Implementation and Congestion Pricing , 2002 .

[41]  Eitan Altman,et al.  The evolution of transport protocols: An evolutionary game perspective , 2009, Comput. Networks.

[42]  Giacomo Como,et al.  On imitation dynamics in potential population games , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[43]  Josef Hofbauer,et al.  On the occurrence of limit cycles in the Volterra-Lotka equation , 1981 .

[44]  Jeff S. Shamma,et al.  Unified convergence proofs of continuous-time fictitious play , 2004, IEEE Transactions on Automatic Control.

[45]  Wenwu Yu,et al.  Distributed Adaptive Control of Synchronization in Complex Networks , 2012, IEEE Transactions on Automatic Control.

[46]  Andres Pantoja,et al.  Distributed optimization using population dynamics with a local replicator equation , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[47]  K Sigmund,et al.  A note on evolutionary stable strategies and game dynamics. , 1979, Journal of theoretical biology.

[48]  Ming Cao,et al.  Minimal-agent control of evolutionary games on tree networks , 2014 .

[49]  Toshimitsu Ushio,et al.  Subsidy-Based Control of Heterogeneous Multiagent Systems Modeled by Replicator Dynamics , 2016, IEEE Transactions on Automatic Control.

[50]  M. Nowak,et al.  Evolutionary dynamics in structured populations , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[51]  Sonia Martínez,et al.  Self-Triggered Best-Response Dynamics for Continuous Games , 2015, IEEE Transactions on Automatic Control.

[52]  E. Akin,et al.  Dynamics of games and genes: Discrete versus continuous time , 1983 .

[53]  Heinrich H. Nax,et al.  A Behavioral Study of 'Noise' in Coordination Games , 2015, J. Econ. Theory.

[54]  Guangming Xie,et al.  Emergence of leadership in a robotic fish group under diverging individual personality traits , 2017, Royal Society Open Science.

[55]  Gang George Yin,et al.  Adaptive Search Algorithms for Discrete Stochastic Optimization: A Smooth Best-Response Approach , 2014, IEEE Transactions on Automatic Control.

[56]  Arne Traulsen,et al.  Human strategy updating in evolutionary games , 2010, Proceedings of the National Academy of Sciences.

[57]  Ming Cao,et al.  Evolutionary Dynamics of Homophily and Heterophily , 2016, Scientific Reports.

[58]  Dario Madeo,et al.  Game Interactions and Dynamics on Networked Populations , 2015, IEEE Transactions on Automatic Control.

[59]  Nicanor Quijano,et al.  Dynamical tuning for MPC using population games: A water supply network application. , 2017, ISA transactions.

[60]  Ming Cao,et al.  Networks of conforming or nonconforming individuals tend to reach satisfactory decisions , 2016, Proceedings of the National Academy of Sciences.

[61]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[62]  Martin Hoefer,et al.  Concurrent imitation dynamics in congestion games , 2009, PODC '09.

[63]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[64]  Bahman Gharesifard,et al.  Stability properties of infected networks with low curing rates , 2014, 2014 American Control Conference.

[65]  Zhi Xu,et al.  Distributed Evaluation and Convergence of Self-Appraisals in Social Networks , 2017, IEEE Trans. Autom. Control..

[66]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[67]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[68]  Andrea Montanari,et al.  The spread of innovations in social networks , 2010, Proceedings of the National Academy of Sciences.

[69]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[70]  William Poundstone,et al.  Prisoner's Dilemma: John Von Neumann, Game Theory and the Puzzle of the Bomb , 1992 .

[71]  Jeff S. Shamma,et al.  Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria , 2005, IEEE Transactions on Automatic Control.

[72]  Jason R. Marden,et al.  Designing Games for Distributed Optimization , 2013, IEEE J. Sel. Top. Signal Process..

[73]  Franz J Weissing,et al.  Focus on the success of others leads to selfish behavior , 2015, Proceedings of the National Academy of Sciences.

[74]  William H. Sandholm,et al.  Pigouvian pricing and stochastic evolutionary implementation , 2007, J. Econ. Theory.

[75]  I. Bomze.  Lotka-Volterra equation and replicator dynamics: A two-dimensional classification , 1983, Biological Cybernetics.

[76]  Nicanor Quijano,et al.  A population dynamics approach for the water distribution problem , 2010, Int. J. Control.

[77]  Xiao Fan Wang,et al.  Analysis and shifting of stochastically stable equilibria for evolutionary snowdrift games , 2015, Syst. Control. Lett..