Landscape and flux for quantifying global stability and dynamics of game theory

Game theory has been widely applied to many research areas including economics, biology and social sciences. However, it is still challenging to quantify the global stability and global dynamics of the game theory. We developed a landscape and flux framework to quantify the global stability and global dynamics of the game theory. As an example, we investigated a model of three-strategy game: a special replicator mutator game termed as the repeated Prison Dilemma model. In this model, one stable state, two stable states and limit cycle can emerge under different parameters. The repeated Prisoner’s Dilemma system has Hopf bifurcation from one stable state to limit cycle state, and then to another one stable state or two stable states, and vice versa. We quantified the global stability of the repeated Prisoner’s Dilemma system and identified optimal kinetic paths between the basins of attractor. The optimal paths are irreversible due to the non-zero flux. We also quantified the interplay between Peace and War.

[1]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[2]  J. Schnakenberg.  Network theory of microscopic and macroscopic behavior of master equation systems , 1976 .

[3]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[4]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[5]  Zbigniew Nitecki,et al.  Global Theory of Dynamical Systems , 1980 .

[6]  P. Schuster,et al.  Dynamical Systems Under Constant Organization II: Homogeneous Growth Functions of Degree $p = 2$ , 1980 .

[7]  E. C. Zeeman,et al.  Population dynamics from game theory , 1980 .

[8]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[9]  H. Haken.  Advanced Synergetics: Instability Hierarchies of Self-Organizing Systems and Devices , 1983 .

[10]  Lyapounov function and stationary probability distributions , 1986 .

[11]  R. Graham.  Macroscopic potentials, bifurcations and noise in dissipative systems , 1987 .

[12]  H. Peyton Young,et al.  Stochastic Evolutionary Game Dynamics , 1990 .

[13]  L. Samuelson,et al.  Evolutionary stability in repeated games played by finite automata , 1992 .

[14]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[15]  W. Ebeling.  Stochastic Processes in Physics and Chemistry , 1995 .

[16]  B. Sinervo,et al.  The rock–paper–scissors game and the evolution of alternative male strategies , 1996, Nature.

[17]  P. Swain,et al.  Intrinsic and extrinsic contributions to stochasticity in gene expression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[18]  D. Friedman,et al.  Buyer search and price dispersion:a laboratory study , 2003 .

[19]  Peter G Wolynes,et al.  Stochastic gene expression as a many-body problem , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[20]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[21]  D. Fudenberg,et al.  Evolutionary cycles of cooperation and defection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  P. Ao,et al.  Laws in Darwinian evolutionary theory , 2005, q-bio/0605020.

[23]  Hong Qian,et al.  Open-system nonequilibrium steady state: statistical thermodynamics, fluctuations, and chemical oscillations. , 2006, The journal of physical chemistry. B.

[24]  Jin Wang,et al.  Funneled Landscape Leads to Robustness of Cell Networks: Yeast Cell Cycle , 2006, PLoS Comput. Biol..

[25]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[26]  Jin Wang,et al.  Potential landscape and flux framework of nonequilibrium networks: Robustness, dissipation, and coherence of biochemical oscillations , 2008, Proceedings of the National Academy of Sciences.

[27]  Ian M. Mitchell.  The Flexible, Extensible and Efficient Toolbox of Level Set Methods , 2008, J. Sci. Comput..

[28]  William H. Sandholm,et al.  Evolutionary Game Theory , 2009, Encyclopedia of Complexity and Systems Science.

[29]  H. Qian.  Entropy demystified the "thermo"-dynamics of stochastically fluctuating systems. , 2009, Methods in enzymology.

[30]  Jin Wang,et al.  Kinetic paths, time scale, and underlying landscapes: a path integral framework to study global natures of nonequilibrium systems and networks. , 2010, The Journal of chemical physics.

[31]  Erkang Wang,et al.  Potential and flux landscapes quantify the stability and robustness of budding yeast cell cycle network , 2010, Proceedings of the National Academy of Sciences.

[32]  Hong Qian,et al.  Physical origins of entropy production, free energy dissipation, and their mathematical representations. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Tobias Galla,et al.  Evolutionary dynamics, intrinsic noise, and cycles of cooperation. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  J. Hofbauer.  Deterministic Evolutionary Game Dynamics , 2011 .

[35]  Wei Wang,et al.  Two-phase dynamics of p53 in the DNA damage response , 2011, Proceedings of the National Academy of Sciences.

[36]  Naomi Ehrich Leonard,et al.  Limit cycles in replicator-mutator network dynamics , 2011, IEEE Conference on Decision and Control and European Control Conference.

[37]  Cars H. Hommes,et al.  Multiple equilibria and limit cycles in evolutionary games with Logit Dynamics , 2012, Games Econ. Behav..

[38]  Daniel I. S. Rosenbloom,et al.  Mutation Rate Evolution in Replicator Dynamics , 2012, Bulletin of Mathematical Biology.

[39]  F. Zhang,et al.  The potential and flux landscape theory of evolution. , 2012, The Journal of chemical physics.

[40]  Naomi Ehrich Leonard,et al.  Hopf Bifurcations and Limit Cycles in Evolutionary Network Dynamics , 2012, SIAM J. Appl. Dyn. Syst..

[41]  Jin Wang,et al.  The potential and flux landscape, Lyapunov function and non-equilibrium thermodynamics for dynamic systems and networks with an application to signal-induced Ca2+ oscillation , 2013 .

[42]  Erkang Wang,et al.  The Potential and Flux Landscape Theory of Ecology , 2014, PloS one.

[43]  David G. Rand,et al.  Limit Cycles Sparked by Mutation in the Repeated Prisoner's Dilemma , 2014, Int. J. Bifurc. Chaos.

[44]  Jin Wang,et al.  Exploring the Mechanisms of Differentiation, Dedifferentiation, Reprogramming and Transdifferentiation , 2014, PloS one.

[45]  Jin Wang.  Landscape and flux theory of non-equilibrium dynamical systems with application to biology , 2015 .

[46]  Danielle F. P. Toupo,et al.  Nonlinear dynamics of the rock-paper-scissors game with mutations. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  D. M. V. Hesteren.  Evolutionary Game Theory , 2017 .