How is the equilibrium of continuous strategy game different from that of discrete strategy game?

Cooperation in the prisoner's dilemma (PD) played on various networks has been explained by so-called network reciprocity. Most of the previous studies presumed that players can offer either cooperation (C) or defection (D). This discrete strategy seems unrealistic in the real world, since actual provisions might not be discrete, but rather continuous. This paper studies the differences between continuous and discrete strategies in two aspects under the condition that the payoff function of the former is a linear interpolation of the payoff matrix of the latter. The first part of this paper proves theoretically that for two-player games, continuous and discrete strategies have different equilibria and game dynamics in a well-mixed but finite population. The second part, conducting a series of numerical experiments, reveals that such differences become considerably large in the case of PD games on networks. Furthermore, it shows, using the Wilcoxon sign-rank test, that continuous and discrete strategy games are statistically significantly different in terms of equilibria. Intensive discussion by comparing these two kinds of games elucidates that describing a strategy as a real number blunts D strategy invasion to C clusters on a network in the early stage of evolution. Thus, network reciprocity is enhanced by the continuous strategy.

[1]  M. Schaffer,et al.  Evolutionarily stable strategies for a finite population and a variable contest size. , 1988, Journal of theoretical biology.

[2]  Brian J. McGill,et al.  Evolutionary Game Theory and Adaptive Dynamics of Continuous Traits , 2007 .

[3]  Hussein A. Abbass,et al.  Mixed strategy and coevolution dynamics in social networks , 2011 .

[4]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[5]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[6]  M. Doebeli,et al.  The evolution of interspecific mutualisms. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[7]  J. Metz,et al.  Adaptive Dynamics: A Geometrical Study of the Consequences of Nearly Faithful Reproduction , 1995 .

[8]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[9]  Jun Tanimoto,et al.  Relationship between dilemma occurrence and the existence of a weakly dominant strategy in a two-player symmetric game , 2007, Biosyst..

[10]  L. Dugatkin,et al.  Tit-For-Tat in guppies (Poecilia reticulata): the relative nature of cooperation and defection during predator inspection , 1991, Evolutionary Ecology.

[11]  Zhen Wang,et al.  Heterogeneous Aspirations Promote Cooperation in the Prisoner's Dilemma Game , 2010, PloS one.

[12]  R. Jiménez,et al.  Gradual learning and the evolution of cooperation in the spatial Continuous Prisoner’s Dilemma , 2009 .

[13]  U. Dieckmann The Dynamical Theory of Coevolution , 1996 .

[14]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .

[15]  Marcus Frean The evolution of degrees of cooperation. , 1996, Journal of theoretical biology.

[16]  Jonathan Roughgarden,et al.  Niche Width: Biogeographic Patterns Among Anolis Lizard Populations , 1974, The American Naturalist.

[17]  D. Fogel,et al.  Evolving continuous behaviors in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[18]  Martin A. Nowak,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2022 .

[19]  R. Cressman,et al.  An ESS maximum principle for matrix games. , 2000, Theoretical population biology.

[20]  Aya Hagishima,et al.  An analysis of network reciprocity in Prisoner's Dilemma games using Full Factorial Designs of Experiment , 2011, Biosyst..

[21]  M. Nowak,et al.  The evolution of stochastic strategies in the Prisoner's Dilemma , 1990 .

[22]  M. Nowak,et al.  The continuous Prisoner's dilemma: II. Linear reactive strategies with noise. , 1999, Journal of theoretical biology.

[23]  Jun Tanimoto,et al.  Differences in dynamics between discrete strategies and continuous strategies in a multi-player game with a linear payoff structure , 2007, Biosyst..

[24]  Peter D. Taylor,et al.  Evolutionary dynamics and stability in discrete and continuous games , 2003 .

[25]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[26]  Martin A. Nowak,et al.  Stochastic evolutionary dynamics of direct reciprocity , 2010, Proceedings of the Royal Society B: Biological Sciences.

[27]  David B. Fogel,et al.  Simulating natural selection as a culling mechanism on finite populations with the hawk-dove game , 2011, Biosyst..

[28]  George H. Weiss,et al.  A First Course in Stochastic Processes, 2nd sd. (Samuel Karlin and Howard M. Taylor) , 1977 .

[29]  Margarita Ifti,et al.  Effects of neighbourhood size and connectivity on the spatial Continuous Prisoner's Dilemma. , 2004, Journal of theoretical biology.

[30]  Peter R. Grant,et al.  Ecology and evolution of Darwin's finches , 1986 .

[31]  Lynette A. Hart,et al.  Reciprocal allogrooming in impala, Aepyceros melampus , 1992, Animal Behaviour.

[32]  Charles R. Brown,et al.  Ecology and Evolution of Darwin’s Finches , 2001, Heredity.

[33]  G. Meszéna,et al.  Speciation in multidimensional evolutionary space. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Benjamin L. Hart,et al.  Reciprocal Allogrooming in Dam‐reared and Hand‐reared Impala Fawns , 2010 .

[35]  D. Fogel,et al.  On the instability of evolutionary stable strategies. , 1997, Bio Systems.

[36]  Drew Fudenberg,et al.  Evolutionary game dynamics in finite populations , 2004, Bulletin of mathematical biology.

[37]  U. Dieckmann,et al.  Evolutionary Optimisation Models and Matrix Games in the Unified Perspective of Adaptive Dynamics , 2002 .

[38]  C. Hauert,et al.  The Evolutionary Origin of Cooperators and Defectors , 2004, Science.

[39]  L M Wahl,et al.  The Continuous Prisoner:s Dilemma: I. Linear Reactive Strategies , 1999 .

[40]  Aya Hagishima,et al.  What controls network reciprocity in the Prisoner's Dilemma game? , 2010, Biosyst..

[41]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[42]  U. Dieckmann,et al.  The Dynamical Theory of Coevolution : A Derivation from Stochastic Ecological Processes , 1996 .

[43]  J. Koella,et al.  The spatial spread of altruism versus the evolutionary response of egoists , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[44]  M. Doebeli,et al.  The Continuous Prisoner’s Dilemma and the Evolution of Cooperation through Reciprocal Altruism with Variable Investment , 2002, The American Naturalist.

[45]  G. Roberts,et al.  Development of cooperative relationships through increasing investment , 1998, Nature.

[46]  J. Hofbauer,et al.  Adaptive dynamics and evolutionary stability , 1990 .

[47]  É. Kisdi,et al.  Dynamics of Adaptation and Evolutionary Branching , 1997 .

[48]  Gary Mar,et al.  CHAOS IN COOPERATION: CONTINUOUS-VALUED PRISONER’S DILEMMAS IN INFINITE-VALUED LOGIC , 1994 .

[49]  M. Doebeli,et al.  Variable investment, the Continuous Prisoner's Dilemma, and the origin of cooperation , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[50]  S. M. Verduyn Lunel,et al.  Stochastic and spatial structures of dynamical systems , 1996 .