Learning and mixed-strategy equilibria in evolutionary games

This paper considers whether Maynard Smith's concept of an evolutionarily stable strategy, or “ESS”, can be used to predict long-run strategy frequencies in large populations whose members are randomly paired to play a game, and who adjust their strategies over time according to sensible learning rules. The existing results linking the ESS to stable equilibrium population strategy frequencies when strategies are inherited do not apply to learning, even when each individual always adjusts its strategy in the direction of increased fitness, because the inherited-strategies stability results depend on aggregating across individuals, and this is not possible for learning. The stability of learning must therefore be analyzed for the entire system of individuals' strategy adjustments. The interactions between individuals' adjustments prove to be generically destabilizing at mixed-strategy equilibria, which are saddlepoints of the learning dynamics. Using the inherited-strategies dynamics to describe learning implicitly restricts the system to the stable manifold whose trajectories approach the saddlepoint, masking its instability. Thus, allowing for the interactions between individuals' strategy adjustments extends the widely recognized instability of mixed-strategy equilibria in multi-species inherited-strategies models to single-species (or multi-species) learning models.

[1]  W. Hines,et al.  Evolutionary Stable Strategies: A Review of Basic Theory , 1987 .

[2]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[3]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[4]  E. Akin,et al.  Cevolutionary instability of mixed Nash solutions , 1983, Journal of mathematical biology.

[5]  E. Zeeman Dynamics of the evolution of animal conflicts , 1981 .

[6]  W. G. S. Hines,et al.  On learning and the evolutionarily stable strategy , 1983 .

[7]  M. Schaffer,et al.  Evolutionarily stable strategies for a finite population and a variable contest size. , 1988, Journal of theoretical biology.

[8]  Alasdair I. Houston,et al.  Learning rules, matching and frequency dependence , 1987 .

[9]  D. E. Matthews Evolution and the Theory of Games , 1977 .

[10]  John Maynard Smith,et al.  The logic of asymmetric contests , 1976, Animal Behaviour.

[11]  J. Maynard Smith,et al.  Can a mixed strategy be stable in a finite population , 1988 .

[12]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[13]  V. Crawford Learning behavior and mixed-strategy Nash equilibria , 1985 .

[14]  W. G. S. Hines Multi-species population models and evolutionarily stable strategies , 1981 .

[15]  J. M. Smith The theory of games and the evolution of animal conflicts. , 1974, Journal of theoretical biology.

[16]  W. G. S. Hines,et al.  Strategy stability in complex populations , 1980, Journal of Applied Probability.

[17]  W. Hines Three characterizations of population strategy stability , 1980 .

[18]  E. C. Zeeman,et al.  Population dynamics from game theory , 1980 .

[19]  C. Harley Learning the evolutionarily stable strategy. , 1981, Journal of theoretical biology.

[20]  V. Crawford Learning the Optimal Strategy in a Zero-Sum Game , 1974 .