Learning in Games by Random Sampling

Abstract We study repeated interactions among a fixed set of “low rationality” players who have status quo actions, randomly sample other actions, and change their status quo if the sampled action yields a higher payoff. This behavior generates a random process, the better-reply dynamics. Long run behavior leads to Nash equilibrium in games with the weak finite improvement property, including finite, supermodular games and generic, continuous, two-player, quasi-concave games. If players make mistakes and if several players can sample at the same time, the resulting better-reply dynamics with simultaneous sampling converges to the Pareto optimal Nash equilibrium in common interest games. Journal of Economic Literature Classification Numbers: C70, C72, C73.

[1]  Fernando Vega-Redondo,et al.  Evolution, Games, and Economic Behaviour , 1996 .

[2]  Paul R. Milgrom,et al.  Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities , 1990 .

[3]  J. Weibull,et al.  Strategy subsets closed under rational behavior , 1991 .

[4]  F. Vega-Redondo,et al.  Efficient Equilibrium Selection in Evolutionary Games with Random Matching , 1996 .

[5]  E. Kalai,et al.  Subjective Equilibrium in Repeated Games , 1993 .

[6]  X. Vives Nash equilibrium with strategic complementarities , 1990 .

[7]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .

[8]  J. Jordan Three Problems in Learning Mixed-Strategy Nash Equilibria , 1993 .

[9]  Drew Fudenberg,et al.  Learning Purified Mixed Equilibria , 2000, J. Econ. Theory.

[10]  L. Shapley,et al.  Potential Games , 1994 .

[11]  R. Marimon Learning from learning in economics , 1996 .

[12]  David Easley,et al.  Rational Expectations and Rational Learning , 1993 .

[13]  J. Jordan,et al.  Bayesian learning in normal form games , 1991 .

[14]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[15]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[16]  I. Milchtaich,et al.  Congestion Games with Player-Specific Payoff Functions , 1996 .

[17]  Suzanne Scotchmer,et al.  On the evolution of optimizing behavior , 1991 .

[18]  David M. Kreps,et al.  Learning Mixed Equilibria , 1993 .

[19]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[20]  H. Young,et al.  The Evolution of Conventions , 1993 .

[21]  L. Samuelson Evolutionary Games and Equilibrium Selection , 1997 .

[22]  Paul R. Milgrom,et al.  Adaptive and sophisticated learning in normal form games , 1991 .

[23]  Henk Norde,et al.  A Characterization of Ordinal Potential Games , 1997 .

[24]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[25]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[26]  R. Aumann,et al.  Cooperation and bounded recall , 1989 .

[27]  J. Weibull,et al.  Evolutionary Selection in Normal-Form Games , 1995 .

[28]  H. Young Individual Strategy and Social Structure , 2020 .