Expedient and Monotone Learning Rules

This paper considers learning rules for environments in which little prior and feedback information is available to the decision maker. Two properties of such learning rules are studied: absolute expediency and monotonicity. Both require that some aspect of the decision maker's performance improves from the current period to the next. The paper provides some necessary, and some sufficient conditions for these properties. It turns out that there is a large variety of learning rules that have the properties. However, all learning rules that have these properties are related to the replicator dynamics of evolutionary game theory. For the case in which there are only two actions, it is shown that one of the absolutely expedient learning rules dominates all others. Copyright The Econometric Society 2004.

[1]  A. Rustichini.  Optimal Properties of Stimulus-Response Learning Models* , 1999 .

[2]  David Easley,et al.  Choice without beliefs , 1999 .

[3]  A. Rubinstein.  Economics and Language , 1999 .

[4]  Tilman Börgers,et al.  Naive Reinforcement Learning With Endogenous Aspiration , 1998 .

[5]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[6]  Drew Fudenberg,et al.  Learning in Games , 1998 .

[7]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[8]  K. Schlag.  Why Imitate, and If So, How?, : A Boundedly Rational Approach to Multi-armed Bandits , 1998 .

[9]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[10]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[11]  L. Samuelson,et al.  Evolutionary Stability in Asymmetric Games , 1992 .

[12]  D. Friedman.  EVOLUTIONARY GAMES IN ECONOMICS , 1991 .

[13]  L. Samuelson,et al.  EVOLUTIONARY STABILITY IN SYMMETRIC GAMES , 1990 .

[14]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .

[15]  J. Cross.  A Stochastic Learning Model of Economic Behavior , 1973 .

[16]  S. Lakshmivarahan,et al.  Absolutely Expedient Learning Algorithms For Stochastic Automata , 1973 .

[17]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[18]  R. R. Bush,et al.  A mathematical model for simple learning. , 1951, Psychological review.