An experimental analysis of the bandit problem

Summary. We investigate, in an experimental setting, the behavior of single decision makers who at discrete time intervals over an “infinite” horizon may choose one action from a set of possible actions where this set is constant over time, i.e. a bandit problem. Two bandit environments are examined, one in which the predicted behavior should always be myopic (the two-armed bandit) and the other in which the predicted behavior should never be myopic (the one-armed bandit). We also investigate the comparative static predictions as the underlying parameters of the bandit environments are changed. The aggregate results show that the behavior in the two bandit environments are quantitatively different and in the direction of the theoretical predictions.

[1]  Joyce E. Berg,et al.  Controlling Preferences for Lotteries on Units of Experimental Exchange , 1986 .

[2]  Rangarajan K. Sundaram,et al.  A class of bandit problems yielding myopic optimal strategies , 1992, Journal of Applied Probability.

[3]  James C. Cox,et al.  Laboratory experiments with a finite-horizon job-search model , 1989 .

[4]  Louis L. Wilde,et al.  An Information-Theoretic Approach to Job Quits , 1977 .

[5]  Michael H. Birnbaum,et al.  A change-of-process theory for contextual effects and preference reversals in risky decision making , 1992 .

[6]  M. Degroot,et al.  Measuring utility by a single-response sequential method. , 1964, Behavioral science.

[7]  M. Rothschild.  A two-armed bandit theory of market pricing , 1974 .

[8]  Vernon L. Smith,et al.  Inducing risk-neutral preferences: An examination in a controlled market environment , 1990 .

[9]  W. Viscusi,et al.  Job Hazards and Worker Quit Rates: An Analysis of Adaptive Worker Behavior , 1979 .

[10]  Glenn W. Harrison,et al.  SEARCH INTENSITY IN EXPERIMENTS , 1990 .

[11]  Dale T. Mortensen,et al.  Chapter 15 Job search and labor market analysis , 1986 .

[12]  A. Roth,et al.  Game-Theoretic Models and the Role of Information in Bargaining , 1979 .

[13]  M. El-Gamal,et al.  Are People Bayesian? Uncovering Behavioral Strategies , 1995 .

[14]  David M. Grether,et al.  Testing Bayes Rule and the Representativeness Heuristic: Some Experimental Evidence , 1992 .

[15]  David Porter,et al.  An Experimental Analysis of the Two-Armed Bandit Program , 1994 .

[16]  J. Banks,et al.  Denumerable-Armed Bandits , 1992 .

[17]  J. Gower,et al.  Multivariate Statistical Inference , 1977 .

[18]  Paul Hudson.  Studies in the Economics of Search , 1979 .

[19]  H. Akaike.  A new look at the statistical model identification , 1974 .

[20]  Thomas A. Rietz.  Implementing and testing risk-preference-induction mechanisms in experimental sealed-bid auctions , 1993 .

[21]  Robert Forsythe,et al.  COMMUNICATION IN THE BATTLE OF THE SEXES GAME , 1989 .