Chapter 19 Agent-Based Models and Human Subject Experiments

Abstract This chapter examines the relationship between agent-based modeling and economic decision-making experiments with human subjects. Both approaches exploit controlled “laboratory” conditions as a means of isolating the sources of aggregate phenomena. Research findings from laboratory studies of human subject behavior have inspired studies using artificial agents in “computational laboratories” and vice versa. In certain cases, both methods have been used to examine the same phenomenon. The focus of this chapter is on the empirical validity of agent-based modeling approaches in terms of explaining data from human subject experiments. We also point out synergies between the two methodologies that have been exploited as well as promising new possibilities.

[1]  Klaus Krickeberg,et al.  Markov learning models for multiperson interactions , 1962 .

[2]  J. Duffy,et al.  Using Symbolic Regression to Infer Strategies from Experimental Data , 2002 .

[3]  D. Friedman A simple testable model of double auction markets , 1991 .

[4]  E. Hopkins Two Competing Models of How People Learn in Games (first version) , 1999 .

[5]  R. Sarin,et al.  Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice , 1999 .

[6]  Leigh Tesfatsion,et al.  Market power and efficiency in a computational electricity market with discriminatory double-auction pricing , 2001, IEEE Trans. Evol. Comput..

[7]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[8]  Joep Sonnemans,et al.  The Instability of a Heterogeneous Cobweb economy: a Strategy Experiment on Expectation Formation , 2004 .

[9]  W. Arthur Designing Economic Agents that Act Like Human Agents: A Behavioral Approach to Bounded Rationality , 1991 .

[10]  John Duffy,et al.  Learning, information, and sorting in market entry games: theory and evidence , 2005, Games Econ. Behav..

[11]  John O. Ledyard,et al.  Scaling Up Learning Models in Public Good Games , 2004 .

[12]  M. Bray,et al.  Rational Expectations Equilibria, Learning, and Model Specification , 1986 .

[13]  Jasmina Arifovic,et al.  Social vs. Individual Learning - What Makes a Difference? , 2004 .

[14]  Ross M. Miller Paving Wall Street: Experimental Economics and the Quest for the Perfect Market , 2002 .

[15]  J. Duffy,et al.  Emergence of money as a medium of exchange: An experimental study , 1999 .

[16]  Nick Feltovich,et al.  Reinforcement-based vs. Belief-based Learning Models in Experimental Asymmetric-information Games , 2000 .

[17]  Dave Cliff,et al.  More than Zero Intelligence Needed for Continuous Double-Auction Trading , 1997 .

[18]  O. H. Brownlee,et al.  ACTIVITY ANALYSIS OF PRODUCTION AND ALLOCATION , 1952 .

[19]  Jasmina Arifovic,et al.  Genetic algorithms and inflationary economies , 1995 .

[20]  Ramon Marimon,et al.  Expectations and learning under alternative monetary regimes: an experimental approach , 1994 .

[21]  H. Sauermann Beiträge zur experimentellen Wirtschaftsforschung , 1967 .

[22]  Shu-Heng Chen,et al.  Equilibrium Selection via Adaptation: Using Genetic Programming to Model Learning in a Coordination Game , 2005 .

[23]  Dhananjay K. Gode,et al.  Allocative Efficiency of Markets with Zero-Intelligence Traders: Market as a Partial Substitute for Individual Rationality , 1993, Journal of Political Economy.

[24]  Reiner Franke,et al.  Reinforcement learning in the El Farol model , 2003 .

[25]  Nicolaas J. Vriend,et al.  An Illustration of the Essential Difference between Individual and Social Learning, and its Consequences for Computational Analyses , 1998 .

[26]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[27]  Shyam Sunder,et al.  Tracking the Invisible Hand: Convergence of Double Auctions toCompetitive Equilibrium , 2000 .

[28]  Michael M. Ting,et al.  A Behavioral Model of Turnout , 2003, American Political Science Review.

[29]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[30]  Charles R. Plott,et al.  Price Controls and the Behavior of Auction Markets: An Experimental Examination , 1981 .

[31]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .

[32]  Herbert Dawid,et al.  Adaptive Learning by Genetic Algorithms, Analytical Results and Applications to Economic Models, 2nd extended and revised edition , 1999 .

[33]  V. Smith,et al.  Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets , 1988 .

[34]  H. Uhlig,et al.  Rules of Thumb versus Dynamic Programming , 1999 .

[35]  H. Simon,et al.  Models of Bounded Rationality: Empirically Grounded Economic Reason , 1997 .

[36]  J. Kagel,et al.  The Winner's Curse and Public Information in Common Value Auctions: Comment , 1999 .

[37]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[38]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[39]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[40]  John A. Carlson,et al.  An Invariably Stable Cobweb Model , 1968 .

[41]  B. LeBaron Agent-based Computational Finance , 2006 .

[42]  J. Cross A theory of adaptive economic behavior , 1983 .

[43]  Jonathan Bendor,et al.  Aspiration-Based Reinforcement Learning in Repeated Games: An Overview , 2001 .

[44]  A. Sadrieh The Alternating Double Auction Market: A Game Theoretic and Experimental Investigation , 1998 .

[45]  Ken Binmore,et al.  Frontiers of game theory , 1993 .

[46]  Jasmina Arifovic,et al.  The Behavior of the Exchange Rate in the Genetic Algorithm and Experimental Economies , 1996, Journal of Political Economy.

[47]  Leigh Tesfatsion,et al.  Non-Employment Benefits and the Evolution of Worker-Employer Cooperation: Experiments with Real and Computational Agents , 2001 .

[48]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[49]  N. Kiyotaki,et al.  On Money as a Medium of Exchange , 1989, Journal of Political Economy.

[50]  Daniel Friedman,et al.  Learning in evolutionary games: some laboratory results , 1997 .

[51]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[52]  J. Kagel,et al.  The Dynamics of Reorganization in Matching Markets: A Laboratory Experiment Motivated by a Natural Experiment , 2000 .

[53]  Colin Camerer,et al.  Experience‐weighted Attraction Learning in Normal Form Games , 1999 .

[54]  W. Brian Arthur,et al.  On designing economic agents that behave like human agents , 1993 .

[55]  Neil Wallace,et al.  On the indeterminacy of equilibrium exchange rates , 1981 .

[56]  David F. Batten,et al.  Discovering Artificial Economics , 2000 .

[57]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[58]  Chun-Lei Yang,et al.  The Hot Versus Cold Effect in a Simple Bargaining Experiment , 2003 .

[59]  J. Duffy,et al.  Using Genetic Algorithms to Model the Evolution of Heterogeneous Beliefs , 1999 .

[60]  V. Smith An Experimental Study of Competitive Market Behavior , 1962, Journal of Political Economy.

[61]  Thomas Riechmann,et al.  Learning and behavioral stability An economic interpretation of genetic algorithms , 1999 .

[62]  V. Smith,et al.  Research in Experimental Economics , 1979 .

[63]  A. Roth Introduction to Experimental Economics , 2004 .

[64]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[65]  Shu-Heng Chen,et al.  Genetic Algorithms and Genetic Programming in Computational Finance , 2002 .

[66]  James G. March,et al.  Organizational Factors in the Theory of Oligopoly , 1956 .

[67]  Richard T. Boylan,et al.  Fictitious Play: A Statistical Study of Multiple Economic Experiments , 1993 .

[68]  Colin Camerer Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[69]  Robert E. Lucas,et al.  Adaptive Behavior and Economic Theory , 1986 .

[70]  Timothy C. Salmon An Evaluation of Econometric Models of Adaptive Learning , 2001 .

[71]  K. Judd Numerical methods in economics , 1998 .

[72]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[73]  Shyam Sunder,et al.  Double Auction Dynamics: Structural Effects of Non-Binding Price Controls , 2003 .

[74]  D. Friedman Equilibrium in Evolutionary Games: Some Experimental Results , 1996 .

[75]  Paul M. Brown Experimental evidence on money as a medium of exchange , 1996 .

[76]  Leigh Tesfatsion,et al.  Appendix A A Guide for Newcomers to Agent-Based Modeling in the Social Sciences⁎ , 2006 .

[77]  John B. Van Huyck,et al.  Adaptive behavior and coordination failure , 1997 .

[78]  Alvin E. Roth,et al.  The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models , 1999 .

[79]  Shu-Heng Chen Evolutionary Computation in Economics and Finance , 2002 .

[80]  Robin Pemantle,et al.  Network formation by reinforcement learning: the long and medium run , 2004, Math. Soc. Sci..

[81]  R. Selten,et al.  Duopoly Strategies Programmed by Experienced Players , 1997 .

[82]  Andreas Blume,et al.  Learning and communication in sender-receiver games: an econometric investigation , 2002 .

[83]  S. Sunder Lower Bounds for Efficiency of Surplus Extraction in Double Auctions , 1992 .

[84]  Daniel Friedman,et al.  A comparison of learning and replicator dynamics using experimental data , 1998 .

[85]  Jasmina Arifovic Genetic algorithm learning and the cobweb model , 1994 .

[86]  Dilip Mookherjee,et al.  Learning and Decision Costs in Experimental Constant Sum Games , 1997 .

[87]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[88]  T. Sargent Bounded rationality in macroeconomics , 1993 .

[89]  John H. Miller,et al.  Auctions with Artificial Adaptive Agents , 1995 .

[90]  Jonathan Bendor,et al.  Aspiration-Based Reinforcement Learning in Repeated Interaction Games: an Overview , 2001, IGTR.

[91]  T. Poggio,et al.  Agent-Based Models of Financial Markets: A Comparison with Experimental Markets , 2001 .

[92]  Tilman Börgers,et al.  Naive Reinforcement Learning With Endogenous Aspirations , 2000 .

[93]  Debraj Ray,et al.  Evolving Aspirations and Cooperation , 1998 .

[94]  R. Battalio,et al.  Selection Dynamics, Asymptotic Stability, and Adaptive Behavior , 1994, Journal of Political Economy.

[95]  H. Young,et al.  The Evolution of Conventions , 1993 .

[96]  Thomas Riechmann,et al.  Learning in Economics: Analysis and Application of Genetic Algorithms , 2001 .

[97]  J. Dickhaut,et al.  Price Formation in Double Auctions , 1998 .

[98]  Ronald M. Harstad,et al.  Information Impact and Allocation Rules in Auctions with Affiliated Private Values: A Laboratory Study , 1987 .

[99]  Charles R. Plott,et al.  DIVISION OF THE HUMANITIES AND SOCIAL SCIENCES CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA, CALIFORNIA 91125 ON THE BEHAVIORAL FOUNDATIONS OF THE LAW OF SUPPLY AND DEMAND: HUMAN CONVERGENCE AND ROBOT RANDOMNESS , 2001 .

[100]  H. Peyton Young,et al.  Individual Strategy and Social Structure , 2020 .

[101]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[102]  John Duffy,et al.  Does observation of others affect learning in strategic environments? An experimental study , 1999, Int. J. Game Theory.

[103]  J. Geweke,et al.  Economic Complexity: Chaos, Sunspots, Bubbles, and Nonlinearity. , 1990 .

[104]  Alvin E. Roth,et al.  Equilibrium behavior and repeated play of the prisoner's dilemma , 1978 .

[105]  J. Ledyard,et al.  Theories of price formation and exchange in double oral auctions , 1986 .

[106]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[107]  Thomas Brenner,et al.  Agent Learning Representation - Advice in Modelling Economic Learning , 2004 .

[108]  J. Kagel,et al.  Handbook of Experimental Economics , 1997 .

[109]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[110]  K. Judd Computational Economics and Economic Theory: Substitutes or Complements , 1997 .

[111]  Dhananjay K. Gode,et al.  What Makes Markets Allocationally Efficient , 1997 .

[112]  Dilip Mookherjee,et al.  Learning behavior in an experimental matching pennies game , 1994 .

[113]  Erdem Basci Learning by imitation , 1999 .

[114]  Jamie L. Brown-Kruse Contestability in the presence of an alternate market: an experimental examination , 1991 .

[115]  Thomas Riechmann Cournot or Walras? Agent based learning, rationality, and long run results in oligopoly games , 2002 .

[116]  A. Schotter,et al.  An Experimental Study of Belief Learning Using Elicited Beliefs , 2002 .

[117]  Jens Grossklags,et al.  Artificial software agents on thin double auction markets: a human trader experiment , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[118]  Cars H. Hommes,et al.  Dynamics of the cobweb model with adaptive expectations and nonlinear supply and demand , 1994 .

[119]  Kathleen Valley,et al.  How Communication Improves Efficiency in Bargaining Games , 2002, Games Econ. Behav..

[120]  L. Samuelson,et al.  Optimization Incentives and Coordination Failure in Laboratory Stag Hunt Games , 2001 .

[121]  John Duffy,et al.  Asset price bubbles and crashes with near-zero-intelligence traders , 2004 .

[122]  E. Chamberlin,et al.  An Experimental Imperfect Market , 1948, Journal of Political Economy.

[123]  M. Wellman,et al.  Automated Markets and Trading Agents , 2007 .

[124]  Colin Camerer,et al.  Cognition and framing in sequential bargaining for gains and losses , 1993 .

[125]  W. Arthur Inductive Reasoning and Bounded Rationality , 1994 .

[126]  R. Palmer,et al.  Asset Pricing Under Endogenous Expectations in an Artificial Stock Market , 1996 .

[127]  V. Smith,et al.  Papers in Experimental Economics: Theory and Behavior of Single Object Auctions , 1982 .

[128]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[129]  John Duffy,et al.  Intrinsically Worthless Objects as Media of Exchange: Experimental Evidence , 2002 .

[130]  J. Robinson AN ITERATIVE METHOD OF SOLVING A GAME , 1951, Classics in Game Theory.

[131]  Philip Mirowski Machine Dreams Economics Becomes a Cyborg Science , 2001 .

[132]  Herbert Dawid,et al.  On the convergence of genetic learning in a double auction market , 1999 .

[133]  Vernon L. Smith,et al.  On Nonbinding Price Controls in a Competitive Market , 1981 .

[134]  M. Utku Ünver,et al.  Backward Unraveling over Time: The Evolution of Strategic Behavior in the Entry-Level British Medical Labor Markets , 2001 .

[135]  D. Polani,et al.  Learning competitive pricing strategies by multi-agent reinforcement learning , 2003 .

[136]  Nathaniel T. Wilcox,et al.  Avoidable Cost: Ride a Double Auction Roller Coaster , 1996 .

[137]  Vernon L. Smith,et al.  Market Contestability in the Presence of Sunk (Entry) Costs , 1984 .

[138]  Alvin E. Roth,et al.  The Dynamics of Law Clerk Matching: An Experimental and Computational Investigation of Proposals for Reform of the Market , 2001 .

[139]  Colin Camerer,et al.  Economic Value of EWA Lite: A Functional Theory of Learning in Games , 2001 .

[140]  Ellen R. McGrattan,et al.  Money as a medium of exchange in an economy with artificially intelligent agents , 1990 .

[141]  K Sigmund,et al.  The theory of evolution and dynamic systems mathematical aspects of selection , 1984 .

[142]  J. Duffy Learning to speculate: Experiments with artificial and real agents , 2001 .

[143]  Chia-Hsuan Yeh,et al.  Genetic programming learning and the Cobweb model , 1996 .

[144]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[145]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[146]  M. Utku Ünver On the Survival of Some Unstable Two-Sided Matching Mechanisms: An Experimental and Computational Investigation of the Stability Hypothesis , 2001 .

[147]  Bereby-Meyer,et al.  On Learning To Become a Successful Loser: A Comparison of Alternative Abstractions of Learning Processes in the Loss Domain. , 1998, Journal of mathematical psychology.

[148]  S. Sunder,et al.  Indeterminacy of Equilibria in a Hyperinflationary World: Experimental Evidence , 1993 .

[149]  John Duffy,et al.  A model of learning and emulation with artificial adaptive agents , 1998 .

[150]  Daniel Friedman,et al.  Individual Learning in Normal Form Games: Some Laboratory Results☆☆☆ , 1997 .

[151]  T. Schelling Micromotives and Macrobehavior , 1978 .

[152]  H. Peyton Young,et al.  Stochastic Evolutionary Game Dynamics , 1990 .

[153]  Dale O. Stahl,et al.  Journal of Economic Behavior & Organization , 1999 .

[154]  R. Selten Evolution, learning, and economic behavior , 1991 .

[155]  I. Erev,et al.  On adaptation, maximization, and reinforcement learning among cognitive strategies. , 2005, Psychological review.

[156]  S. Sunder,et al.  A Simple Decentralized Institution for Learning Competitive Equilibrium , 2002 .

[157]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[158]  V. Smith Microeconomic Systems as an Experimental Science , 1982 .

[159]  R. Axelrod,et al.  The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration , 1998 .

[160]  Glenn Ellison Learning, Local Interaction, and Coordination , 1993 .

[161]  J. Ochs Games with Unique, Mixed Strategy Equilibria: An Experimental Study , 1995 .

[162]  L. Shapley,et al.  College Admissions and the Stability of Marriage , 1962 .

[163]  Farshid Vahid,et al.  Predicting How People Play Games: A Simple Dynamic Model of Choice , 2001, Games Econ. Behav..

[164]  T. Riechmann Genetic algorithm learning and evolutionary games , 2001 .

[165]  L. Marengo,et al.  A learning-to-forecast experiment on the foreign exchange market with a classifier system , 1997 .