Maximization, learning, and economic behavior

The rationality assumption that underlies mainstream economic theory has proved to be a useful approximation, despite the fact that systematic violations to its predictions can be found. That is, the assumption of rational behavior is useful in understanding the ways in which many successful economic institutions function, although it is also true that actual human behavior falls systematically short of perfect rationality. We consider a possible explanation of this apparent inconsistency, suggesting that mechanisms that rest on the rationality assumption are likely to be successful when they create an environment in which the behavior they try to facilitate leads to the best payoff for all agents on average, and most of the time. Review of basic learning research suggests that, under these conditions, people quickly learn to maximize expected return. This review also shows that there are many situations in which experience does not increase maximization. In many cases, experience leads people to underweight rare events. In addition, the current paper suggests that it is convenient to distinguish between two behavioral approaches to improve economic analyses. The first, and more conventional approach among behavioral economists and psychologists interested in judgment and decision making, highlights violations of the rational model and proposes descriptive models that capture these violations. The second approach studies human learning to clarify the conditions under which people quickly learn to maximize expected return. The current review highlights one set of conditions of this type and shows how the understanding of these conditions can facilitate market design.

[1]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[2]  B. Skinner,et al.  Science and human behavior , 1953 .

[3]  M. Allais Le comportement de l'homme rationnel devant le risque : critique des postulats et axiomes de l'ecole americaine , 1953 .

[4]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[5]  S. Weinstock Acquisition and extinction of a partially reinforced running response at a 24-hour intertrial interval. , 1958, Journal of experimental psychology.

[6]  D. Bernoulli Specimen theoriae novae de mensura sortis : translated into German and English , 1967 .

[7]  R. Selten Reexamination of the perfectness concept for equilibrium points in extensive games , 1975, Classics in Game Theory.

[8]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[9]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[10]  M. Kovács Cognitive therapy in depression. , 1980, The Journal of the American Academy of Psychoanalysis.

[11]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[12]  I. Robertson Learned helplessness. , 1986, Nursing times.

[13]  Ronald M. Harstad,et al.  Information Impact and Allocation Rules in Auctions with Affiliated Private Values: A Laboratory Study , 1987 .

[14]  G. Harrison,et al.  An Experimental Evaluation of Weakest Link/Best Shot Models of Public Goods , 1989, Journal of Political Economy.

[15]  D. Gopher,et al.  Practice under changing priorities: An approach to the training of complex skills☆ , 1989 .

[16]  A. Roth,et al.  Considerations of Fairness and Strategy: Experimental Data from Sequential Games , 1992 .

[17]  H. Young,et al.  The Evolution of Conventions , 1993 .

[18]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[19]  D. Fudenberg,et al.  Self-confirming equilibrium , 1993 .

[20]  D. Gopher,et al.  Transfer of Skill from a Computer Game Trainer to Flight , 1994 .

[21]  W. Estes Toward a Statistical Theory of Learning. , 1994 .

[22]  Ken Binmore,et al.  Learning to be imperfect: The ultimatum game , 1995 .

[23]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[24]  I. Gilboa,et al.  Case-Based Decision Theory , 1995 .

[25]  L. Kruschwitz,et al.  Daniel Bernoulli: Entwurf einer neuen Theorie zur Bewertung von Lotterien. “Specimen theoriae novae de mensura sortis”, Commentarii Academiae Scientiarum Imperialis Petropolitanae 1738, S. 175–192. Aus dem Lateinischen übersetzt , 1996 .

[26]  D. Fudenberg,et al.  Measuring Players' Losses in Experimental Games , 1997 .

[27]  Ido Erev,et al.  Equilibrium Play in Large Group Market Entry Games , 1998 .

[28]  Erev,et al.  Organizational Behavior and Human Decision Processes Accidents and Decision Making under Uncertainty: a Comparison of Four Models , 2022 .

[29]  E. Fehr A Theory of Fairness, Competition and Cooperation , 1998 .

[30]  Gary E. Bolton,et al.  ERC: A Theory of Equity, Reciprocity, and Competition , 2000 .

[31]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[32]  A. Rustichini,et al.  A Fine is a Price , 2000, The Journal of Legal Studies.

[33]  K Fiedler Beware of samples! A cognitive-ecological sampling approach to judgment biases. , 2000, Psychological review.

[34]  Y. Kareev Seven (indeed, plus or minus two) and the detection of correlations. , 2000, Psychological review.

[35]  E Yechiam,et al.  On the potential value and limitations of emphasis change and other exploration-enhancing training methods. , 2001, Journal of experimental psychology. Applied.

[36]  L. Samuelson,et al.  Optimization Incentives and Coordination Failure in Laboratory Stag Hunt Games , 2001 .

[37]  J. March,et al.  Adaptation as Information Restriction: The Hot Stove Effect , 2001 .

[38]  William H. Sandholm,et al.  Evolutionary Implementation and Congestion Pricing , 2002 .

[39]  Alvin E. Roth,et al.  The Timing of Bids in Internet Auctions: Market Design, Bidder Behavior, and Artificial Agents , 2001, AI Mag..

[40]  Alvin E. Roth,et al.  An Experimental Analysis of Ending Rules in Internet Auctions , 2003 .

[41]  K. Dobson,et al.  Cognitive therapy of depression: pretreatment patient predictors of outcome. , 2002, Clinical psychology review.

[42]  A. Roth,et al.  Last-Minute Bidding and the Rules for Ending Second-Price Auctions: Evidence from eBay and Amazon Auctions on the Internet , 2002 .

[43]  Cleotilde Gonzalez,et al.  Instance-based learning in dynamic decision making , 2003, Cogn. Sci..

[44]  I. Erev,et al.  Small feedback‐based decisions and their limited correspondence to description‐based decisions , 2003 .

[45]  Atila Abdulkadiroglu,et al.  School Choice: A Mechanism Design Approach , 2003 .

[46]  Joachim Meyer,et al.  Conceptual Issues in the Study of Dynamic Hazard Warnings , 2004, Hum. Factors.

[47]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[48]  Paul Milgrom,et al.  Putting Auction Theory to Work , 2004 .

[49]  I. Erev,et al.  On adaptation, maximization, and reinforcement learning among cognitive strategies. , 2005, Psychological review.

[50]  Parag A. Pathak,et al.  The Boston Public School Match , 2005 .

[51]  E. Yechiam,et al.  The Role of Personal Experience in Contributing to Different Patterns of Response to Rare Terrorist Attacks , 2005 .

[52]  Philippe Jehiel,et al.  Analogy-based expectation equilibrium , 2004, J. Econ. Theory.

[53]  A. Roth,et al.  The Speed of Learning in Noisy Games: Partial Reinforcement and the Sustainability of Cooperation , 2006 .

[54]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[55]  Elena Katok,et al.  Regret in auctions: theory and evidence , 2007 .

[56]  I. Erev,et al.  On the Descriptive Value of Loss Aversion in Decisions under Risk: Six Clarifications , 2007, Judgment and Decision Making.

[57]  Robert van Rooij,et al.  The Stag Hunt and the Evolution of Social Structure , 2007, Stud Logica.

[58]  Robert L. Slonim,et al.  Learning and equilibrium as useful approximations: Accuracy of prediction on randomly selected constant sum games , 2007 .

[59]  Ryan K. Jessup,et al.  Feedback Produces Divergence From Prospect Theory in Descriptive Choice , 2008, Psychological science.

[60]  Greg Barron,et al.  The effect of safe experience on a warnings’ impact: Sex, drugs, and rock-n-roll , 2008 .

[61]  I. Erev,et al.  Perceptual accuracy and conflicting effects of certainty on risk-taking behaviour , 2008, Nature.

[62]  Alvin E. Roth,et al.  Strategy-Proofness Versus Efficiency in Matching with Indifferences: Redesigning the New York City High School Match , 2009 .

[63]  N. Chater,et al.  Are Probabilities Overweighted or Underweighted When Rare Outcomes Are Experienced (Rarely)? , 2009, Psychological science.

[64]  R. Hertwig,et al.  The description–experience gap in risky choice , 2009, Trends in Cognitive Sciences.

[65]  Parag A. Pathak,et al.  Strategy-Proofness versus Efficiency in Matching with Indifferences: Redesigning the NYC High School Match , 2009 .

[66]  I. Erev,et al.  Continuous punishment and the potential of gentle rule enforcement , 2010, Behavioural Processes.

[67]  Timothy J. Pleskac,et al.  Decisions from experience: Why small samples? , 2010, Cognition.

[68]  Ara Darzi,et al.  Evaluation of a clinical communication programme for perioperative and surgical care practitioners , 2010, Quality and Safety in Health Care.

[69]  Alvin E. Roth,et al.  A Choice Prediction Competition for Market Entry Games: An Introduction , 2010, Games.

[70]  G. Doniger,et al.  To give or not to give: Parental experience and adherence to the Food and Drug Administration warning about over-the-counter cough and cold medicine usage , 2010, Judgment and Decision Making.

[71]  Ben R. Newell,et al.  Degrees of uncertainty: An overview and framework for future research on experience‐based choice , 2010 .

[72]  A. Lyndon,et al.  Skilful anticipation: maternity nurses' perspectives on maintaining safety , 2010, Quality and Safety in Health Care.

[73]  Alvin E. Roth,et al.  A choice prediction competition: Choices from experience and from description , 2010 .

[74]  Ken Binmore,et al.  Experimental economics: Where next? , 2010 .

[75]  Y. Donchin,et al.  The value of ‘gentle reminder’ on safe medical behaviour , 2010, Quality and Safety in Health Care.

[76]  P. Wakker Prospect Theory: For Risk and Ambiguity , 2010 .

[77]  José Suárez-Lledó,et al.  The Black Swan: The Impact of the Highly Improbable , 2011 .

[78]  Cleotilde González,et al.  Effects of feedback and complexity on repeated decisions from description , 2011 .

[79]  Wei Chen,et al.  Bounded Memory, Inertia, Sampling and Weighting Model for Market Entry Games , 2011, Games.

[80]  Reinhard Selten,et al.  Dealing with Dynamic Decision Problems when Knowledge of the Environment Is Limited: An Approach Based on Goal Systems , 2012 .

[81]  I. Erev,et al.  On Surprise, Change, and the Effect of Recent Outcomes , 2011, Front. Psychology.

[82]  I. Erev,et al.  Decisions among defaults and the effect of the option to do nothing , 2012 .

[83]  I. Erev,et al.  The experience-description gap and the role of the inter decision interval. , 2013, Progress in brain research.

[84]  Gary E. Bolton,et al.  Learning and the Economics of Small Decisions , 2013 .

[85]  L. S. Shapley,et al.  College Admissions and the Stability of Marriage , 2013, Am. Math. Mon..

[86]  I. Erev,et al.  The effect of unpleasant experiences on evaluation and behavior , 2014 .

[87]  Kinneret Teodorescu,et al.  On the Decision to Explore New Alternatives: The Coexistence of Under‐ and Over‐exploration , 2014 .

[88]  R. Hertwig Decisions from Experience , 2015 .

[89]  Ido Erev,et al.  Noisy retrieval models of over- and undersensitivity to rare events , 2015 .

[90]  The 1-800 Critique, Counterexamples, and the Future of Behavioral Economics , 2015 .