Decision-Making Under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires

We find consistent evidence of negative autocorrelation in decision-making that is unrelated to the merits of the cases considered in three separate high-stakes field settings: refugee asylum court decisions, loan application reviews, and major league baseball umpire pitch calls. The evidence is most consistent with the law of small numbers and the gambler's fallacy – people underestimating the likelihood of sequential streaks occurring by chance – leading to negatively autocorrelated decisions that result in errors. The negative autocorrelation is stronger among more moderate and less experienced decision-makers, following longer streaks of decisions in one direction, when the current and previous cases share similar characteristics or occur close in time, and when decision-makers face weaker incentives for accuracy. Other explanations for negatively autocorrelated decisions such as quotas, learning, or preferences to treat all parties fairly, are less consistent with the evidence, though we cannot completely rule out sequential contrast effects as an alternative explanation.

[1]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[2]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[3]  A. Pepitone,et al.  Contrast effects in judgments of crime severity and the punishment of criminal violators. , 1976 .

[4]  A. Tversky,et al.  Judgment under Uncertainty , 1982 .

[5]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[6]  Jon A. Krosnick,et al.  Altering the Foundations of Support for the President Through Priming , 1990 .

[7]  W. Wagenaar,et al.  The perception of randomness , 1991 .

[8]  Charles T. Clotfelter,et al.  The "Gambler&Apos;S Fallacy" in Lottery Play , 1991 .

[9]  A. Rapoport,et al.  Generation of random series in two-person strictly competitive games , 1992 .

[10]  Philip J. Cook,et al.  Notes: The Gambler's Fallacy in Lottery Play , 1993 .

[11]  Dek Terrell,et al.  A test of the gambler's fallacy: Evidence from pari-mutuel games , 1994 .

[12]  M. Rabin Inference by Believers in the Law of Small Numbers , 2000 .

[13]  Chris Guthrie,et al.  Inside the Judicial Mind , 2001 .

[14]  Peter Ayton,et al.  The hot hand fallacy and the gambler’s fallacy: Two faces of subjective randomness? , 2004, Memory & cognition.

[15]  M. Rabin,et al.  The Gambler's and Hot-Hand Fallacies In a Dynamic-Inference Model , 2005 .

[16]  Rachel T. A. Croson,et al.  The Gambler’s Fallacy and the Hot Hand: Empirical Data from Casinos , 2005 .

[17]  A. Shleifer,et al.  Coarse Thinking and Persuasion , 2006 .

[18]  George Loewenstein,et al.  Mistake #37: The Effect of Previously Encountered Prices on Current Housing Demand , 2006 .

[19]  Uri Simonsohn,et al.  New Yorkers Commute More Everywhere: Contrast Effects in the Field , 2006, Review of Economics and Statistics.

[20]  L. Kogan,et al.  The Gambler’s and Hot-Hand Fallacies: Theory and Applications , 2007 .

[21]  Philip G. Schrag,et al.  Refugee Roulette: Disparities in Asylum Adjudication , 2007 .

[22]  E. Gold,et al.  The gambler's fallacy and the coin's memory. , 2008 .

[23]  Rationality and social responsibility : essays in honor of Robyn Mason Dawes , 2008 .

[24]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[25]  Michael Hertzel,et al.  Inference from Streaks in Random Outcomes: Experimental Evidence on Beliefs in Regime Shifting and the Law of Small Numbers , 2009, Manag. Sci..

[26]  T. Moskowitz,et al.  Scorecasting: The Hidden Influences Behind How Sports Are Played and Games Are Won , 2011 .

[27]  Jean-Robert Tyran,et al.  Predicting Lotto Numbers , 2011 .

[28]  Daniel L. Chen Priming Ideology? Electoral Cycles Without Electoral Incentives Among U.S. Judges , 2011 .

[29]  Jean-Robert Tyran,et al.  Predicting Lotto Numbers , 2011 .

[30]  S. Danziger,et al.  Extraneous factors in judicial decisions , 2011, Proceedings of the National Academy of Sciences.

[31]  Rembert De Blander,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2011 .

[32]  Christopher A. Parsons,et al.  Strike Three: Discrimination, Incentives, and Evaluation , 2011 .

[33]  Leora F. Klapper,et al.  Incentivizing Calculated Risk-Taking: Evidence from an Experiment with Commercial Bank Loan Officers , 2012 .

[34]  D. Moore,et al.  Misconceptions of Chance : Evidence from an Integrated Experiment , 2012 .

[35]  Daniel L. Chen,et al.  Priming Ideology? Electoral Cycles Without Electoral Incentives Among Elite U.S. Judges , 2013 .

[36]  U. Simonsohn,et al.  Daily Horizons , 2013, Psychological science.

[37]  U. Simonsohn,et al.  Daily Horizons: Evidence of Narrow Bracketing in Judgments from 9,000 MBA Admission Interviews , 2013 .

[38]  Raymond J. Fisman,et al.  Contrast Effects in Sequential Decisions: Evidence from Speed Dating , 2014, Review of Economics and Statistics.

[39]  J. Miller,et al.  A Cold Shower for the Hot Hand Fallacy , 2014 .

[40]  Incentivizing Calculated Risk-Taking: Evidence from an Experiment with Commercial Bank Loan Officers: Incentivizing Calculated Risk-Taking , 2015 .

[41]  A. Shleifer,et al.  Salience Theory of Judicial Decisions , 2013, The Journal of Legal Studies.

[42]  Jeffrey Zwiebel,et al.  The Hot-Hand Fallacy: Cognitive Mistakes or Equilibrium Adjustments? Evidence from Major League Baseball , 2017 .

[43]  Samuel M. Hartzmark,et al.  A Tough Act to Follow: Contrast Effects in Financial Markets , 2017 .

[44]  L. Henkin Executive Office for Immigration Review , 2018 .

[45]  Brett Green,et al.  The Hot-Hand Fallacy: Cognitive Mistakes or Equilibrium Adjustments? Evidence from Major League Baseball , 2017, Manag. Sci..