Wide of the Mark: Evidence on the Underlying Causes of Overprecision in Judgment

Overprecision is the most robust and least understood form of overconfidence. In an attempt to elucidate the underlying causes of overprecision in judgment, the present paper offers a new approach – examining people’s beliefs about the likelihood of chance events drawn from known probability distributions. This approach allows us to test the assumption that low hit rates inside subjective confidence intervals arise because those confidence intervals are drawn too narrowly. In fact, subjective probability distributions are systematically too wide, or insufficiently precise. This result raises profound questions for the study of overconfidence.

[1]  Dean P. Foster,et al.  Graininess of judgment under uncertainty: An accuracy-informativeness trade-off , 1995 .

[2]  G. Gigerenzer How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases” , 1991 .

[3]  Don A. Moore,et al.  Overprecision in Judgment , 2015 .

[4]  Carey K. Morewedge,et al.  A simple remedy for overprecision in judgment. , 2010, Judgment and decision making.

[5]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  D. Moore,et al.  The trouble with overconfidence. , 2008, Psychological review.

[7]  Richard P. Larrick,et al.  Cognitive Repairs : How Organizational Practices Can Compensate for Individual Shortcomings , 1998 .

[8]  P. Mamassian Overconfidence in an Objective Anticipatory Motor Task , 2008, Psychological science.

[9]  R. Hertwig,et al.  The description–experience gap in risky choice , 2009, Trends in Cognitive Sciences.

[10]  R. Selten Axiomatic Characterization of the Quadratic Scoring Rule , 1998 .

[11]  Anders Winman,et al.  The naïve intuitive statistician: a naïve sampling model of intuitive confidence intervals. , 2007, Psychological review.

[12]  Joshua Klayman,et al.  Overconfidence in interval estimates. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Richard A. Block,et al.  Overconfidence in estimation: Testing the anchoring-and-adjustment hypothesis , 1991 .

[14]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[15]  Colin Camerer,et al.  Regulation for Conservatives: Behavioral Economics and the Case for 'Asymmetric Paternalism' , 2003 .

[16]  Gary L. Brase,et al.  Individuation , Counting , and Statistical Inference : The Role of Frequency and Whole-Object Representations in Judgment Under Uncertainty , 1998 .

[17]  Nigel Harvey,et al.  Confidence in judgment , 1997, Trends in Cognitive Sciences.

[18]  S. Plous,et al.  A comparison of strategies for reducing interval overconfidence in group judgments , 1995 .

[19]  Craig R. Fox,et al.  Judgment Extremity and Accuracy Under Epistemic vs. Aleatory Uncertainty , 2017, Manag. Sci..

[20]  Ayleen Wisudha,et al.  Distribution of probability assessments for almanac and future event questions , 1982 .

[21]  P. Goodwin,et al.  Judgmental forecasting: A review of progress over the last 25 years , 2006 .

[22]  GUlden Ulkiimen,et al.  DISTINGUISHING TWO DIMENSIONS OF UNCERTAINTY , 2011 .

[23]  K Fiedler Beware of samples! A cognitive-ecological sampling approach to judgment biases. , 2000, Psychological review.

[24]  Chris Arney Nudge: Improving Decisions about Health, Wealth, and Happiness , 2015 .

[25]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[26]  Albert E. Mannes,et al.  A Behavioral Demonstration of Overconfidence in Judgment , 2013, Psychological science.

[27]  H. Raiffa,et al.  Judgment under uncertainty: A progress report on the training of probability assessors , 1982 .

[28]  D. Moore,et al.  Effects of Task Difficulty on Use of Advice , 2007 .

[29]  D. Gilbert How mental systems believe. , 1991 .

[30]  Anil Gaba,et al.  Unpacking the Future: A Nudge Toward Wider Subjective Confidence Intervals , 2011, Manag. Sci..