Judgmental overconfidence: Three measures, one bias?

Overconfidence is used to explain various instances of detrimental decision making. In behavioral economic and finance models, it is usually captured by misperceiving the reliability of signals and results in overweighting private information. Empirical tests of these models often fail to find evidence for the predicted effects of overconfidence. These studies assume, however, that a specific type of overconfidence, i.e. “miscalibration,” captures the underlying trait. We challenge this assumption and borrow the psychological methodology of single-cue probability learning to obtain a direct measure for misperceiving signal reliability. Our findings indicate that the perception of signal precision and measures of miscalibration are unrelated. We thus conclude that in order to test the theoretical predictions of the overconfidence literature in economics and finance, one cannot rely on the well-established miscalibration bias.

[1]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[2]  Jack B. Soll,et al.  Overconfidence: It Depends on How, What, and Whom You Ask. , 1999, Organizational behavior and human decision processes.

[3]  Bruno Biais,et al.  Judgmental Overconfidence, Self-Monitoring and Trading Performance in an Experimental Financial Market , 2005 .

[4]  Ben Greiner,et al.  An Online Recruitment System for Economic Experiments , 2004 .

[5]  U. Fischbacher z-Tree: Zurich toolbox for ready-made economic experiments , 1999 .

[6]  Markus Glaser,et al.  Overconfidence and trading volume , 2003 .

[7]  Y. Ganzach Predictor Representation and Prediction Strategies , 1993 .

[8]  Benjamin Czaczkes,et al.  The Natural Selection of Prediction Heuristics: Anchoring and Adjustment versus Representativeness , 1996 .

[9]  G. Gigerenzer,et al.  Probabilistic mental models: a Brunswikian theory of confidence. , 1991, Psychological review.

[10]  Thomas Langer,et al.  Overconfidence of Professionals and Lay Men : Individual Differences Within and Between Tasks? , 2005 .

[11]  Theo Offerman,et al.  Is the Quadratic Scoring Rule Behaviorally Incentive Compatible , 2001 .

[12]  Terrance Odean,et al.  Volume, Volatility, Price, and Profit When All Traders are Above Average , 1998 .

[13]  A. Tversky,et al.  Variants of uncertainty , 1982, Cognition.

[14]  Y. Ganzach Feedback Representation and Prediction Strategies , 1994 .

[15]  P. Goodwin,et al.  Judgmental forecasting: A review of progress over the last 25 years , 2006 .

[16]  Nigel Harvey,et al.  Use of heuristics: Insights from forecasting research , 2007, Thinking & Reasoning.

[17]  Alexandros Benos,et al.  Aggressiveness and survival of overconfident traders , 1998 .

[18]  P. Juslin The Overconfidence Phenomenon as a Consequence of Informal Experimenter-Guided Selection of Almanac Items , 1994 .

[19]  H. Raiffa,et al.  Judgment under uncertainty: A progress report on the training of probability assessors , 1982 .

[20]  G. Keren Calibration and probability judgements: Conceptual and methodological issues , 1991 .

[21]  Albert S. Kyle,et al.  Speculation Duopoly with Agreement to Disagree: Can Overconfidence Survive the Market Test? , 1997 .

[22]  Marcus O'Connor,et al.  Exploring judgemental forecasting , 1992 .

[23]  Kent D. Daniel,et al.  Presentation Slides for 'Investor Psychology and Security Market Under and Overreactions' , 1998 .

[24]  Laure Cabantous,et al.  Do Positive Illusions Predict Overconfidence in Judgment? A Test Using Interval Production and Probability Evaluation Measures of Miscalibration , 2011 .

[25]  Y. Ganzach Coherence and correspondence in the psychological analysis of numerical predictions: How error-prone heuristics are replaced by ecologically valid heuristics , 2009, Judgment and Decision Making.

[26]  D. Moore,et al.  The trouble with overconfidence. , 2008, Psychological review.

[27]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .

[28]  Guo Ying Luo,et al.  An Experimental Test of the Impact of Overconfidence and Gender on Trading Activity , 2003 .

[29]  R I Benjamin,et al.  Critical IT (information technology) issues: the next ten years. , 1992, Sloan management review.

[30]  Marcus O'Connor,et al.  Scale, Variability, and the Calibration of Judgmental Prediction Intervals , 1993 .