Estimating the Relationship between Skill and Overconfidence

The Dunning–Kruger effect states that low performers vastly overestimate their performance while high performers more accurately assess their performance. Researchers usually interpret this empirical pattern as evidence that the low skilled are vastly overconfident while the high skilled are more accurate in assessing their skill. However, measurement error alone can lead to a negative relationship between performance and overestimation, even if skill and overconfidence are unrelated. To clarify the role of measurement error, we restate the Dunning–Kruger effect in terms of skill and overconfidence. We show that we can correct for bias caused by measurement error with an instrumental variable approach that uses a second performance as instrument. We then estimate the Dunning–Kruger effect in the context of the exam grade predictions of economics students, using their grade point average as an instrument for their exam grade. Our results show that the unskilled are more overconfident than the skilled. However, as we predict in our methodological discussion, this relationship is significantly weaker than ordinary least squares estimates suggest.

[1]  Joachim Krueger,et al.  Unskilled, unaware, or both? The better-than-average heuristic and statistical regression predict errors in estimates of own performance. , 2002, Journal of personality and social psychology.

[2]  David Dunning,et al.  How unaware are the unskilled? Empirical tests of the “signal extraction” counterexplanation for the Dunning–Kruger effect in self-evaluation of performance , 2013 .

[3]  L. Ross,et al.  The “false consensus effect”: An egocentric bias in social perception and attribution processes , 1977 .

[4]  Jan Feld,et al.  SEF Working paper : 14 / 2015 Understanding peer effects-on the nature , estimation and channels of peer effects , 2015 .

[5]  D. Moore,et al.  The trouble with overconfidence. , 2008, Psychological review.

[6]  Erik Dane,et al.  Exploring Intuition and its Role in Managerial Decision Making , 2007 .

[7]  Ulrike Malmendier,et al.  CEO Overconfidence and Corporate Investment , 2002 .

[8]  Colin Camerer,et al.  Overconfidence and Excess Entry: An Experimental Approach , 1999 .

[9]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[10]  Argie Leach,et al.  Assessing the Competence of Specimen-Processing Personnel , 2000 .

[11]  Andreas Ortmann,et al.  Are the Unskilled Really that Unaware? An Alternative Explanation , 2007 .

[12]  David Dunning,et al.  Unskilled and unaware--but why? A reply to Krueger and Mueller (2002). , 2002, Journal of personality and social psychology.

[13]  Richard P. Larrick,et al.  Skilled or unskilled, but still unaware of it: how perceptions of difficulty drive miscalibration in relative comparisons. , 2006, Journal of personality and social psychology.

[14]  Avishalom Tor The Fable of Entry: Bounded Rationality, Market Discipline, and Legal Policy , 2002 .

[15]  Kerri L. Johnson,et al.  Why the Unskilled are Unaware: Further Explorations of (Absent) Self-Insight Among the Incompetent , 2006, Organizational behavior and human decision processes.

[16]  D. Dunning The Dunning–Kruger Effect , 2011 .

[17]  D. Hamermesh,et al.  Endophilia or Exophobia: Beyond Discrimination , 2013, SSRN Electronic Journal.

[18]  Wei Xiong,et al.  Overconfidence and Speculative Bubbles , 2003, Journal of Political Economy.

[19]  Andreas Ortmann,et al.  Are the unskilled doomed to remain unaware , 2012 .

[20]  D. Dunning The Dunning–Kruger Effect: On Being Ignorant of One’s Own Ignorance , 2011 .