Confidence in judgment

Experiments have shown that, generally, people are overconfident about the correctness of their answers to questions. Cognitive psychologists have attributed this to biases in the way people generate and handle evidence for and against their views. The overconfidence phenomenon and cognitive psychologists' accounts of its origins have recently given rise to three debates. Firstly, ecological psychologists have proposed that overconfidence is an artefact that has arisen because experimenters have used question material not representative of the natural environment. However, it now appears that some overconfidence remains even after this problem has been remedied. Secondly, it has been proposed that overconfidence is an artefactual regression effect that arises because judgments contain an inherently random component. However, those claiming this appear to use the term overconfidence to refer to a phenomenon quite different from the one that the cognitive psychologists set out to explain. Finally, a debate has arisen about the status of perceptual judgments. Some claim that these evince only underconfidence and must, therefore, depend on mechanisms fundamentally different from those subserving other types of judgment. Others have obtained overconfidence with perceptual judgments and argue that a unitary theory is more appropriate. At present, however, no single theory provides an adequate account of the many diverse factors that influence confidence in judgment.

[1]  Jack B. Soll Determinants of Overconfidence and Miscalibration: The Roles of Random Error and Ecological Structure☆ , 1996 .

[2]  K. Manktelow,et al.  Rationality: Psychological and Philosophical Perspectives , 1993 .

[3]  Phillip E. Pfeifer,et al.  Are We Overconfident in the Belief That Probability Forecasters Are Overconfident , 1994 .

[4]  L. Thurstone A law of comparative judgment. , 1994 .

[5]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[6]  W. Ferrell,et al.  A model for realism of confidence judgments: Implications for underconfidence in sensory discrimination , 1995, Perception & psychophysics.

[7]  G. Keren Calibration and probability judgements: Conceptual and methodological issues , 1991 .

[8]  P. Juslin,et al.  Realism of confidence in sensory discrimination: The underconfidence phenomenon , 1993, Perception & psychophysics.

[9]  Anders Winman,et al.  Calibration of sensory and cognitive judgments : Two different accounts , 1993 .

[10]  P. Juslin,et al.  Reply to William R. Ferrell's paper "Calibration of sensory and cognitive judgments: A single model for both. , 1995 .

[11]  Jean-Paul Caverni,et al.  Contributions to decision making , 1995 .

[12]  E. Brunswik,et al.  The Conceptual Framework of Psychology , 1954 .

[13]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[14]  P. Juslin An explanation of the hard-easy effect in studies of realism of confidence in one's general knowledge , 1993 .

[15]  W. Ferrell Calibration of sensory and cognitive judgments: a single model for both. , 1994, Scandinavian journal of psychology.

[16]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[17]  G. Gigerenzer,et al.  Probabilistic mental models: a Brunswikian theory of confidence. , 1991, Psychological review.

[18]  Nigel Harvey,et al.  Judging the probability that the next point in an observed time series will be below, or above, a given value , 1995 .

[19]  Marcus O'Connor,et al.  Scale, Variability, and the Calibration of Judgmental Prediction Intervals , 1993 .

[20]  M. Björkman Internal Cue Theory: Calibration and Resolution of Confidence in General Knowledge , 1994 .

[21]  I. Erev,et al.  Simultaneous Over- and Underconfidence: The Role of Error in Judgment Processes. , 1994 .

[22]  David V. Budescu,et al.  Encoding subjective probabilities: A psychological and psychometric review , 1983 .

[23]  H. Olsson,et al.  Underconfidence in sensory discrimination: The interaction between experimental setting and response strategies , 1996, Perception & psychophysics.

[24]  Lyle Brenner,et al.  Overconfidence in Probability and Frequency Judgments: A Critical Examination , 1996 .

[25]  R. Dodge,et al.  Thresholds of Rotation. , 1923 .

[26]  Derek J. Koehler,et al.  Hypothesis generation and confidence in judgment , 1994 .

[27]  Robyn M. Dawes,et al.  The False Consensus Effect and Overconfidence: Flaws in Judgment or Flaws in How We Study Judgment? , 1996 .

[28]  J. Baranski,et al.  The calibration and resolution of confidence in perceptual judgments , 1994, Perception & psychophysics.

[29]  Marcus O'Connor,et al.  Models of human behaviour and confidence in judgement: A review , 1989 .

[30]  P. Juslin,et al.  Reply to William R. Ferrell’s paper “A model for realism of confidence judgments: Implications for underconfidence in sensory discrimination” , 1995 .

[31]  W. Ferrell,et al.  The Hard-Easy Effect in Subjective Probability Calibration , 1996 .

[32]  A. Tversky,et al.  Support theory: A nonextensional representation of subjective probability. , 1994 .