On the ability of monitoring non-veridical perceptions and uncertain knowledge: some calibration studies.

Abstract There is ample evidence in the literature to suggest that people are poor probability assessors, namely they are miscalibrated and usually exhibit overconfidence (Lichtenstein, Fischhoff and Phillips 1982). Recently, Dawes (1980) proposed that overconfidence is particularly apparent in tasks that require ‘intellectual’ judgments (such as general knowledge questions). In contrast, Dawes argued, we have developed a remarkable perceptual encoding system, which is not vulnerable to the same limitations as our ‘intellectual’ judgments. Three experiments were designed to test the ability of self-monitoring visual perceptual tasks in terms of confidence ratings. The overall evidence suggests that people are indeed less likely to be overconfident in a perceptual task. This holds especially for tasks in which little or no additional processing, beyond sensory encoding, is required and performance is limited only by perceptual variables (‘state limitation’ tasks in terms of Garner (1970, 1974)). Perceptual tasks that require additional processing of abstraction and discrimination (‘process limitation’ tasks in Garner's terminology) may be vulnerable to overconfidence. Possible explanations for the differences in confidence ratings for knowledge as compared with perceptual experience, are briefly discussed.

[1]  B. Fischhoff,et al.  Subjective Confidence in Forecasts. , 1982 .

[2]  W. R. Garner,et al.  The Stimulus in Information Processing , 1970 .

[3]  L. A. Goodman,et al.  Measures of association for cross classifications , 1979 .

[4]  C. Eriksen,et al.  Is recognition accuracy really impaired when the target is repeated in the display? , 1981, Perception & psychophysics.

[5]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[6]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[7]  Ronald G. Shapiro,et al.  Effect of similarity of surround on target-letter processing. , 1983, Journal of experimental psychology. Human perception and performance.

[8]  James R. Pomerantz,et al.  State and process limitations in information processing: An additive factors analysis , 1977 .

[9]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[10]  J SWETS,et al.  Decision processes in perception. , 1961, Psychological review.

[11]  Charles W. Eriksen,et al.  Target redundancy in visual search: Do repetitions of the target within thedisplay impair processing? , 1979 .

[12]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[13]  Bertrand Russell,et al.  A History of Western Philosophy. , 1947 .

[14]  W. Estes,et al.  Similarity-related channel interactions in visual processing. , 1982, Journal of experimental psychology. Human perception and performance.

[15]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[16]  Howard E. Egeth,et al.  Conceptual and perceptual components of interletter inhibition. , 1981 .

[17]  W. R. Garner,et al.  Letter identification as a function of type of perceptual limitation and type of attribute. , 1978, Journal of experimental psychology. Human perception and performance.

[18]  M. P. Friedman,et al.  HANDBOOK OF PERCEPTION , 1977 .

[19]  Elizabeth L Bjork,et al.  On the nature of input channels in visual processing. , 1977, Psychological review.

[20]  W A Wagenaar,et al.  Does the expert know? The reliability of predictions and confidence ratings of experts , 1986 .

[21]  W. W. Daniel Applied Nonparametric Statistics , 1979 .

[22]  B. Fischhoff,et al.  Training for calibration. , 1980 .

[23]  James V. Bradley,et al.  Overconfidence in ignorant experts , 1981 .

[24]  H E Egeth,et al.  Interference in letter identification: A test of feature-specific inhibition , 1980, Perception & psychophysics.

[25]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[26]  G. W. Fischer,et al.  Scoring-rule feedback and the overconfidence syndrome in subjective probability forecasting , 1982 .

[27]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .

[28]  W. R. Garner The Processing of Information and Structure , 1974 .

[29]  B. D. Finetti La prévision : ses lois logiques, ses sources subjectives , 1937 .