Realism of confidence in sensory discrimination

Is there a common and general basis for confidence in human judgment? Recently, we found that the properties of confidence judgments in the sensory domain mirror those previously established in the cognitive domain; notably, we found underconfidence on easy sensory judgments and overconfidence on hard sensory judgments. In contrast, data from the Uppsala laboratory in Sweden suggest that sensory judgments are unique; they found a pervasive underconfidence bias, with overconfidence being evident only on very hard sensory judgments. Olsson and Winman (1996) attempted to resolve the debate on the basis of methodological issues related to features of the stimulus display in a visual discrimination task. A reanalysis of the data reported in Baranski and Petrusic (1994), together with the findings of a new experiment that controlled stimulus display characteristics, supports the position that the difference between the Canadian and the Swedish data is real and, thus, may reflect cross-national differences in confidence in sensory discrimination.

[1]  Lazar Stankov,et al.  Calibration curves, scatterplots and the distinction between general knowledge and perceptual tasks , 1998 .

[2]  G. Keren,et al.  On the ability of monitoring non-veridical perceptions and uncertain knowledge: some calibration studies. , 1988, Acta psychologica.

[3]  Shawn P. Curley,et al.  Probability judgment accuracy for general knowledge. Cross‐national differences and assessment methods , 1995 .

[4]  Donald McEwen Johnson,et al.  Confidence and speed in the two-category judgment , 1939 .

[5]  P. Juslin,et al.  Thurstonian and Brunswikian origins of uncertainty in judgment: a sampling model of confidence in sensory discrimination. , 1997, Psychological review.

[6]  Mats Björkman,et al.  Brunswikian and Thurstonian Origins of Bias in Probability Assessment: On the Interpretation of Stochastic Components of Judgment , 1997 .

[7]  R A Heath,et al.  Random-Walk and Accumulator Models of Psychophysical Discrimination: A Critical Evaluation , 1984, Perception.

[8]  V. Henmon,et al.  The relation of the time of a judgment to its accuracy. , 1911 .

[9]  J. Yates,et al.  Beliefs about Overconfidence, Including Its Cross-National Variation , 1996 .

[10]  Anders Winman,et al.  Calibration of sensory and cognitive judgments : Two different accounts , 1993 .

[11]  W. Ferrell,et al.  A model for realism of confidence judgments: Implications for underconfidence in sensory discrimination , 1995, Perception & psychophysics.

[12]  J. Baranski,et al.  The calibration and resolution of confidence in perceptual judgments , 1994, Perception & psychophysics.

[13]  J. Baranski,et al.  On the calibration of knowledge and perception. , 1995, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[14]  David L. Ronis,et al.  Probability judgment accuracy: China, Japan, and the United States , 1989 .

[15]  P. Juslin,et al.  Realism of confidence in sensory discrimination: The underconfidence phenomenon , 1993, Perception & psychophysics.

[16]  Ab McClelland,et al.  The calibration of subjective probabilities: Theories and models 1980-1993 , 1994 .

[17]  Gustav Theodor Fechner,et al.  Elements of psychophysics , 1966 .

[18]  P. Juslin.  An explanation of the hard-easy effect in studies of realism of confidence in one's general knowledge , 1993 .

[19]  Lawrence D. Phillips,et al.  CULTURAL VARIATION IN PROBABILISTIC THINKING: ALTERNATIVE WAYS OF DEALING WITH UNCERTAINTY* , 1980 .

[20]  G. Keren.  Calibration and probability judgements: Conceptual and methodological issues , 1991 .

[21]  P. Ayton,et al.  Decision time, subjective probability, and task difficulty , 1988, Memory & cognition.

[22]  D. Jamieson,et al.  Presentation order effects in duration discrimination , 1975 .

[23]  Robyn M. Dawes,et al.  The False Consensus Effect and Overconfidence: Flaws in Judgment or Flaws in How We Study Judgment? , 1996 .

[24]  M. Björkman.  Internal Cue Theory: Calibration and Resolution of Confidence in General Knowledge , 1994 .

[25]  R J AUDLEY,et al.  A stochastic model for individual choice behavior. , 1960, Psychological review.

[26]  Leon Festinger,et al.  Studies in decision: I. Decision-time, relative frequency of judgment and subjective confidence as related to physical stimulus difference. , 1943 .

[27]  D Vickers,et al.  Effects of alternating set for speed or accuracy on response time, accuracy and confidence in a unidimensional discrimination task. , 1982, Acta psychologica.

[28]  W. Ferrell,et al.  The Hard-Easy Effect in Subjective Probability Calibration , 1996 .

[29]  Nigel Harvey,et al.  Confidence in judgment , 1997, Trends in Cognitive Sciences.

[30]  I. Erev,et al.  Simultaneous Over- and Underconfidence: The Role of Error in Judgment Processes. , 1994 .

[31]  W. Ferrell.  Calibration of sensory and cognitive judgments: a single model for both. , 1994, Scandinavian journal of psychology.

[32]  S C Masin,et al.  Attentional scanning and space errors , 1991, Perception & psychophysics.

[33]  William M. Petrusic,et al.  Probing the locus of confidence judgments: experiments on the time to determine confidence. , 1998 .

[34]  H. Olsson,et al.  Underconfidence in sensory discrimination: The interaction between experimental setting and response strategies , 1996, Perception & psychophysics.

[35]  Jack B. Soll.  Determinants of Overconfidence and Miscalibration: The Roles of Random Error and Ecological Structure☆ , 1996 .

[36]  J. Yates,et al.  General knowledge overconfidence : Cross-national variations, response style, and reality , 1997 .

[37]  Lawrence D. Phillips,et al.  Cultural Differences in Probabilistic Thinking , 1978 .

[38]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[39]  J V Baranski,et al.  The discriminability of remembered magnitudes , 1992, Memory & cognition.

[40]  William R. Ferrell,et al.  A model of calibration for subjective probabilities , 1980 .

[41]  David V. Budescu,et al.  On the Importance of Random Error in the Study of Probability Judgment. Part II: Applying the Stochastic Judgment Model to Detect Systematic Trends , 1997 .

[42]  Ake Hellstrom,et al.  The time-order error and its relatives: Mirrors of cognitive processes in comparing. , 1985 .

[43]  W. Petrusic,et al.  Semantic congruity effects and theories of the comparison process. , 1992, Journal of experimental psychology. Human perception and performance.

[44]  G. Gigerenzer,et al.  Probabilistic mental models: a Brunswikian theory of confidence. , 1991, Psychological review.

[45]  O. Svenson.  ARE WE ALL LESS RISKY AND MORE SKILLFUL THAN OUR FELLOW DRIVERS , 1981 .

[46]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[47]  R. G. Crowder,et al.  The role of succession in temporal cognition: Is the time-order error a recency effect of memory? , 1988, Perception & psychophysics.

[48]  Donald G. Jamieson,et al.  Resolution time and the coding of arithmetic relations on supraliminally different visual extents , 1979 .

[49]  Philip L. Smith,et al.  Experimental paradigms emphasising state or process limitations: II effects on confidence , 1985 .

[50]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[51]  J. Baranski,et al.  Semantic congruity effects in perceptual comparisons , 1989, Perception & psychophysics.

[52]  J. Baranski,et al.  Context, feedback, and the calibration and resolution of confidence in perceptual judgments. , 1997, American Journal of Psychology.

[53]  P. Juslin.  The Overconfidence Phenomenon as a Consequence of Informal Experimenter-Guided Selection of Almanac Items , 1994 .

[54]  J. M. Cattell,et al.  On the Perception of Small Differences , 1894 .

[55]  David V. Budescu,et al.  Encoding subjective probabilities: A psychological and psychometric review , 1983 .

[56]  R. Donaghy.  The perception of small differences , 1980 .

[57]  Nigel Harvey,et al.  Relations between confidence and skilled performance , 1994 .

[58]  L. Stankov,et al.  Confidence judgments in studies of individual differences , 1996 .