Overconfidence effects in category learning: a comparison of connectionist and exemplar memory models.

Exemplar and connectionist models were compared on their ability to predict overconfidence effects in category learning data. In the standard task, participants learned to classify hypothetical patients with particular symptom patterns into disease categories and reported confidence judgments in the form of probabilities. The connectionist model asserts that classifications and confidence are based on the strength of learned associations between symptoms and diseases. The exemplar retrieval model (ERM) proposes that people learn by storing examples and that their judgments are often based on the first example they happen to retrieve. Experiments 1 and 2 established that overconfidence increases when the classification step of the process is bypassed. Experiments 2 and 3 showed that a direct instruction to retrieve many exemplars reduces overconfidence. Only the ERM predicted the major qualitative phenomena exhibited in these experiments.

[1]  L. Humphreys Acquisition and extinction of verbal expectations in a situation analogous to conditioning. , 1939 .

[2]  D. A. Grant,et al.  Acquisition and extinction of a verbal conditioned response with differing percentages of reinforcement. , 1951, Journal of experimental psychology.

[3]  W. Estes,et al.  Analysis of a verbal conditioning situation in terms of statistical learning theory , 1954 .

[4]  H. Simon,et al.  A comparison of game theory and learning theory , 1956 .

[5]  W. K. Estes,et al.  Theory of learning with constant, variable, or contingent probabilities of reinforcement , 1957 .

[6]  E. H. Shuford,et al.  Comparison of predictions and estimates in a probability learning situation. , 1959, Journal of experimental psychology.

[7]  W. Edwards,et al.  Probability learning in 1000 trials. , 1961, Journal of experimental psychology.

[8]  A. W. Melton Categories of Human Learning , 1964 .

[9]  L. Beach,et al.  Man as an Intuitive Statistician , 2022 .

[10]  L. Squire Mechanisms of memory. , 1986, Lancet.

[11]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[12]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[13]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[14]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[15]  Dewey Rundus,et al.  Negative effects of using list items as recall cues , 1973 .

[16]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[17]  H. Grice Logic and conversation , 1975 .

[18]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[19]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[20]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[21]  B. Fischhoff,et al.  Subjective sensitivity analysis. , 1979 .

[22]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[23]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[24]  D. G. Payne,et al.  Hypermnesia: the role of repeated testing. , 1982, Journal of experimental psychology. Learning, memory, and cognition.

[25]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[26]  Berndt Brehmer,et al.  Does having to justify one's judgments change the nature of the judgment process? , 1983 .

[27]  R. Nosofsky American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[28]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[29]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[30]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[31]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[32]  W. Estes Array models for category learning , 1986, Cognitive Psychology.

[33]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[34]  David L. Ronis,et al.  Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. , 1987 .

[35]  G. Logan Toward an instance theory of automatization. , 1988 .

[36]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[37]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[38]  Jerome R. Busemeyer,et al.  A New Method for Investigating Prototype Learning , 1988 .

[39]  W. Estes,et al.  Base-rate effects in category learning: a comparison of parallel network and memory storage-retrieval models. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Janet A. Sniezek,et al.  The effect of choosing on confidence in choice , 1990 .

[41]  D R Shanks,et al.  Connectionism and the Learning of Probabilistic Concepts , 1990, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[42]  Mark A. Gluck,et al.  Component and pattern information in adaptive networks , 1990 .

[43]  G. Gigerenzer,et al.  Probabilistic mental models: a Brunswikian theory of confidence. , 1991, Psychological review.

[44]  Janet A. Sniezek,et al.  Influences on the appropriateness of confidence in judgment: Practice, effort, information, and decision-making , 1991 .

[45]  W. Wagenaar,et al.  The perception of randomness , 1991 .

[46]  David R. Shanks,et al.  CATEGORIZATION BY A CONNECTIONIST NETWORK , 1991 .

[47]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[48]  L A Real,et al.  Animal choice behavior and the evolution of cognitive architecture , 1991, Science.

[49]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[50]  A. Rapoport,et al.  Generation of random series in two-person strictly competitive games , 1992 .

[51]  Eric J. Johnson,et al.  Behavioral decision research: A constructive processing perspective. , 1992 .

[52]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[53]  F. Gregory Ashby,et al.  Multidimensional models of categorization. , 1992 .

[54]  R. Nosofsky Exemplars, prototypes, and similarity rules. , 1992 .

[55]  R. Nosofsky,et al.  Combining exemplar-based category representations and connectionist learning rules. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[56]  N. Sanders,et al.  Journal of behavioral decision making: "The need for contextual and technical knowledge in judgmental forecasting", 5 (1992) 39-52 , 1992 .

[57]  R I Benjamin,et al.  Critical IT (information technology) issues: the next ten years. , 1992, Sloan management review.

[58]  Gideon Keren,et al.  A Handbook for data analysis in the behavioral sciences : methodological issues , 1993 .

[59]  A. Rapoport,et al.  Subjective randomization in one-and two-person games , 1994 .

[60]  I. Erev,et al.  Simultaneous Over- and Underconfidence: The Role of Error in Judgment Processes. , 1994 .

[61]  Ab McClelland,et al.  The calibration of subjective probabilities: Theories and models 1980-1993 , 1994 .

[62]  Timothy D. Wilson,et al.  Knowing what you'll do: effects of analyzing reasons on self-prediction. , 1995, Journal of personality and social psychology.

[63]  Jack B. Soll Determinants of Overconfidence and Miscalibration: The Roles of Random Error and Ecological Structure☆ , 1996 .

[64]  Lyle Brenner,et al.  Overconfidence in Probability and Frequency Judgments: A Critical Examination , 1996 .

[65]  W. Ferrell,et al.  The Hard-Easy Effect in Subjective Probability Calibration , 1996 .

[66]  Mats Björkman,et al.  Brunswikian and Thurstonian Origins of Bias in Probability Assessment: On the Interpretation of Stochastic Components of Judgment , 1997 .

[67]  Gideon Keren,et al.  On The Calibration of Probability Judgments: Some Critical Comments and Alternative Perspectives , 1997 .

[68]  Thomas J. Palmeri,et al.  An Exemplar-Based Random Walk Model of Speeded Classification , 1997 .

[69]  Edward E. Smith,et al.  Alternative strategies of categorization , 1998, Cognition.

[70]  Winston R. Sieck,et al.  Cross-Cultural Variations in Probability Judgment Accuracy: Beyond General Knowledge Overconfidence? , 1998, Organizational behavior and human decision processes.

[71]  Winston R. Sieck,et al.  Justification effects on the judgment of analogy , 1999, Memory & cognition.

[72]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[73]  S. Menard Coefficients of Determination for Multiple Logistic Regression Analysis , 2000 .

[74]  H Gu,et al.  The effects of averaging subjective probability estimates between and within judges. , 2000, Journal of experimental psychology. Applied.