From conditioning to category learning: an adaptive network model.

We used adaptive network theory to extend the Rescorla-Wagner (1972) least mean squares (LMS) model of associative learning to phenomena of human learning and judgment. In three experiments subjects learned to categorize hypothetical patients with particular symptom patterns as having certain diseases. When one disease is far more likely than another, the model predicts that subjects will substantially overestimate the diagnosticity of the more valid symptom for the rare disease. The results of Experiments 1 and 2 provide clear support for this prediction in contradistinction to predictions from probability matching, exemplar retrieval, or simple prototype learning models. Experiment 3 contrasted the adaptive network model with one predicting pattern-probability matching when patients always had four symptoms (chosen from four opponent pairs) rather than the presence or absence of each of four symptoms, as in Experiment 1. The results again support the Rescorla-Wagner LMS learning rule as embedded within an adaptive network model.

[1]  D. Whitteridge.  Lectures on Conditioned Reflexes , 1942, Nature.

[2]  C. L. Hull.  Principles of Behavior , 1945 .

[3]  Herbert A. Simon,et al.  Forgetting in an association memory , 1961, ACM National Meeting.

[4]  J. Orbach.  Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms. , 1962 .

[5]  L. Kamin.  Predictability, surprise, attention, and conditioning , 1967 .

[6]  R. Rescorla.  Probability of shock in the presence and absence of CS in fear conditioning. , 1968, Journal of comparative and physiological psychology.

[7]  G. Bower,et al.  Attention in Learning: Theory and Research , 1968 .

[8]  W. K. Honig,et al.  Fundamental issues in associative learning : proceedings of a symposium held at Dalhousie University, Halifax, June 1968 , 1969 .

[9]  A. R. Wagner.  Stimulus Selection and A “Modified Continuity Theoryrdquo;1 , 1970 .

[10]  J. Bransford,et al.  Abstraction of visual patterns. , 1971, Journal of experimental psychology.

[11]  Paul Slovic,et al.  Comparison of Bayesian and Regression Approaches to the Study of Information Processing in Judgment. , 1971 .

[12]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[13]  R. Rescorla.  A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[14]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[15]  J. W. Rudy,et al.  Stimulus selection in animal conditioning and paired-associate learning: Variations in the associative process , 1974 .

[16]  R. Rescorla,et al.  Extinction of Pavlovian conditioned inhibition. , 1974, Journal of comparative and physiological psychology.

[17]  A. G. Baker,et al.  Excitatory and inhibitory conditioning following uncorrelated presentations of CS and UCS , 1977 .

[18]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[19]  A. Tversky.  Features of Similarity , 1977 .

[20]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[21]  K. Spence.  Behavior Theory and Conditioning , 1978 .

[22]  Saul M. Kassin,et al.  Base Rates and Prediction: The Role of Sample Size , 1979 .

[23]  M. Bar-Hillel.  The base-rate fallacy in probability judgments. , 1980 .

[24]  A. Tversky,et al.  Evidential impact of base rates , 1981 .

[25]  D. Homa,et al.  Limitations of exemplar-based generalization and the abstraction of categorical information. , 1981 .

[26]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[27]  J. H. Neely.  The role of expectancy in probability learning. , 1982 .

[28]  P. Holland,et al.  Behavioral Studies of Associative Learning in Animals , 1982 .

[29]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[30]  Mark W. Altom,et al.  Correlated symptoms and simulated medical classification. , 1982, Journal of experimental psychology. Learning, memory, and cognition.

[31]  N. Mackintosh,et al.  Conditioning And Associative Learning , 1983 .

[32]  D. Medin,et al.  Learning of ill-defined categories by monkeys. , 1984 .

[33]  R. Nosofsky.  American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[34]  L. Alloy,et al.  Assessment of covariation by humans and animals: The joint influence of prior expectations and current situational information. , 1984 .

[35]  Edward E. Smith,et al.  Concepts and concept formation. , 1984, Annual review of psychology.

[36]  K. Holyoak,et al.  Induction of category distributions: a framework for classification learning. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[37]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[38]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[39]  G. O. Stone,et al.  An analysis of the delta rule and the learning of statistical associations , 1986 .

[40]  W. Estes.  Array models for category learning , 1986, Cognitive Psychology.

[41]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[42]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[43]  David B. Parker,et al.  A comparison of algorithms for neuron-like cells , 1987 .

[44]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[45]  D. Medin,et al.  Problem structure and the use of base-rate information from experience. , 1988, Journal of experimental psychology. General.

[46]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .