An elemental model of associative learning: I. Latent inhibition and perceptual learning

This paper presents a brief, informal outline followed by a formal statement of an elemental associative learning model first described by McLaren, Kaye, and Mackintosh (1989). The model assumes representation of stimuli by sets of elements (i.e., microfeatures) and a set of associative algorithms that incorporate the following: real-time simulation of learning; an error-correcting learning rule; weight decay that distinguishes between transient and permanent associations; and modulation of associative learning that gives high salience to and, hence, promotes rapid learning with novel, unpredicted stimuli and reduces the salience for a stimulus as its error term declines. The model is applied in outline fashion to some of the basic phenomena of simple conditioning and, in greater detail, to the phenomena of latent inhibition and perceptual learning. A detailed account of generalization and discrimination will be provided in a later paper.

[1]  W. Brown Animal Intelligence: Experimental Studies , 1912, Nature.

[2]  J. Deese Principles of Psychology , 1923, Nature.

[3]  Harold Gulliksen,et al.  A theory of learning and transfer: I , 1938 .

[4]  B. Skinner,et al.  Principles of Behavior , 1944 .

[5]  C. L. Hull Principles of Behavior , 1945 .

[6]  S. Kaplan The Physiology of Thought , 1950 .

[7]  M E BITTERMAN,et al.  Relational learning in the rat. , 1951, The American journal of psychology.

[8]  R. R. Bush,et al.  A Mathematical Model for Simple Learning , 1951 .

[9]  K W SPENCE,et al.  The nature of the response in discrimination learning. , 1952, Psychological review.

[10]  E. F. Maccaslin Successive and simultaneous discrimination as a function of stimulus-similarity. , 1954, The American journal of psychology.

[11]  J. Gibson,et al.  Perceptual learning; differentiation or enrichment? , 1955, Psychological review.

[12]  W. Estes Statistical theory of distributional phenomena in learning. , 1955, Psychological review.

[13]  E. Gibson,et al.  The effect of prolonged exposure to visually presented patterns on learning to discriminate them. , 1956, Journal of comparative and physiological psychology.

[14]  F. Attneave,et al.  Transfer of experience with a class-schema to identification-learning of patterns and shapes. , 1957, Journal of experimental psychology.

[15]  E. Gibson,et al.  The effect of prolonged exposure to visual patterns on learning to discriminate similar and different patterns. , 1958, Journal of comparative and physiological psychology.

[16]  D. A. Riley,et al.  The nature of the effective stimulus in animal discrimination learning: transposition reconsidered. , 1958, Psychological review.

[17]  Forgus Rh The effect of different kinds of form pre-exposure on form discrimination learning. , 1958 .

[18]  R. Forgus The effect of different kinds of form pre-exposure on form discrimination learning. , 1958, Journal of comparative and physiological psychology.

[19]  R. Forgus The interaction between form pre-exposure and test requirements in determining form discrimination. , 1958, Journal of comparative and physiological psychology.

[20]  L. Tinbergen The natural control of insects in pinewoods. I. Factors influencing the intensity of predation by songbirds , 1960 .

[21]  L. Tinbergen The Natural Control of Insects in Pinewoods , 1960 .

[22]  Koch Sigmund Ed,et al.  Psychology: A Study of A Science , 1962 .

[23]  Eugene Galanter,et al.  Handbook of mathematical psychology: I. , 1963 .

[24]  Richard C. Atkinson,et al.  Stimulus Sampling Theory , 1967 .

[25]  K. Haberlandt,et al.  Stimulus selection in animal discrimination learning. , 1968, Journal of Experimental Psychology.

[26]  R. Gilbert Animal Discrimination Learning , 1969 .

[27]  D. Lawrence,et al.  Attention in Discrimination Learning , 1969 .

[28]  M. Davis,et al.  Effects of interstimulus interval length and variability on startle-response habituation in the rat. , 1970, Journal of comparative and physiological psychology.

[29]  W. Ellis Role of Stimulus Sequences in Stimulus Discrimination and Stimulus Generalization. , 1970 .

[30]  G. Horn Habituation and Memory , 1971 .

[31]  N. Mackintosh,et al.  Mechanisms of animal discrimination learning , 1971 .

[32]  R. Oswalt Relationship between level of visual pattern difficulty during rearing and subsequent discrimination in rats. , 1972, Journal of comparative and physiological psychology.

[33]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[34]  P. W. Frey,et al.  Inhibition and learning , 1973 .

[35]  Alma E. Lantz Effect of number of trials, interstimulus interval, and dishabituation during CS habituation on subsequent conditioning in a CER paradigm , 1973 .

[36]  R. Elkins Attenuation of drug-induced bait shyness to a palatable solution as an increasing function of its availability prior to conditioning. , 1973, Behavioral biology.

[37]  E. Gibson,et al.  Principles of Perceptual Learning and Development , 1973 .

[38]  A. F. Carr Latent inhibition and overshadowing in conditioned emotional response conditioning with rats. , 1974, Journal of comparative and physiological psychology.

[39]  N. Mackintosh The psychology of animal learning , 1974 .

[40]  R. Rescorla,et al.  Extinction of Pavlovian conditioned inhibition. , 1974, Journal of comparative and physiological psychology.

[41]  A. G. Baker Conditioned inhibition is not the symmetrical opposite of conditioned excitation: A test of the Rescorla-Wagner model , 1974 .

[42]  A. Kendon,et al.  Organization of behavior in face-to-face interaction , 1975 .

[43]  E. Gibson,et al.  The Psychology of Reading , 1977 .

[44]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[45]  S. Klein,et al.  The effect of different levels of pre-exposure to sucrose on the acquisition and extinction of a conditioned aversion. , 1975, Behavioral biology.

[46]  D. Medin A theory of context in discrimination learning , 1975 .

[47]  D. Blanchard,et al.  Environmental control of defensive reactions to footshock , 1976 .

[48]  R. Lubow,et al.  Latent inhibition: The effects of ITI and CS intensity during preexposure☆ , 1976 .

[49]  N. Mackintosh,et al.  Surprise and the attenuation of blocking. , 1976 .

[50]  N. Mackintosh,et al.  Locus of the Effect of a Surprising Reinforcer in the Attenuation of Blocking , 1977 .

[51]  Enhancing the expression of flavor neophobia: some effects of the ingestion-illness contingency. , 1977, Journal of experimental psychology. Animal behavior processes.

[52]  O. K. Fudim,et al.  Sensory preconditioning of flavors with a formalin-produced sodium need. , 1978, Journal of experimental psychology. Animal behavior processes.

[53]  O. K. Fudim Sensory preconditioning of flavors with a formalin-produced sodium need. , 1978, Journal of experimental psychology. Animal behavior processes.

[54]  N. Mackintosh,et al.  One-Trial Overshadowing , 1979 .

[55]  A C Kamil,et al.  Search Image Formation in the Blue Jay (Cyanocitta cristata) , 1979, Science.

[56]  N. Mackintosh,et al.  Reinforcer specificity in the enhancement of conditioning by posttrial surprise. , 1979 .

[57]  W. K. Honig,et al.  Cognitive Processes in Animal Behavior , 1979 .

[58]  A. R. Wagner,et al.  One-trial overshadowing: evidence of distributive processing. , 1980, Journal of experimental psychology. Animal behavior processes.

[59]  J. Pearce,et al.  A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980 .

[60]  Geoffrey Hall Exposure learning in animals , 1980 .

[61]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[62]  R. R. Miller,et al.  Associations to contextual stimuli as a determinant of long-term habituation. , 1981, Journal of experimental psychology. Animal behavior processes.

[63]  R. F. Westbrook,et al.  Short- and long-term decrements in toxicosis-induced odor-aversion learning: the role of duration of exposure to an odor. , 1981, Journal of experimental psychology. Animal behavior processes.

[64]  Peter C. Holland,et al.  Acquisition of Representation-Mediated Conditioned Food Aversions. , 1981 .

[65]  G. Hall,et al.  Facilitation and retardation of discrimination learning after exposure to the stimuli. , 1981, Journal of experimental psychology. Animal behavior processes.

[66]  P. Mercier,et al.  Extinction of the context and latent inhibition , 1982 .

[67]  N. Mackintosh,et al.  Conditioning And Associative Learning , 1983 .

[68]  G. Hall,et al.  A Search for Context-Stimulus Associations in Latent Inhibition , 1984 .

[69]  N. Mackintosh,et al.  Context specificity of conditioning, extinction, and latent inhibition. , 1984 .

[70]  Robert A. Boakes,et al.  Transfer of Relational Rules in Matching and Oddity Learning by Pigeons and Corvids , 1985 .

[71]  Geoffrey Hall,et al.  Differential effects of contextual change on latent inhibition and on the habituation of an orienting response , 1985 .

[72]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[73]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[74]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[75]  R. R. Miller,et al.  Retrieval variability: sources and consequences. , 1986, The American journal of psychology.

[76]  G. Hall,et al.  Context Specificity of Latent Inhibition in Taste Aversion Learning , 1986, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[77]  M. Fanselow Associative vs topographical accounts of the immediate shock-freezing deficit in rats: Implications for the response selection rules governing species-specific defensive reactions ☆ , 1986 .

[78]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[79]  J. Pearce A model for stimulus generalization in Pavlovian conditioning. , 1987, Psychological review.

[80]  Ralph R. Miller,et al.  The comparator hypothesis: A response rule for the expression of associations. , 1988 .

[81]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[82]  Ralph R. Miller,et al.  Learned irrelevance exceeds the sum of CS-preexposure and US-preexposure deficits. , 1988 .

[83]  J. Pearce,et al.  The orienting response as an index of stimulus associability in rats. , 1988, Journal of experimental psychology. Animal behavior processes.

[84]  N. Mackintosh,et al.  An associative theory of the representation of stimuli: Applications to perceptual learning and latent inhibition. , 1989 .

[85]  V. D. Chamizo,et al.  Latent learning and latent inhibition in maze discriminations , 1989 .

[86]  R. C. Honey,et al.  Enhanced discriminability and reduced associability following flavor preexposure , 1989 .

[87]  Ralph R. Miller,et al.  Superconditioning and Overshadowing , 1989 .

[88]  R. C. Honey,et al.  Stimulus generalization as a function of stimulus novelty and familiarity in rats. , 1990, Journal of experimental psychology. Animal behavior processes.

[89]  M. Fanselow Factors governing one-trial contextual conditioning , 1990 .

[90]  V. D. Chamizo,et al.  Perceptual Learning in Maze Discriminations , 1991, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[91]  Geoffrey Hall Perceptual and associative learning , 1991 .

[92]  V. D. Chamizo,et al.  Role of Context in Perceptual Learning in Maze Discriminations , 1992, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[93]  T Poggio,et al.  Fast perceptual learning in visual hyperacuity. , 1991, Science.

[94]  R. F. Westbrook,et al.  Effects of Exposure to a To-Be-Shocked Environment upon the Rat's Freezing Response: Evidence for Facilitation, Latent Inhibition, and Perceptual Learning , 1993, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[95]  M. Bouton Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. , 1993, Psychological bulletin.

[96]  V. D. Chamizo,et al.  Effects of Pre-Exposure to the same or Different Pattern of Extra-Maze Cues on Subsequent Extra-Maze Discrimination , 1994, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[97]  R. C. Honey,et al.  The Role of Stimulus Comparison in Perceptual Learning: An Investigation with the Domestic Chick , 1994, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[98]  J. Pearce Similarity and discrimination: a selective review and a connectionist model. , 1994, Psychological review.

[99]  Robert C. Barnet,et al.  Latent inhibition as a performance deficit resulting from CS—context associations , 1994 .

[100]  N. Mackintosh,et al.  Latent Inhibition, Context Specificity, and Context Familiarity , 1994, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[101]  Reduced generalization following preexposure: latent inhibition of common elements or a difference in familiarity? , 1994, Journal of experimental psychology. Animal behavior processes.

[102]  E. Wasserman,et al.  Cue Competition in Causality Judgments: The Role of Nonpresentation of Compound Stimulus Elements , 1994 .

[103]  N. Mackintosh,et al.  Inhibitory associations between neutral stimuli in flavor-aversion conditioning , 1995 .

[104]  M Symonds Perceptual learning in flavour aversion conditioning. , 1995 .

[105]  N. Mackintosh,et al.  Visual search for cryptic stimuli in pigeons: implications for the search image and search rate hypotheses , 1995, Animal Behaviour.

[106]  Geoffrey Hall,et al.  Perceptual learning in flavor aversion conditioning: Roles of stimulus comparison and latent inhibition of common stimulus elements☆ , 1995 .

[107]  Ralph R. Miller,et al.  Temporal encoding in trace conditioning , 1995 .

[108]  R. Bevins,et al.  One-trial context fear conditioning as a function of the interstimulus interval , 1995 .

[109]  Ralph R. Miller,et al.  Assessment of the Rescorla-Wagner model. , 1995 .

[110]  R. C. Honey,et al.  Stimulus Comparison and Perceptual Learning: Further Evidence and Evaluation from an Imprinting Procedure , 1996, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[111]  R. R. Miller,et al.  Biological significance in forward and backward blocking: resolution of a discrepancy between animal conditioning and human causal judgment. , 1996, Journal of experimental psychology. General.

[112]  N. Mackintosh,et al.  Facilitation and Retardation of Flavour Aversion Conditioning following Prior Exposure to the CS , 1996, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[113]  A. Dickinson,et al.  Within Compound Associations Mediate the Retrospective Revaluation of Causality Judgements , 1996, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[114]  V. D. Chamizo,et al.  Aprendizaje perceptivo en discriminaciones espaciales , 1996 .

[115]  N. Mackintosh,et al.  Perceptual differentiation during categorization learning by pigeons. , 1996 .

[116]  Geoffrey Hall,et al.  Backward Sensory Preconditioning , 1996 .

[117]  I. Mclaren,et al.  Generalization in Human Category Learning: A Connectionist Account of Differences in Gradient after Discriminative and Non discriminative Training , 1997 .

[118]  The Effect of Stimulus Preexposure on Responding during a Compound Stimulus , 1997 .

[119]  V. D. Chamizo,et al.  Blocking in the spatial domain. , 1997, Journal of experimental psychology. Animal behavior processes.

[120]  R. Bevins,et al.  Converging evidence for one-trial context fear conditioning with an immediate shock: importance of shock potency. , 1997, Journal of experimental psychology. Animal behavior processes.

[121]  Stimulus Preexposure, Comparison, and Changes in the Associability of Common Stimulus Features , 1997, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[122]  K. Plaisted The effect of interstimulus interval on the discrimination of cryptic targets. , 1997 .

[123]  I P McLaren,et al.  Categorization and Perceptual Learning: An Analogue of the Face Inversion Effect , 1997, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[124]  I. Mclaren,et al.  Perceptual Learning and Free Classification , 1998, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[125]  R. R. Miller,et al.  Temporal encoding as a determinant of overshadowing. , 1998, Journal of experimental psychology. Animal behavior processes.

[126]  I. Mclaren,et al.  Perceptual Categorization: Connectionist Modelling and Decision Rules , 1998, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[127]  N. Mackintosh,et al.  Simultaneous activation of the representations of absent cues results in the formation of an excitatory association between them. , 1998 .

[128]  N. Mackintosh,et al.  Comparison and Contrast as a Mechanism of Perceptual Learning? , 1999, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[129]  Sarah Wills,et al.  Relational Learning in Pigeons? , 1999 .

[130]  Dominic Michael Dwyer,et al.  Retrospective revaluation or mediated conditioning? The effect of different reinforcers. , 1999, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[131]  V. D. Chamizo,et al.  Latent inhibition and perceptual learning in a swimming-pool navigation task. , 1999, Journal of experimental psychology. Animal behavior processes.

[132]  L. Saksida Effects of similarity and experience on discrimination learning: a nonassociative connectionist model of perceptual learning. , 1999, Journal of experimental psychology. Animal behavior processes.

[133]  N. Mackintosh,et al.  The role of inhibitory associations in perceptual learning , 1999 .

[134]  N. Mackintosh,et al.  Is the context specificity of latent inhibition a sufficient explanation of learned irrelevance? , 2000, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.