The Role of Associative History in Models of Associative Learning: A Selective Review and a Hybrid Model

Associative learning theories strive to capture the processes underlying and driving the change in strength of the associations between representations of stimuli that develop as a result of experience of the predictive relationships between those stimuli. Historically, formal models of associative learning have focused on two potential factors underlying associative change, namely processing of the conditioned stimulus (in terms of changes in associability) and processing of the unconditioned stimulus (in terms of changes in error). This review constitutes an analysis of the proper role of these two factors, specifically with regard to the way in which they are influenced by associative history (the prior training undergone by cues). A novel “hybrid” model of associative learning is proposed and is shown to provide a more satisfactory account of the effects of associative history on subsequent learning than any previous single-process theory.

[1]  E. Thorndike.  “Animal Intelligence” , 1898, Nature.

[2]  R. R. Bush,et al.  A mathematical model for simple learning. , 1951, Psychological review.

[3]  L. S. Reid,et al.  The development of noncontinuity behavior through continuity learning. , 1953, Journal of experimental psychology.

[4]  L. Kamin.  Predictability, surprise, attention, and conditioning , 1967 .

[5]  K. Haberlandt,et al.  Stimulus selection in animal discrimination learning. , 1968, Journal of Experimental Psychology.

[6]  José M. R. Delgado,et al.  Integrative Activity of the Brain , 1968, The Yale Journal of Biology and Medicine.

[7]  N. Mackintosh.  Further analysis of the overtraining reversal effect. , 1969, Journal of comparative and physiological psychology.

[8]  R. Rescorla.  Pavlovian conditioned inhibition , 1969 .

[9]  A. M. Schrier,et al.  Consecutive intradimensional and extradimensional shifts in monkeys. , 1969 .

[10]  R. Rescorla.  Conditioned inhibition of fear resulting from negative CS-US contingencies. , 1969, Journal of comparative and physiological psychology.

[11]  N. Mackintosh,et al.  Intradimensional and extradimensional shift learning by pigeons , 1969 .

[12]  R. Rescorla.  Reduction in the effectiveness of reinforcement after prior excitatory conditioning , 1970 .

[13]  N. Mackintosh,et al.  Mechanisms of animal discrimination learning , 1971 .

[14]  R. C. Tees,et al.  Optional intradimensional and extradimensional shifts in the rat. , 1971, Journal of comparative and physiological psychology.

[15]  R. Rescorla.  Variation in the effectiveness of reinforcement and nonreinforcement following prior inhibitory conditioning , 1971 .

[16]  N. Mackintosh,et al.  Blocking as a Function of Novelty of CS and Predictability of UCS , 1971, The Quarterly journal of experimental psychology.

[17]  K. Spence,et al.  Essays in neobehaviorism : a memorial volume to Kenneth W. Spence , 1971 .

[18]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[19]  N. J. Mackintosh,et al.  Stimulus selection: Learning to ignore stimuli that predict no change in reinforcement. , 1973 .

[20]  E. Wasserman.  STIMULUS-REINFORCER PREDICTIVENESS AND SELECTIVE DISCRIMINATION LEARNING IN PIGEONS ' , 1974 .

[21]  N. Mackintosh.  A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[22]  N. Mackintosh,et al.  Surprise and the attenuation of blocking. , 1976 .

[23]  A. G. Baker,et al.  Excitatory and inhibitory conditioning following uncorrelated presentations of CS and UCS , 1977 .

[24]  E. Kremer.  The Rescorla-Wagner model: losses in associative strength in compound conditioned stimuli. , 1978, Journal of experimental psychology. Animal behavior processes.

[25]  V. Lolordo,et al.  Associative and nonassociative theories of the UCS preexposure phenomenon: implications for Pavlovian conditioning. , 1979, Psychological bulletin.

[26]  P. Seraganian.  Extradimensional transfer in the easy-to-hard effect , 1979 .

[27]  A. G. Baker,et al.  Preexposure to the CS alone, US alone, or CS and US uncorrelated: Latent inhibition, blocking by context or learned irrelevance? , 1979 .

[28]  N. Mackintosh,et al.  Reinforcer specificity in the enhancement of conditioning by posttrial surprise. , 1979 .

[29]  J. Pearce,et al.  Latent inhibition of a CS during CS-US pairings. , 1979, Journal of experimental psychology. Animal behavior processes.

[30]  Evaluation of blocking and conditioned inhibition to a CS signaling a decrease in US intensity. , 1980, Journal of experimental psychology. Animal behavior processes.

[31]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[32]  Anthony Dickinson,et al.  Loss of Associability by a Conditioned Inhibitor* , 1982, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[33]  N. Mackintosh,et al.  Inhibitory Conditioning Resulting from a Reduction in the Magnitude of Reinforcement , 1982, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[34]  J. Pearce,et al.  Restoring the Associability of a Pre-Exposed CS by a Surprising Event , 1982 .

[35]  Geoffrey Hall,et al.  Contextual effects in latent inhibition with an appetitive conditioning procedure , 1983 .

[36]  A. Dickinson,et al.  Judgement of Act-Outcome Contingency: The Role of Selective Attribution , 1984 .

[37]  G. Hall,et al.  A Search for Context-Stimulus Associations in Latent Inhibition , 1984 .

[38]  J. Pearce,et al.  The strength of the orienting response during Pavlovian conditioning. , 1984, Journal of experimental psychology. Animal behavior processes.

[39]  P. Holland.  Unblocking in Pavlovian appetitive conditioning. , 1984, Journal of experimental psychology. Animal behavior processes.

[40]  JOHN W. Moore,et al.  Real-time attentional models for classical conditioning and the hippocampus , 1985 .

[41]  Ralph R. Miller,et al.  Information processing in animals : conditioned inhibition , 1985 .

[42]  M. Schlossberg.  Information Processing in Animals: Memory Mechanisms. , 1986 .

[43]  Mark E. Bouton,et al.  Contextual control of negative transfer produced by prior CS-US pairings , 1986 .

[44]  N. Mackintosh,et al.  Context Specificity of Conditioning and Latent Inhibition: Evidence for a Dissociation of Latent Inhibition and Associative Interference , 1987 .

[45]  Ralph R. Miller,et al.  The comparator hypothesis: A response rule for the expression of associations. , 1988 .

[46]  T. Robbins,et al.  The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates , 1988, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[47]  Ralph R. Miller,et al.  Learned irrelevance exceeds the sum of CS-preexposure and US-preexposure deficits. , 1988 .

[48]  J. Pearce,et al.  The orienting response as an index of stimulus associability in rats. , 1988, Journal of experimental psychology. Animal behavior processes.

[49]  P. Holland.  Excitation and inhibition in unblocking. , 1988, Journal of experimental psychology. Animal behavior processes.

[50]  N. Mackintosh,et al.  An associative theory of the representation of stimuli: Applications to perceptual learning and latent inhibition. , 1989 .

[51]  R. Lubow.  Latent Inhibition and Conditioned Attention Theory , 1989 .

[52]  Ralph R. Miller,et al.  Superconditioning and Overshadowing , 1989 .

[53]  Geoffrey Hall.  Perceptual and associative learning , 1991 .

[54]  J. Pearce,et al.  Restoration of the Orienting Response to a Light by a Change in its Predictive Accuracy , 1992 .

[55]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[56]  K. White,et al.  Dimensional Shift and the Transfer of Attention , 1993 .

[57]  M. Bouton.  Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. , 1993, Psychological bulletin.

[58]  M. Bouton.  Conditioning, remembering, and forgetting. , 1994 .

[59]  J. Pearce.  Similarity and discrimination: a selective review and a connectionist model. , 1994, Psychological review.

[60]  W. Estes.  Toward a Statistical Theory of Learning. , 1994 .

[61]  Supernormal conditioning. , 1995, Journal of experimental psychology. Animal behavior processes.

[62]  N. Mackintosh,et al.  Learned Irrelevance is not the Sum of Exposure to CS and US , 1995, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[63]  C. Buhusi,et al.  Attention, configuration, and hippocampal function , 1996, Hippocampus.

[64]  Blocking, unblocking, and overexpectation in autoshaping with pigeons. , 1996, Journal of the experimental analysis of behavior.

[65]  Geoffrey Hall,et al.  Learned Irrelevance: No More Than the Sum of CS and US Preexposure Effects? , 1996 .

[66]  Additivity of the effects of retention interval and context change on latent inhibition: toward resolution of the context forgetting paradox. , 1997, Journal of experimental psychology. Animal behavior processes.

[67]  Sadahiko Nakajima,et al.  Overexpectation in appetitive Pavlovian and instrumental conditioning , 1998 .

[68]  J. Pearce,et al.  The role of attention in the solution of conditional discriminations , 1998 .

[69]  Jose Prados,et al.  Active preexposure enhances attention to the landmarks surrounding a Morris swimming pool. , 1999 .

[70]  J. Pearce,et al.  Acquired distinctiveness is controlled by stimulus relevance not correlation with reward , 1999 .

[71]  Nathaniel J. Blair,et al.  Blocking and backward blocking involve learned inattention , 2000, Psychonomic bulletin & review.

[72]  R. Rescorla.  Associative changes in excitors and inhibitors differ when they are conditioned in compound. , 2000, Journal of experimental psychology. Animal behavior processes.

[73]  N. Mackintosh,et al.  Is the context specificity of latent inhibition a sufficient explanation of learned irrelevance? , 2000, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[74]  J. Pearce,et al.  The effects of pre-exposure on escape from a Morris pool , 2001, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[75]  R. C. Honey,et al.  Involvement of the entorhinal cortex in a process of attentional modulation: evidence from a novel variant of an IDS/EDS procedure. , 2001, Behavioral neuroscience.

[76]  J. Pearce,et al.  Theories of associative learning in animals. , 2001, Annual review of psychology.

[77]  J. Kruschke.  Toward a unified model of attention in associative learning , 2001 .

[78]  R. Rescorla.  Unequal Associative Changes when Excitors and Neutral Stimuli are Conditioned in Compound , 2001, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[79]  Tom Beckers,et al.  A Review of Recent Developments in Research and Theories on Human Contingency Learning , 2002, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[80]  M. McDevitt,et al.  Inhibition and Superconditioning , 2002, Psychological science.

[81]  R. Rescorla,et al.  Effect of following an excitatory-inhibitory compound with an intermediate reinforcer. , 2002, Journal of experimental psychology. Animal behavior processes.

[82]  I. Mclaren,et al.  Representation and Discrimination on an Artificial Dimension , 2003, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[83]  I. Mclaren,et al.  Learned Associability and Associative Change in Human Causal Learning , 2003, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[84]  Charlotte Bonardi,et al.  Learned Irrelevance: A Contemporary Overview , 2003, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[85]  Edgar H Vogel,et al.  Stimulus representation in SOP: I Theoretical rationalization and some implications , 2003, Behavioural Processes.

[86]  N. Mackintosh,et al.  Intradimensional and extradimensional shifts in spatial learning. , 2003, Journal of experimental psychology. Animal behavior processes.

[87]  A. R. Wagner.  Context-Sensitive Elemental Theory , 2003, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[88]  T. Lochmann,et al.  Predictive History in an Allergy Prediction Task , 2019, Proceedings of EuroCogSci 03.