Brain mechanisms for changes in processing of conditioned stimuli in Pavlovian conditioning: Implications for behavior theory

This article is a review of the results of a series of experiments designed to identify brain systems involved in appetitive conditioning of rats. It discusses some of their implications for behavioral theories of learning, especially those that concern changes in processing of conditioned stimuli (CSs). Evidence is presented which suggests that separable brain circuits are involved in (1) the production of CS-dependent conditioned orienting responses, (2) the enhancement of CS associability produced when expectancies about upcoming events are violated, (3) the reduction of CS associability produced when stimuli are consistent predictors of other events or are presented without consequence, and (4) the abilities of CSs to serve as reinforcers for second-order conditioning and to be sensitive to postconditioning changes in the value of the unconditioned stimulus (US). Finally, none of these circuits seems critical for normal acquisition of the most common indicator of Pavlovian conditioning, US-dependent conditioned responses (CRs). Although the independence of brain pathways does not demand independence of behavioral function, clustering of behavioral phenomena on anatomical grounds may provide useful guides for constructing behavior theories.

[1]  J. H. Curtis,et al.  Learning Theory and Behavior , 1960 .

[2]  R. Rescorla,et al.  Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. , 1967, Psychological review.

[3]  L. Kamin.  Attention-like processes in classical conditioning , 1967 .

[4]  E. D. Kemble,et al.  Runway performance of rats following amygdaloid lesions. , 1970, Physiology & behavior.

[5]  N. Mackintosh,et al.  Blocking as a Function of Novelty of CS and Predictability of UCS , 1971, The Quarterly journal of experimental psychology.

[6]  R. Rescorla.  A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[7]  P. Henke,et al.  Lesions in the amygdala and the frustration effect. , 1973, Physiology & behavior.

[8]  P. Solomon,et al.  Latent inhibition and stimulus generalization of the classically conditioned nictitating membrane response in rabbits (Oryctolagus cuniculus) following dorsal hippocampal ablation. , 1975, Journal of comparative and physiological psychology.

[9]  N. Mackintosh.  A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[10]  H. Rachlin.  Behavior and learning , 1976 .

[11]  N. Mackintosh,et al.  Surprise and the attenuation of blocking. , 1976 .

[12]  A. R. Lurii︠a︡,et al.  The neuropsychology of memory , 1977 .

[13]  P. Holland.  Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. , 1977, Journal of experimental psychology. Animal behavior processes.

[14]  P. Solomon.  Role of the hippocampus in blocking and conditioned inhibition of the rabbit's nictitating membrane response. , 1977, Journal of comparative and physiological psychology.

[15]  T. L. Bennett,et al.  Hippocampectomy and the attenuation of blocking. , 1978, Behavioral biology.

[16]  P. Holland,et al.  Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. , 1979, Journal of experimental psychology. Animal behavior processes.

[17]  P. Holland,et al.  Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats. , 1979, Journal of experimental psychology. Animal behavior processes.

[18]  P. Holland.  The effects of qualitative and quantitative variation in the US on individual components of Pavlovian appetitive conditioned behavior in rats , 1979 .

[19]  P. Holland,et al.  Influence of visual conditioned stimulus characteristics on the form of Pavlovian appetitive conditioned responding in rats. , 1980, Journal of experimental psychology. Animal behavior processes.

[20]  A. Luria.  Higher Cortical Functions in Man , 1980, Springer US.

[21]  P. Holland.  CS-US interval as a determinant of the form of Pavlovian appetitive conditioned responses. , 1980, Journal of experimental psychology. Animal behavior processes.

[22]  J. Pearce,et al.  A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980 .

[23]  D. Amaral,et al.  An autoradiographic study of the projections of the central nucleus of the monkey amygdala , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  R. Lubow,et al.  The effects of compound stimulus preexposure of two elements differing in salience on the acquisition of conditioned suppression , 1982 .

[25]  J. Pearce,et al.  Restoring the Associability of a Pre-Exposed CS by a Surprising Event , 1982 .

[26]  J. Staddon.  Adaptive behavior and learning , 1983 .

[27]  H. Weingarten.  Conditioned cues elicit feeding in sated rats: a role for learning in meal initiation. , 1983, Science.

[28]  F. J. Friedrich,et al.  Effects of parietal injury on covert orienting of attention , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  N. Mackintosh,et al.  Successful overshadowing and blocking in hippocampectomized rats , 1984, Behavioural Brain Research.

[30]  P. Holland.  Origins of Behavior in Pavlovian Conditioning , 1984 .

[31]  J. Pearce,et al.  The strength of the orienting response during Pavlovian conditioning. , 1984, Journal of experimental psychology. Animal behavior processes.

[32]  P. Holland.  Unblocking in Pavlovian appetitive conditioning. , 1984, Journal of experimental psychology. Animal behavior processes.

[33]  J. Pearce,et al.  The Effect of Informative Events on Response Rate , 1985 .

[34]  Pretraining a compound conditioned stimulus reduces unblocking , 1985 .

[35]  J. Pearce,et al.  Predictive Accuracy and the Effects of Partial Reinforcement on Serial Autoshaping , 1985 .

[36]  J. Pearce,et al.  Hippocampal lesions attenuate latent inhibition of a CS and of a neutral stimulus , 1987, Psychobiology.

[37]  S. Petersen,et al.  Contributions of the pulvinar to visual spatial attention , 1987, Neuropsychologia.

[38]  M. Lamb.  Selective attention: effects of cuing on the processing of different types of compound stimuli. , 1988, Journal of experimental psychology. Animal behavior processes.

[39]  J. Pearce,et al.  The Influence of Predictive Accuracy on Serial Conditioning in the Rat , 1988 .

[40]  Joseph E LeDoux,et al.  Different projections of the central amygdaloid nucleus mediate autonomic and behavioral correlates of conditioned fear , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  J. Pearce,et al.  The orienting response as an index of stimulus associability in rats. , 1988, Journal of experimental psychology. Animal behavior processes.

[42]  P. Holland.  Excitation and inhibition in unblocking. , 1988, Journal of experimental psychology. Animal behavior processes.

[43]  E. Grove,et al.  Neural associations of the substantia innominata in the rat: Afferent connections , 1988, The Journal of comparative neurology.

[44]  T. Robbins,et al.  Effects of unilateral dorsal and ventral striatal dopamine depletion on visual neglect in the rat: A neural and behavioural analysis , 1989, Neuroscience.

[45]  T. Robbins,et al.  Involvement of the amygdala in stimulus-reward associations: Interaction with the ventral striatum , 1989, Neuroscience.

[46]  M. Gallagher,et al.  The amygdala central nucleus and appetitive Pavlovian conditioning: lesions impair one class of conditioned behavior , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  P. Holland.  Event representation in Pavlovian conditioning: Image and action , 1990, Cognition.

[48]  Michael Davis,et al.  Efferent pathway of the amygdala involved in conditioned fear as measured with the fear-potentiated startle paradigm. , 1991, Behavioral neuroscience.

[49]  L. Heimer,et al.  Piecing together the puzzle of basal forebrain anatomy. , 1991, Advances in experimental medicine and biology.

[50]  R. Rescorla.  Separate reinforcement can enhance the effectiveness of modulators , 1991 .

[51]  N. Schmajuk,et al.  A neural network approach to hippocampal function in classical conditioning. , 1991, Behavioral neuroscience.

[52]  J. Pearce,et al.  Restoration of the Orienting Response to a Light by a Change in its Predictive Accuracy , 1992 .

[53]  J. Edeline,et al.  Associative retuning in the thalamic source of input to the amygdala and auditory cortex: receptive field plasticity in the medial division of the medial geniculate body. , 1992, Behavioral neuroscience.

[54]  Michael Davis,et al.  The role of the amygdala in conditioned fear. , 1992 .

[55]  John P. Aggleton,et al.  The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction. , 1992 .

[56]  S. Pellis,et al.  Toward a Synthetic Physiological Psychology , 1992 .

[57]  P. Holland,et al.  Understanding the function of the central nucleus: Is simple conditioning enough? , 1992 .

[58]  Joseph E. LeDoux,et al.  Emotion and the amygdala. , 1992 .

[59]  D. A. Riley,et al.  Spatial and configural factors in compound stimulus processing by pigeons , 1992 .

[60]  R. J. McDonald,et al.  A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. , 1993, Behavioral neuroscience.

[61]  M. Gallagher,et al.  Amygdala central nucleus lesions disrupt increments, but not decrements, in conditioned stimulus processing. , 1993, Behavioral neuroscience.

[62]  P. Holland,et al.  Effects of amygdala central nucleus lesions on blocking and unblocking. , 1993, Behavioral neuroscience.

[63]  Michela Gallagher,et al.  Amygdala central nucleus lesions disrupt increments, but not decrements, in conditioned stimulus processing. , 1993, Behavioral Neuroscience.

[64]  R. C. Honey,et al.  Selective hippocampal lesions abolish the contextual specificity of latent inhibition and conditioning. , 1993, Behavioral neuroscience.

[65]  M. Gallagher,et al.  The amygdala complex: multiple roles in associative learning and attention. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[66]  J. Pearce.  Similarity and discrimination: a selective review and a connectionist model. , 1994, Psychological review.

[67]  B. Kapp,et al.  Effects of electrical stimulation of the amygdaloid central nucleus on neocortical arousal in the rabbit. , 1994, Behavioral neuroscience.

[68]  E. Salzmann.  Attention and memory trials during neuronal recording from the primate pulvinar and posterior parietal cortex (area PG) , 1995, Behavioural Brain Research.

[69]  M. Gallagher,et al.  Hippocampal lesions disrupt decrements but not increments in conditioned stimulus processing , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[70]  P. Holland,et al.  Basal forebrain cholinergic lesions disrupt increments but not decrements in conditioned stimulus processing , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[71]  Intact spatial learning in both young and aged rats following selective removal of hippocampal cholinergic input. , 1996, Behavioral neuroscience.

[72]  T. Robbins,et al.  Effects of excitotoxic lesions of the central amygdaloid nucleus on the potentiation of reward-related stimuli by intra-accumbens amphetamine. , 1996, Behavioral neuroscience.

[73]  Effects of excitotoxic lesions of the central amygdaloid nucleus on the potentiation of reward-related stimuli by intra-accumbens amphetamine. , 1996, Behavioral neuroscience.

[74]  P. Holland,et al.  Neurotoxic Lesions of Basolateral, But Not Central, Amygdala Interfere with Pavlovian Second-Order Conditioning and Reinforcer Devaluation Effects , 1996, The Journal of Neuroscience.

[75]  A. Chiba,et al.  The amygdala and emotion , 1996, Current Opinion in Neurobiology.

[76]  P. Holland,et al.  Disruption of Decrements in Conditioned Stimulus Processing by Selective Removal of Hippocampal Cholinergic Input , 1997, The Journal of Neuroscience.

[77]  P. Holland,et al.  The Role of an Amygdalo-Nigrostriatal Pathway in Associative Learning , 1997, The Journal of Neuroscience.