Relations between Pavlovian-instrumental transfer and reinforcer devaluation.

Relations between posttraining reinforcer devaluation and Pavlovian-instrumental transfer were examined in 2 experiments. When a single reinforcer was used, extended training of the instrumental response increased transfer but reduced devaluation effects. When multiple instrumental reinforcers were used, both reinforcer-specific transfer and devaluation effects were less influenced by the amount of instrumental training. Finally, although reinforcer devaluation decreased both Pavlovian conditioned responses and baseline instrumental responding, it had no effect on either single-reinforcer or reinforcer-specific transfer. These results indicate that transfer and reinforcer devaluation can reflect different aspects of associative learning and that the nature of associative learning can be influenced by parameters such as the amount of training and the use of multiple reinforcers.

[1]  W. Estes.  Discriminative conditioning. I. A discriminative property of conditioned anticipation. , 1943 .

[2]  R. Rescorla,et al.  Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. , 1967, Psychological review.

[3]  José M. R. Delgado,et al.  Integrative Activity of the Brain , 1968, The Yale Journal of Biology and Medicine.

[4]  D. R. Thomas,et al.  Information value and stimulus configuring as factors in conditioned reinforcement. , 1968, Journal of experimental psychology.

[5]  N. Azrin,et al.  Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli. , 1969, Journal of the experimental analysis of behavior.

[6]  Simultaneous and backward fear conditioning in the rat. , 1973, Journal of comparative and physiological psychology.

[7]  Heith Cd,et al.  Simultaneous and backward fear conditioning in the rat. , 1973 .

[8]  D. Bindra.  A motivational view of learning, performance, and behavior modification. , 1974, Psychological review.

[9]  W. K. Honig,et al.  Handbook of Operant Behavior , 2022 .

[10]  J. Karpicke.  Directed approach responses and positive conditioned suppression in the rat , 1978 .

[11]  P. Lovibond.  Effects of long- and variable-duration signals for food on activity, instrumental responding, and eating , 1980 .

[12]  J. E. Sherman,et al.  Aversion to the reinforcer differentially affects conditioned reinforcement and instrumental responding. , 1981, Journal of experimental psychology. Animal behavior processes.

[13]  P. Lovibond.  Appetitive Pavlovian-Instrumental Interactions: Effects of Inter-Stimulus Interval and Baseline Reinforcement Conditions , 1981, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[14]  Christopher D. Adams.  Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[15]  A. Dickinson,et al.  Irrelevant Incentive Learning during Instrumental Conditioning: The Role of the Drive-Reinforcer and Response-Reinforcer Relationships , 1983 .

[16]  Christopher D. Adams,et al.  The Effect of the Instrumental Training Contingency on Susceptibility to Reinforcer Devaluation , 1983 .

[17]  A. Dickinson,et al.  Irrelevant Incentive Learning during Training on Ratio and Interval Schedules , 1983 .

[18]  H. Weingarten.  Conditioned cues elicit feeding in sated rats: a role for learning in meal initiation. , 1983, Science.

[19]  R. Rescorla,et al.  Instrumental responding remains sensitive to reinforcer devaluation after extensive training , 1985 .

[20]  M. Schlossberg.  Information Processing in Animals: Memory Mechanisms. , 1986 .

[21]  A. Dickinson,et al.  Pavlovian Processes in the Motivational Control of Instrumental Performance , 1987 .

[22]  R. Rescorla.  Pavlovian conditioning. It's not what you think it is. , 1988, The American psychologist.

[23]  R. Rescorla,et al.  Associations between the discriminative stimulus and the reinforcer in instrumental learning. , 1988 .

[24]  Effect of reinforcer devaluation on discriminative control of instrumental behavior. , 1990, Journal of experimental psychology. Animal behavior processes.

[25]  R. Rescorla.  Instrumental responses become associated with reinforcers that differ in one feature , 1990 .

[26]  P. Holland.  Event representation in Pavlovian conditioning: Image and action , 1990, Cognition.

[27]  D. Weisz,et al.  An associative process maintains reflex facilitation of the unconditioned nictitating membrane response during the early stages of training. , 1990, Behavioral neuroscience.

[28]  Modulation of a discrete Pavlovian conditioned reflex by a putative emotive Pavlovian conditioned stimulus. , 1991, Journal of experimental psychology. Animal behavior processes.

[29]  R. Rescorla.  Response-outcome versus outcome-response associations in instrumental learning , 1992 .

[30]  R. Rescorla.  Transfer of instrumental control mediated by a devalued outcome , 1994 .

[31]  R. Colwill,et al.  Encoding of the unconditioned stimulus in Pavlovian conditioning , 1994 .

[32]  R. Boakes,et al.  Motivational control after extended instrumental training , 1995 .

[33]  B. Balleine,et al.  Motivational Control of Instrumental Action , 1995 .

[34]  P. Holland,et al.  Neurotoxic Lesions of Basolateral, But Not Central, Amygdala Interfere with Pavlovian Second-Order Conditioning and Reinforcer Devaluation Effects , 1996, The Journal of Neuroscience.

[35]  P. Holland.  Brain mechanisms for changes in processing of conditioned stimuli in Pavlovian conditioning: Implications for behavior theory , 1997 .

[36]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[37]  K. Lattal,et al.  Trial and intertrial durations in Pavlovian conditioning: issues of learning and performance. , 1999, Journal of experimental psychology. Animal behavior processes.

[38]  J. Mirenowicz,et al.  Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. , 2000, Behavioral neuroscience.

[39]  P. Holland.  Trial and intertrial durations in appetitive conditioning in rats , 2000 .

[40]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[41]  Kimberly S. Kirkpatrick,et al.  Independent effects of stimulus and cycle duration in conditioning: The role of timing processes , 2000 .

[42]  A. Dickinson,et al.  Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour , 2001, The European journal of neuroscience.

[43]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[44]  G. Hall,et al.  Lesions of the Basolateral Amygdala Disrupt Selective Aspects of Reinforcer Representation in Rats , 2001, The Journal of Neuroscience.

[45]  P. Holland,et al.  The effects of amygdala lesions on conditioned stimulus-potentiated eating in rats , 2002, Physiology & Behavior.

[46]  S. S. Stevens,et al.  Learning, motivation, and emotion , 2002 .

[47]  R. Colwill,et al.  Instrumental responding remains under the control of the consequent outcome after extended training , 2002, Behavioural Processes.

[48]  J. N. P. Rawlins,et al.  Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats , 2002, Experimental Brain Research.

[49]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .

[50]  P. Holland,et al.  Double dissociation of the effects of lesions of basolateral and central amygdala on conditioned stimulus‐potentiated feeding and Pavlovian‐instrumental transfer , 2003, The European journal of neuroscience.

[51]  B. Balleine,et al.  Instrumental and Pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain. , 2003, Journal of experimental psychology. Animal behavior processes.