Learning about Multiple Attributes of Reward in Pavlovian Conditioning

Abstract:  The nature of the reward representation in Pavlovian conditioning has been of perennial interest to students of associative learning theory. We consider the view that it consists of a range of different attributes, each of which may be governed by different learning rules. We investigated this issue through a series of experiments using a time‐sensitive Pavlovian‐to‐instrumental transfer procedure, aiming to dissociate learning about temporal and specific sensory features of a reward. Our results successfully demonstrated that learning about these different features appears to be dissociable, with learning about the specific sensory features of a Pavlovian unconditioned stimulus (US) occurring very rapidly across a wide range of experimental procedures, while learning about the temporal features of the US occurred slightly less quickly and was more sensitive to parametric disruption. These results are discussed with regard to the potential independence or interdependence of the relevant learning processes, and to some recent neurophysiological recording and brain lesion work, which provide additional means to investigate these dissociations.

[1]  S. Klein,et al.  Handbook of contemporary learning theories , 2000 .

[2]  E. Fischer Conditioned Reflexes , 1942, American journal of physical medicine.

[3]  Geoffrey Schoenbaum,et al.  Rapid Associative Encoding in Basolateral Amygdala Depends on Connections with Orbitofrontal Cortex , 2005, Neuron.

[4]  K. Berridge,et al.  Intra-Accumbens Amphetamine Increases the Conditioned Incentive Salience of Sucrose Reward: Enhancement of Reward “Wanting” without Enhanced “Liking” or Response Reinforcement , 2000, The Journal of Neuroscience.

[5]  W. Timberlake,et al.  Stimulus and response contingencies in the misbehavior of rats. , 1982, Journal of experimental psychology. Animal behavior processes.

[6]  J. Horvitz,et al.  Extended Habit Training Reduces Dopamine Mediation of Appetitive Response Expression , 2005, The Journal of Neuroscience.

[7]  Evidence for detection of one duration sample and default responding to other duration samples by pigeons may result from an artifact of retention-test ambiguity. , 2004, Journal of experimental psychology. Animal behavior processes.

[8]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[9]  J. Gibbon,et al.  Temporal control during maintenance and extinction of conditioned keypecking in ring doves , 1999 .

[10]  Kimberly S. Kirkpatrick,et al.  Independent effects of stimulus and cycle duration in conditioning: The role of timing processes , 2000 .

[11]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[12]  A. Delamater THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2004, 57B (2), 97–132 Experimental extinction in Pavlovian , 2022 .

[13]  P. Holland Event representation in Pavlovian conditioning: Image and action , 1990, Cognition.

[14]  Modulation of the acquisition of the rabbit eyeblink conditioned response by conditioned contextual stimuli. , 1998, Journal of experimental psychology. Animal behavior processes.

[15]  P. Holland,et al.  The influence of CS-US interval on several different indices of learning in appetitive conditioning. , 2008, Journal of experimental psychology. Animal behavior processes.

[16]  José M. R. Delgado,et al.  Integrative Activity of the Brain , 1968, The Yale Journal of Biology and Medicine.

[17]  Karim Nader,et al.  Memory traces unbound , 2003, Trends in Neurosciences.

[18]  A. Delamater Effects of several extinction treatments upon the integrity of Pavlovian stimulus-outcome associations , 1996 .

[19]  W. W. Rozeboom What is learned? An empirical enigma. , 1958, Psychological review.

[20]  P. Holland Relations between Pavlovian-instrumental transfer and reinforcer devaluation. , 2004, Journal of experimental psychology. Animal behavior processes.

[21]  M. Roesch,et al.  Orbitofrontal Cortex, Associative Learning, and Expectancies , 2005, Neuron.

[22]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[23]  P. Balsam,et al.  Timing at the Start of Associative Learning , 2002 .

[24]  H. Grill,et al.  The taste reactivity test. I. Mimetic responses to gustatory stimuli in neurologically normal rats , 1978, Brain Research.

[25]  P. Couvillon,et al.  Temporal control of conditioned responding in goldfish. , 2005, Journal of experimental psychology. Animal behavior processes.

[26]  K. Berridge,et al.  Control of fluid palatability by exteroceptive Pavlovian signals. , 1986, Journal of experimental psychology. Animal behavior processes.

[27]  J. Bruce Overmier,et al.  Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific , 1983 .

[28]  R. Rescorla Preservation of Pavlovian Associations through Extinction , 1996 .

[29]  B. Balleine,et al.  Double Dissociation of Basolateral and Central Amygdala Lesions on the General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer , 2005, The Journal of Neuroscience.

[30]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[31]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[32]  A. Delamater Outcome-selective effects of intertrial reinforcement in a Pavlovian appetitive conditioning paradigm with rats , 1995 .

[33]  G. Hall,et al.  Lesions of the Basolateral Amygdala Disrupt Selective Aspects of Reinforcer Representation in Rats , 2001, The Journal of Neuroscience.

[34]  G. Hall Associative Structures in Pavlovian and Instrumental Conditioning , 2002 .