Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

[1]  T. Robinson,et al.  On the motivational properties of reward cues: Individual differences , 2014, Neuropharmacology.

[2]  Andrew R Delamater,et al.  Learning about Multiple Attributes of Reward in Pavlovian Conditioning , 2007, Annals of the New York Academy of Sciences.

[3]  T. Robinson,et al.  Cholinergic Control over Attention in Rats Prone to Attribute Incentive Salience to Reward Cues , 2013, The Journal of Neuroscience.

[4]  J. Konorski Some new ideas concerning the physiological mechanisms of perception. , 1967, Acta biologiae experimentalis.

[5]  P. Anselme,et al.  Incentive salience attribution under reward uncertainty: A Pavlovian model , 2015, Behavioural Processes.

[6]  T. Robinson,et al.  A Cocaine Cue Acts as an Incentive Stimulus in Some but not Others: Implications for Addiction , 2010, Biological Psychiatry.

[7]  K. Berridge,et al.  The incentive sensitization theory of addiction: some current issues , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  S. Garofalo,et al.  Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior , 2015, Front. Behav. Neurosci..

[9]  T. Robinson,et al.  A selective role for dopamine in reward learning , 2010, Nature.

[10]  K. Berridge,et al.  Which cue to ‘want’? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking , 2012, Behavioural Brain Research.

[11]  Joshua S. Beckmann,et al.  Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat , 2011, Behavioural Brain Research.

[12]  Travis P Todd,et al.  Context change and associative learning. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[13]  A. Delamater On the nature of CS and US representations in Pavlovian learning , 2012, Learning & behavior.

[14]  P. Holland Occasion Setting in Pavlovian Conditioning , 1992 .

[15]  K. Berridge,et al.  Reward uncertainty enhances incentive salience attribution as sign-tracking , 2013, Behavioural Brain Research.

[16]  T. Robinson,et al.  A cocaine cue is more preferred and evokes more frequency-modulated 50-kHz ultrasonic vocalizations in rats prone to attribute incentive salience to a food cue , 2011, Psychopharmacology.

[17]  D. Kearns,et al.  Sign-tracking predicts increased choice of cocaine over food in rats , 2015, Behavioural Brain Research.

[18]  T. Robinson,et al.  Individual Variation in the Motivational and Neurobiological Effects of an Opioid Cue , 2015, Neuropsychopharmacology.

[19]  David Belin,et al.  Evidence for Addiction-like Behavior in the Rat , 2004, Science.

[20]  R. Rescorla Spontaneous recovery. , 2004, Learning & memory.

[21]  T. Robinson,et al.  The Form of a Conditioned Stimulus Can Influence the Degree to Which It Acquires Incentive Motivational Properties , 2014, PloS one.

[22]  T. Robinson,et al.  Individual variation in resisting temptation: Implications for addiction , 2013, Neuroscience & Biobehavioral Reviews.

[23]  T. Robinson,et al.  Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats , 2007, Psychopharmacology.

[24]  Samuel P. León,et al.  Contextual control of discriminated operant behavior. , 2014, Journal of Experimental Psychology: Animal Learning and Cognition.

[25]  A. Tomie,et al.  Individual Differences in Pavlovian Autoshaping of Lever Pressing in Rats Predict Stress-Induced Corticosterone Release and Mesolimbic Levels of Monoamines , 2000, Pharmacology Biochemistry and Behavior.

[26]  K. Zener The significance of behavior accompanying conditioned salivary secretion for theories of the conditioned response. , 1937 .

[27]  M. Bouton Context and behavioral processes in extinction. , 2004, Learning & memory.

[28]  T. Robinson,et al.  A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue , 2012, Psychopharmacology.

[29]  A. Delamater Issues in the extinction of specific stimulus-outcome associations in Pavlovian conditioning , 2012, Behavioural Processes.

[30]  Huda Akil,et al.  Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction , 2009, Neuropharmacology.

[31]  T. Robinson,et al.  An Animal Model of Genetic Vulnerability to Behavioral Disinhibition and Responsiveness to Reward-Related Cues: Implications for Addiction , 2010, Neuropsychopharmacology.

[32]  T. Robinson,et al.  Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues , 2012, PloS one.

[33]  P. Holland,et al.  Hippocampus and context in classical conditioning , 1999, Current Opinion in Neurobiology.

[34]  G. Elmer,et al.  The habenula governs the attribution of incentive salience to reward predictive cues , 2013, Front. Hum. Neurosci..

[35]  K. Berridge ‘Liking’ and ‘wanting’ food rewards: Brain substrates and roles in eating disorders , 2009, Physiology & Behavior.

[36]  W. Timberlake Behavior systems, associationism, and Pavlovian conditioning , 1994, Psychonomic bulletin & review.

[37]  T. Robinson,et al.  Individual Variation in the Motivational Properties of Cocaine , 2011, Neuropsychopharmacology.

[38]  T. Robinson,et al.  Individual variation in the propensity to attribute incentive salience to an appetitive cue predicts the propensity to attribute motivational salience to an aversive cue , 2011, Behavioural Brain Research.

[39]  T. Robinson,et al.  A food predictive cue must be attributed with incentive salience for it to induce c-fos mRNA expression in cortico-striatal-thalamic brain regions , 2011, Neuroscience.

[40]  M. Bouton Context, ambiguity, and unlearning: sources of relapse after behavioral extinction , 2002, Biological Psychiatry.

[41]  Terry E. Robinson,et al.  Cue-induced reinstatement of food seeking in rats that differ in their propensity to attribute incentive salience to food cues , 2010, Behavioural Brain Research.

[42]  T. Robinson,et al.  Rats prone to attribute incentive salience to reward cues are also prone to impulsive action , 2011, Behavioural Brain Research.

[43]  A. Tomie,et al.  Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse , 2008, Brain Research Reviews.

[44]  A. R. Wagner,et al.  Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). , 1989 .

[45]  P. Phillips,et al.  Pavlovian valuation systems in learning and decision making , 2012, Current Opinion in Neurobiology.

[46]  P. Holland Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. , 1977, Journal of experimental psychology. Animal behavior processes.

[47]  J. Peters,et al.  d-Cycloserine administered directly to infralimbic medial prefrontal cortex enhances extinction memory in sucrose-seeking animals , 2013, Neuroscience.

[48]  H. M. Jenkins,et al.  Sign-tracking : the stimulus-reinforcer relation and directed action , 1974 .

[49]  S. Tiffany,et al.  Applying extinction research and theory to cue-exposure addiction treatments. , 2002, Addiction.

[50]  T. Robinson,et al.  The role of dopamine in the accumbens core in the expression of Pavlovian‐conditioned responses , 2012, The European journal of neuroscience.

[51]  Anna M. Lomanowska,et al.  Inadequate early social experience increases the incentive salience of reward-related cues in adulthood , 2011, Behavioural Brain Research.

[52]  Hank Davis,et al.  Operant-Pavlovian Interactions , 1977 .

[53]  G. Elmer,et al.  Disruption of conditioned reward association by typical and atypical antipsychotics , 2010, Pharmacology Biochemistry and Behavior.

[54]  T. Robinson,et al.  Variation in the Form of Pavlovian Conditioned Approach Behavior among Outbred Male Sprague-Dawley Rats from Different Vendors and Colonies: Sign-Tracking vs. Goal-Tracking , 2013, PloS one.

[55]  Stanley J. Watson,et al.  Antecedents and consequences of drug abuse in rats selectively bred for high and low response to novelty , 2014, Neuropharmacology.

[56]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[57]  Y. Shaham,et al.  Context-induced relapse to drug seeking: a review , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[58]  F. Gonzalez-Lima,et al.  Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors. , 2014, Journal of the experimental analysis of behavior.

[59]  T. Robinson,et al.  Dissociating the Predictive and Incentive Motivational Properties of Reward-Related Cues Through the Study of Individual Differences , 2009, Biological Psychiatry.

[60]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[61]  Topography of spatially directed conditioned responding: effects of context and trial duration. , 2001 .

[62]  P. Holland,et al.  Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing , 2012, Neurobiology of Learning and Memory.

[63]  H. de Wit,et al.  Role of unconditioned and conditioned drug effects in the self-administration of opiates and stimulants. , 1984, Psychological review.

[64]  T. Robinson,et al.  Sign-tracking to an appetitive cue predicts incubation of conditioned fear in rats , 2015, Behavioural Brain Research.

[65]  K. Berridge,et al.  Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues , 2014, Behavioural Brain Research.

[66]  T. Robinson,et al.  A Cocaine Context Renews Drug Seeking Preferentially in a Subset of Individuals , 2014, Neuropsychopharmacology.

[67]  J. Beckmann,et al.  Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence , 2015, Learning & memory.

[68]  K. Berridge,et al.  Which Cue to “Want?” Central Amygdala Opioid Activation Enhances and Focuses Incentive Salience on a Prepotent Reward Cue , 2009, The Journal of Neuroscience.

[69]  J. Troisi Perhaps more Consideration of Pavlovian-Operant interaction May Improve the Clinical Efficacy of Behaviorally Based Drug Treatment Programs , 2013, The Psychological record.

[70]  M. Bouton,et al.  Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning , 2014, Neurobiology of Learning and Memory.

[71]  T. Robinson,et al.  Cue-Evoked Cocaine “Craving”: Role of Dopamine in the Accumbens Core , 2013, The Journal of Neuroscience.

[72]  P. Holland,et al.  Blocking in autoshaped lever-pressing procedures with rats , 2014, Learning & behavior.

[73]  P. Phillips,et al.  Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training , 2013, The Journal of Neuroscience.

[74]  M. Domjan Stepping outside the box in considering the C/T ratio , 2003, Behavioural Processes.