Sign Tracking, but Not Goal Tracking, is Resistant to Outcome Devaluation

During Pavlovian conditioning, a conditioned stimulus (CS) may act as a predictor of a reward to be delivered in another location. Individuals vary widely in their propensity to engage with the CS (sign tracking) or with the site of eventual reward (goal tracking). It is often assumed that sign tracking involves the association of the CS with the motivational value of the reward, resulting in the CS acquiring incentive value independent of the outcome. However, experimental evidence for this assumption is lacking. In order to test the hypothesis that sign tracking behavior does not rely on a neural representation of the outcome, we employed a reward devaluation procedure. We trained rats on a classic Pavlovian paradigm in which a lever CS was paired with a sucrose reward, then devalued the reward by pairing sucrose with illness in the absence of the CS. We found that sign tracking behavior was enhanced, rather than diminished, following reward devaluation; thus, sign tracking is clearly independent of a representation of the outcome. In contrast, goal tracking behavior was decreased by reward devaluation. Furthermore, when we divided rats into those with high propensity to engage with the lever (sign trackers) and low propensity to engage with the lever (goal trackers), we found that nearly all of the effects of devaluation could be attributed to the goal trackers. These results show that sign tracking and goal tracking behavior may be the output of different associative structures in the brain, providing insight into the mechanisms by which reward-associated stimuli—such as drug cues—come to exert control over behavior in some individuals.

[1]  Individual Variation , 1910, Botanical Gazette.

[2]  A. Anastasi Individual differences. , 2020, Annual review of psychology.

[3]  H. M. Jenkins,et al.  Sign-tracking : the stimulus-reinforcer relation and directed action , 1974 .

[4]  G. Davey,et al.  The effects of satiation and reinforcer develuation on signal-centered behavior in the rat , 1982 .

[5]  G. G. Cleland,et al.  Topography of signal-centered behavior in the rat: Effects of deprivation state and reinforcer type. , 1982, Journal of the experimental analysis of behavior.

[6]  M. Domjan,et al.  Sexual approach conditioning: tests of unconditioned stimulus devaluation using hormone manipulations. , 1993, Journal of experimental psychology. Animal behavior processes.

[7]  M. Domjan,et al.  Effects on Sexual Conditioning of Devaluing the US through Satiation , 1995, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[8]  E. Rolls,et al.  The Orbitofrontal Cortex , 2019 .

[9]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[10]  G. Schoenbaum,et al.  Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning , 1999, The Journal of Neuroscience.

[11]  A. Tomie,et al.  Individual Differences in Pavlovian Autoshaping of Lever Pressing in Rats Predict Stress-Induced Corticosterone Release and Mesolimbic Levels of Monoamines , 2000, Pharmacology Biochemistry and Behavior.

[12]  B. Everitt,et al.  Differential Involvement of NMDA, AMPA/Kainate, and Dopamine Receptors in the Nucleus Accumbens Core in the Acquisition and Performance of Pavlovian Approach Behavior , 2001, The Journal of Neuroscience.

[13]  T. Robbins,et al.  Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function , 2002, Behavioural Brain Research.

[14]  Lloyd D. Partridge,et al.  Convergence of Information , 2003 .

[15]  Geoffrey Schoenbaum,et al.  Different Roles for Orbitofrontal Cortex and Basolateral Amygdala in a Reinforcer Devaluation Task , 2003, The Journal of Neuroscience.

[16]  Howard L Fields,et al.  Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task. , 2004, Journal of neurophysiology.

[17]  K. Berridge Motivation concepts in behavioral neuroscience , 2004, Physiology & Behavior.

[18]  S. Nicola,et al.  The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues , 2004, The Journal of Neuroscience.

[19]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[20]  S. J. Weiss,et al.  A comparison of Lewis and Fischer rat strains on autoshaping (sign-tracking), discrimination reversal learning and negative automaintenance , 2006, Behavioural Brain Research.

[21]  A. Tomie,et al.  Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse , 2008, Brain Research Reviews.

[22]  S. Nicola,et al.  Basolateral Amygdala Neurons Facilitate Reward-Seeking Behavior by Exciting Nucleus Accumbens Neurons , 2008, Neuron.

[23]  T. Robinson,et al.  Dissociating the Predictive and Incentive Motivational Properties of Reward-Related Cues Through the Study of Individual Differences , 2009, Biological Psychiatry.

[24]  Huda Akil,et al.  Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction , 2009, Neuropharmacology.

[25]  C. Daniel Salzman,et al.  The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons , 2009, The Journal of Neuroscience.

[26]  T. Robinson,et al.  An Animal Model of Genetic Vulnerability to Behavioral Disinhibition and Responsiveness to Reward-Related Cues: Implications for Addiction , 2010, Neuropsychopharmacology.

[27]  T. Robinson,et al.  Individual Variation in the Motivational Properties of Cocaine , 2011, Neuropsychopharmacology.

[28]  T. Robinson,et al.  A selective role for dopamine in reward learning , 2010, Nature.

[29]  T. Robinson,et al.  A cocaine cue is more preferred and evokes more frequency-modulated 50-kHz ultrasonic vocalizations in rats prone to attribute incentive salience to a food cue , 2011, Psychopharmacology.

[30]  T. Robinson,et al.  A food predictive cue must be attributed with incentive salience for it to induce c-fos mRNA expression in cortico-striatal-thalamic brain regions , 2011, Neuroscience.

[31]  S. Nicola,et al.  Roles of Nucleus Accumbens Core and Shell in Incentive-Cue Responding and Behavioral Inhibition , 2011, The Journal of Neuroscience.

[32]  T. Robinson,et al.  Quantifying Individual Variation in the Propensity to Attribute Incentive Salience to Reward Cues , 2012, PloS one.

[33]  P. Phillips,et al.  Pavlovian valuation systems in learning and decision making , 2012, Current Opinion in Neurobiology.

[34]  T. Robinson,et al.  The role of dopamine in the accumbens core in the expression of Pavlovian‐conditioned responses , 2012, The European journal of neuroscience.

[35]  P. Holland,et al.  Effects of nucleus accumbens core and shell lesions on autoshaped lever-pressing , 2013, Behavioural Brain Research.

[36]  T. Robinson,et al.  Variation in the Form of Pavlovian Conditioned Approach Behavior among Outbred Male Sprague-Dawley Rats from Different Vendors and Colonies: Sign-Tracking vs. Goal-Tracking , 2013, PloS one.

[37]  Vincent B. McGinty,et al.  Invigoration of Reward Seeking by Cue and Proximity Encoding in the Nucleus Accumbens , 2013, Neuron.

[38]  K. Berridge,et al.  Reward uncertainty enhances incentive salience attribution as sign-tracking , 2013, Behavioural Brain Research.

[39]  T. Robinson,et al.  Individual variation in resisting temptation: Implications for addiction , 2013, Neuroscience & Biobehavioral Reviews.

[40]  T. Robinson,et al.  On the motivational properties of reward cues: Individual differences , 2014, Neuropharmacology.

[41]  Sara E. Morrison,et al.  Neurons in the Nucleus Accumbens Promote Selection Bias for Nearer Objects , 2014, The Journal of Neuroscience.

[42]  S. Nicola,et al.  Dopamine Invigorates Reward Seeking by Promoting Cue-Evoked Excitation in the Nucleus Accumbens , 2014, The Journal of Neuroscience.

[43]  Mehdi Khamassi,et al.  Modelling Individual Differences in the Form of Pavlovian Conditioned Approach Responses: A Dual Learning Systems Approach with Factored Representations , 2014, PLoS Comput. Biol..

[44]  P. Tobler,et al.  The role of learning-related dopamine signals in addiction vulnerability. , 2014, Progress in brain research.

[45]  D. Kearns,et al.  Sign-tracking predicts increased choice of cocaine over food in rats , 2015, Behavioural Brain Research.

[46]  J. Beckmann,et al.  Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence , 2015, Learning & memory.

[47]  Terry E. Robinson,et al.  Rats that sign-track are resistant to Pavlovian but not instrumental extinction , 2016, Behavioural Brain Research.