Primary food reward and reward‐predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum

Phasic changes in dopamine activity play a critical role in learning and goal‐directed behavior. Unpredicted reward and reward‐predictive cues evoke phasic increases in the firing rate of the majority of midbrain dopamine neurons – results that predict uniformly broadcast increases in dopamine concentration throughout the striatum. However, measurement of dopamine concentration changes during reward has cast doubt on this prediction. We systematically measured phasic changes in dopamine in four striatal subregions [nucleus accumbens shell and core (Core), dorsomedial (DMS) and dorsolateral striatum] in response to stimuli known to activate a majority of dopamine neurons. We used fast‐scan cyclic voltammetry in awake and behaving rats, which measures changes in dopamine on a similar timescale to the electrophysiological recordings that established a relationship between phasic dopamine activity and reward. Unlike the responses of midbrain dopamine neurons, unpredicted food reward and reward‐predictive cues evoked a phasic increase in dopamine that was subregion specific. In rats with limited experience, unpredicted food reward evoked an increase exclusively in the Core. In rats trained on a discriminative stimulus paradigm, both unpredicted reward and reward‐predictive cues evoked robust phasic dopamine in the Core and DMS. Thus, phasic dopamine release in select target structures is dynamic and dependent on context and experience. Because the four subregions assayed receive different inputs and have differential projection targets, the regional selectivity of phasic changes in dopamine has important implications for information flow through the striatum and plasticity that underlies learning and goal‐directed behavior.

[1]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[2]  S. Cragg,et al.  Dopamine Release and Uptake Dynamics within Nonhuman Primate Striatum In Vitro , 2000, The Journal of Neuroscience.

[3]  S. Floresco,et al.  Orexin A/Hypocretin-1 Selectively Promotes Motivation for Positive Reinforcers , 2009, The Journal of Neuroscience.

[4]  John A. Dani,et al.  Controls of Tonic and Phasic Dopamine Transmission in the Dorsal and Ventral Striatum , 2009, Molecular Pharmacology.

[5]  R. Joosten,et al.  Reward-Predictive Cues Enhance Excitatory Synaptic Strength onto Midbrain Dopamine Neurons , 2008, Science.

[6]  K. Deisseroth,et al.  Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning , 2009, Science.

[7]  R. Wightman,et al.  Resolving neurotransmitters detected by fast-scan cyclic voltammetry. , 2004, Analytical chemistry.

[8]  J. Bolam,et al.  Synaptic organisation of the basal ganglia , 2000, Journal of anatomy.

[9]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[10]  G. Chiara,et al.  Differential responsiveness of dopamine transmission to food-stimuli in nucleus accumbens shell/core compartments , 1999, Neuroscience.

[11]  S. Nicola The nucleus accumbens as part of a basal ganglia action selection circuit , 2007, Psychopharmacology.

[12]  Joshua L. Jones,et al.  Cocaine Cues Drive Opposing Context-Dependent Shifts in Reward Processing and Emotional State , 2011, Biological Psychiatry.

[13]  G. Di Chiara,et al.  Reward system and addiction: what dopamine does and doesn't do. , 2007, Current opinion in pharmacology.

[14]  A. Kelley Functional Specificity of Ventral Striatal Compartments in Appetitive Behaviors , 1999, Annals of the New York Academy of Sciences.

[15]  Chunxiang Zhang,et al.  Region-specific induction of FosB/ΔFosB by voluntary alcohol intake: effects of naltrexone. , 2010, Alcoholism, clinical and experimental research.

[16]  Kyle S. Smith,et al.  Corticostriatal Interactions during Learning, Memory Processing, and Decision Making , 2009, The Journal of Neuroscience.

[17]  S. Cragg,et al.  Dopamine Signaling in Dorsal Versus Ventral Striatum: The Dynamic Role of Cholinergic Interneurons , 2011, Front. Syst. Neurosci..

[18]  S. Lammel,et al.  Unique Properties of Mesoprefrontal Neurons within a Dual Mesocorticolimbic Dopamine System , 2008, Neuron.

[19]  R. Wightman,et al.  Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli , 2008, Nature Neuroscience.

[20]  W. Schultz,et al.  Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm , 2003, The Journal of Neuroscience.

[21]  R. Wightman,et al.  Preferential Enhancement of Dopamine Transmission within the Nucleus Accumbens Shell by Cocaine Is Attributable to a Direct Increase in Phasic Dopamine Release Events , 2008, The Journal of Neuroscience.

[22]  Ina Ruck,et al.  USA , 1969, The Lancet.

[23]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[24]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[25]  A. Zapata,et al.  Shift from Goal-Directed to Habitual Cocaine Seeking after Prolonged Experience in Rats , 2010, The Journal of Neuroscience.

[26]  G. Chiara,et al.  Reciprocal responsiveness of nucleus accumbens shell and core dopamine to food- and drug-conditioned stimuli , 2011, Psychopharmacology.

[27]  Ben M. Crittenden,et al.  Dissociable Control of Impulsivity in Rats by Dopamine D2/3 Receptors in the Core and Shell Subregions of the Nucleus Accumbens , 2010, Neuropsychopharmacology.

[28]  L. Swanson The Rat Brain in Stereotaxic Coordinates, George Paxinos, Charles Watson (Eds.). Academic Press, San Diego, CA (1982), vii + 153, $35.00, ISBN: 0 125 47620 5 , 1984 .

[29]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[30]  Jennifer M. Mitchell,et al.  Midbrain Dopamine Neurons: Projection Target Determines Action Potential Duration and Dopamine D2 Receptor Inhibition , 2008, The Journal of Neuroscience.

[31]  M. Olds,et al.  Relation between rotation in the 6‐OHDA lesioned rat and dopamine loss in striatal and substantia nigra subregions , 2006, Synapse.

[32]  S. Ikemoto Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex , 2007, Brain Research Reviews.

[33]  F. Fujiyama,et al.  Single Nigrostriatal Dopaminergic Neurons Form Widely Spread and Highly Dense Axonal Arborizations in the Neostriatum , 2009, The Journal of Neuroscience.

[34]  M. Roitman,et al.  Depressive-like effects of the kappa opioid receptor agonist salvinorin A are associated with decreased phasic dopamine release in the nucleus accumbens , 2010, Psychopharmacology.

[35]  S. Cragg Meaningful silences: how dopamine listens to the ACh pause , 2006, Trends in Neurosciences.

[36]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[37]  E. Richfield Quantitative autoradiography of the dopamine uptake complex in rat brain using [3H]GBR 12935: binding characteristics , 1991, Brain Research.

[38]  Elyssa B. Margolis,et al.  The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? , 2006, The Journal of physiology.

[39]  P. Garris,et al.  Determination of release and uptake parameters from electrically evoked dopamine dynamics measured by real-time voltammetry , 2001, Journal of Neuroscience Methods.

[40]  R. Wightman,et al.  In vivo voltammetric monitoring of catecholamine release in subterritories of the nucleus accumbens shell , 2010, Neuroscience.

[41]  M. Ragozzino,et al.  Acetylcholine activity in selective striatal regions supports behavioral flexibility , 2009, Neurobiology of Learning and Memory.

[42]  T. Robbins,et al.  Dopamine Release in the Dorsal Striatum during Cocaine-Seeking Behavior under the Control of a Drug-Associated Cue , 2002, The Journal of Neuroscience.

[43]  Ethan S. Bromberg-Martin,et al.  Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards , 2009, Neuron.

[44]  C. Gerfen,et al.  Modulation of striatal projection systems by dopamine. , 2011, Annual review of neuroscience.

[45]  K. Chergui,et al.  Uptake of Dopamine Released by Impulse Flow in the Rat Mesolimbic and Striatal Systems In Vivo , 1995, Journal of neurochemistry.

[46]  T. Prescott,et al.  The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. , 2010, Progress in Neurobiology.

[47]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[48]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[49]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[50]  Camelia M. Kuhnen,et al.  Delays Conferred by Escalating Costs Modulate Dopamine Release to Rewards But Not Their Predictors , 2010, The Journal of Neuroscience.

[51]  K. Berridge,et al.  Hedonic Hot Spot in Nucleus Accumbens Shell: Where Do μ-Opioids Cause Increased Hedonic Impact of Sweetness? , 2005, The Journal of Neuroscience.

[52]  P. Garris,et al.  Comparison of Dopamine Uptake in the Basolateral Amygdaloid Nucleus, Caudate‐Putamen, and Nucleus Accumbens of the Rat , 1995, Journal of neurochemistry.

[53]  T. Robinson,et al.  An Animal Model of Genetic Vulnerability to Behavioral Disinhibition and Responsiveness to Reward-Related Cues: Implications for Addiction , 2010, Neuropsychopharmacology.

[54]  B. Knowlton,et al.  Contributions of striatal subregions to place and response learning. , 2004, Learning & memory.

[55]  S. Deadwyler,et al.  Firing Rate of Nucleus Accumbens Neurons Is Dopamine-Dependent and Reflects the Timing of Cocaine-Seeking Behavior in Rats on a Progressive Ratio Schedule of Reinforcement , 2000, The Journal of Neuroscience.

[56]  R. Ito,et al.  Opposing Roles of Nucleus Accumbens Core and Shell Dopamine in the Modulation of Limbic Information Processing , 2011, The Journal of Neuroscience.

[57]  R. Palmiter,et al.  Dopamine Modulates Release from Corticostriatal Terminals , 2004, The Journal of Neuroscience.

[58]  Mark Laubach,et al.  The Dorsomedial Striatum Reflects Response Bias during Learning , 2009, The Journal of Neuroscience.

[59]  S. Mizumori,et al.  Dorsal striatal head direction and hippocampal place representations during spatial navigation , 2001, Experimental Brain Research.

[60]  Joshua L. Jones,et al.  Basolateral Amygdala Modulates Terminal Dopamine Release in the Nucleus Accumbens and Conditioned Responding , 2010, Biological Psychiatry.

[61]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[62]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[63]  M. Roitman,et al.  Regional specificity in the real‐time development of phasic dopamine transmission patterns during acquisition of a cue–cocaine association in rats , 2009, The European journal of neuroscience.

[64]  R. Wightman,et al.  Synaptic Overflow of Dopamine in the Nucleus Accumbens Arises from Neuronal Activity in the Ventral Tegmental Area , 2009, The Journal of Neuroscience.

[65]  R. Palmiter Dopamine Signaling in the Dorsal Striatum Is Essential for Motivated Behaviors , 2008, Annals of the New York Academy of Sciences.

[66]  J. B. Justice,et al.  Dopamine depletion in a striatal subregion disrupts performance of a skilled motor task in the rat , 1985, Brain Research.

[67]  Joshua L. Plotkin,et al.  Dopamine and synaptic plasticity in dorsal striatal circuits controlling action selection , 2009, Current Opinion in Neurobiology.

[68]  S. Hersch,et al.  The dopamine transporter: immunochemical characterization and localization in brain , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[69]  R. J. McDonald,et al.  Dorsal striatum and stimulus-response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a stimulus-response-based instrumental discrimination task, while sparing conditioned place preference learning , 2004, Neuroscience.

[70]  Y. Lacasse,et al.  From the authors , 2005, European Respiratory Journal.

[71]  S. Lammel,et al.  Projection-Specific Modulation of Dopamine Neuron Synapses by Aversive and Rewarding Stimuli , 2011, Neuron.

[72]  H. Groenewegen,et al.  Convergence and Segregation of Ventral Striatal Inputs and Outputs , 1999, Annals of the New York Academy of Sciences.

[73]  M. Ungless,et al.  Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli , 2009, Proceedings of the National Academy of Sciences.

[74]  R. Palmiter,et al.  Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior , 2009, Proceedings of the National Academy of Sciences.

[75]  B. Hyland,et al.  Firing modes of midbrain dopamine cells in the freely moving rat , 2002, Neuroscience.

[76]  H. Groenewegen,et al.  Integration and segregation of limbic cortico-striatal loops at the thalamic level: an experimental tracing study in rats , 1999, Journal of Chemical Neuroanatomy.

[77]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.