Contributions of nucleus accumbens dopamine to cognitive flexibility

There is a compelling evidence that midbrain dopamine (DA) neurons and their projections to the ventral striatum provide a mechanism for motivating reward‐seeking behavior, and for utilizing information about unexpected reward prediction errors (RPEs) to guide behavior based on current, rather than historical, outcomes. When this mechanism is compromised in addictions, it may produce patterns of maladaptive behavior that remain obdurate in the face of contrary information and even adverse consequences. Nonetheless, DAergic contributions to performance on behavioral tasks that rely on the ability to flexibly update stimulus‐reward relationships remains incompletly understood. In the current study, we used a discrimination and reversal paradigm to monitor subsecond DA release in mouse NAc core (NAc) using in vivo fast‐scan cyclic voltammetry (FSCV). We observed post‐choice elevations in phasic NAc DA release; however, increased DA transients were only evident during early reversal when mice made responses at the newly rewarded stimulus. Based on this finding, we used in vivo optogenetic (eNpHR) photosilencing and (Channelrhodopsin2 [ChR2]) photostimulation to assess the effects of manipulating VTA‐DAergic fibers in the NAc on reversal performance. Photosilencing the VTA → NAc DAergic pathway during early reversal increased errors, while photostimulation did not demonstrably affect behavior. Taken together, these data provide additional evidence of the importance of NAc DA release as a neural substrate supporting adjustments in learned behavior after a switch in expected stimulus‐reward contingencies. These findings have possible implications for furthering understanding the role of DA in persistent, maladaptive decision‐making characterizing addictions.

[1]  Camelia M. Kuhnen,et al.  Delays Conferred by Escalating Costs Modulate Dopamine Release to Rewards But Not Their Predictors , 2010, The Journal of Neuroscience.

[2]  Mihaela D Iordanova,et al.  Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning , 2006, The European journal of neuroscience.

[3]  Ilana B. Witten,et al.  Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target , 2016, Nature Neuroscience.

[4]  R. Wightman,et al.  Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation , 2008, Proceedings of the National Academy of Sciences.

[5]  Nathan T. Rodeberg,et al.  Hitchhiker's Guide to Voltammetry: Acute and Chronic Electrodes for in Vivo Fast-Scan Cyclic Voltammetry , 2017, ACS chemical neuroscience.

[6]  C. I. Howarth,et al.  Drive Decay: The Cause of Fast "Extinction" of Habits Learned for Brain Stimulation , 1962, Science.

[7]  Peter A. Groblewski,et al.  Excessive cocaine use results from decreased phasic dopamine signaling in the striatum , 2014, Nature Neuroscience.

[8]  R. Palmiter,et al.  Reward without Dopamine , 2003, The Journal of Neuroscience.

[9]  J. Tepper,et al.  Glutamatergic Signaling by Mesolimbic Dopamine Neurons in the Nucleus Accumbens , 2010, The Journal of Neuroscience.

[10]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[11]  J. Bolam,et al.  Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli , 2004, Science.

[12]  J. Berke What does dopamine mean? , 2018, Nature Neuroscience.

[13]  P. Phillips,et al.  Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training , 2013, The Journal of Neuroscience.

[14]  Joshua L. Jones,et al.  Dopamine transients are sufficient and necessary for acquisition of model-based associations , 2017, Nature Neuroscience.

[15]  P. Glimcher,et al.  Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term , 2014, The Journal of Neuroscience.

[16]  Alexander B. Johnson,et al.  Ventral tegmental area glutamate neurons co-release GABA and promote positive reinforcement , 2016, Nature Communications.

[17]  Nephi Stella,et al.  Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals , 2009, Nature Methods.

[18]  L. Saksida,et al.  Paradoxical reversal learning enhancement by stress or prefrontal cortical damage: rescue with BDNF , 2011, Nature Neuroscience.

[19]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[20]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[21]  Ilana B. Witten,et al.  Mesolimbic Dopamine Dynamically Tracks, and Is Causally Linked to, Discrete Aspects of Value-Based Decision Making , 2015, Biological Psychiatry.

[22]  S. Ikemoto,et al.  Similar Roles of Substantia Nigra and Ventral Tegmental Dopamine Neurons in Reward and Aversion , 2014, The Journal of Neuroscience.

[23]  T. Robinson,et al.  A selective role for dopamine in reward learning , 2010, Nature.

[24]  Naoshige Uchida,et al.  Arithmetic and local circuitry underlying dopamine prediction errors , 2015, Nature.

[25]  R. Palmiter,et al.  Vesicular Glutamate Transport Promotes Dopamine Storage and Glutamate Corelease In Vivo , 2010, Neuron.

[26]  S. Floresco,et al.  Overriding Phasic Dopamine Signals Redirects Action Selection during Risk/Reward Decision Making , 2014, Neuron.

[27]  C. Lüscher,et al.  Sufficiency of Mesolimbic Dopamine Neuron Stimulation for the Progression to Addiction , 2015, Neuron.

[28]  Lisa M. Saksida,et al.  Genetic and dopaminergic modulation of reversal learning in a touchscreen-based operant procedure for mice , 2006, Behavioural Brain Research.

[29]  R. Palmiter,et al.  Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior , 2009, Proceedings of the National Academy of Sciences.

[30]  S. Ostlund,et al.  Phasic Mesolimbic Dopamine Release Tracks Reward Seeking During Expression of Pavlovian-to-Instrumental Transfer , 2013, Biological Psychiatry.

[31]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[32]  Mark A. Rossi,et al.  Operant Self-Stimulation of Dopamine Neurons in the Substantia Nigra , 2013, PloS one.

[33]  Garret D Stuber,et al.  Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. , 2003, Methods in molecular medicine.

[34]  S. Floresco,et al.  Ventral Striatal Dopamine Modulation of Different Forms of Behavioral Flexibility , 2009, Neuropsychopharmacology.

[35]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[36]  P. Janak,et al.  Establishing causality for dopamine in neural function and behavior with optogenetics , 2013, Brain Research.

[37]  Ilana B. Witten,et al.  Recombinase-Driver Rat Lines: Tools, Techniques, and Optogenetic Application to Dopamine-Mediated Reinforcement , 2011, Neuron.

[38]  G. McNally,et al.  A role of nucleus accumbens dopamine receptors in the nucleus accumbens core, but not shell, in fear prediction error. , 2015, Behavioral neuroscience.

[39]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[40]  R. Joosten,et al.  Phasic dopamine release induced by positive feedback predicts individual differences in reversal learning , 2015, Neurobiology of Learning and Memory.

[41]  R. Wightman,et al.  Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[42]  B. Everitt,et al.  Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use , 2012, Proceedings of the National Academy of Sciences.

[43]  S. Ostlund,et al.  Nucleus Accumbens Acetylcholine Receptors Modulate Dopamine and Motivation , 2016, Neuropsychopharmacology.

[44]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[45]  Joshua L. Jones,et al.  Phasic Nucleus Accumbens Dopamine Release Encodes Effort- and Delay-Related Costs , 2010, Biological Psychiatry.

[46]  Guillem R. Esber,et al.  Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors , 2015, Nature Neuroscience.

[47]  K. Wassum,et al.  Nucleus accumbens core dopamine signaling tracks the need‐based motivational value of food‐paired cues , 2016, Journal of neurochemistry.

[48]  W. Hauber,et al.  Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats , 2007, Psychopharmacology.

[49]  Joshua H. Jennings,et al.  Tools for Resolving Functional Activity and Connectivity within Intact Neural Circuits , 2014, Current Biology.

[50]  K. Deisseroth,et al.  Optogenetic Interrogation of Dopaminergic Modulation of the Multiple Phases of Reward-Seeking Behavior , 2011, The Journal of Neuroscience.

[51]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[52]  Wolfgang Hauber,et al.  Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. , 2008, Learning & memory.

[53]  Lisa M. Saksida,et al.  Reward-Related Behavioral Paradigms for Addiction Research in the Mouse: Performance of Common Inbred Strains , 2011, PloS one.

[54]  William R. Stauffer,et al.  Dopamine Neuron-Specific Optogenetic Stimulation in Rhesus Macaques , 2016, Cell.

[55]  M. Rubinstein,et al.  Loss of Feedback Inhibition via D2 Autoreceptors Enhances Acquisition of Cocaine Taking and Reactivity to Drug-Paired Cues , 2014, Neuropsychopharmacology.

[56]  Michael P. Saddoris,et al.  Prior Cocaine Experience Impairs Normal Phasic Dopamine Signals of Reward Value in Accumbens Shell , 2017, Neuropsychopharmacology.

[57]  James L Olds Self-Stimulation of the Brain , 1958, Science.

[58]  T. Robbins,et al.  Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats , 2010, Behavioural Brain Research.

[59]  L. Saksida,et al.  Effects of Subchronic Phencyclidine (PCP) Treatment on Social Behaviors, and Operant Discrimination and Reversal Learning in C57BL/6J Mice , 2008, Front. Behav. Neurosci..

[60]  Vaughn L. Hetrick,et al.  Mesolimbic Dopamine Signals the Value of Work , 2015, Nature Neuroscience.

[61]  Anne L. Collins,et al.  Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation , 2016, Scientific Reports.

[62]  P. Phillips,et al.  Risk preference following adolescent alcohol use is associated with corrupted encoding of costs but not rewards by mesolimbic dopamine , 2011, Proceedings of the National Academy of Sciences.

[63]  S. Ikemoto,et al.  Phasic excitation of ventral tegmental dopamine neurons potentiates the initiation of conditioned approach behavior: parametric and reinforcement-schedule analyses , 2014, Front. Behav. Neurosci..

[64]  D. Lovinger,et al.  Cocaine supersensitivity and enhanced motivation for reward in mice lacking dopamine D2 autoreceptors , 2011, Nature Neuroscience.

[65]  Ulrik R Beierholm,et al.  Dopamine Modulates Reward-Related Vigor , 2013, Neuropsychopharmacology.

[66]  J. Salamone,et al.  Mesolimbic Dopamine and the Regulation of Motivated Behavior. , 2015, Current topics in behavioral neurosciences.

[67]  Raag D. Airan,et al.  Natural Neural Projection Dynamics Underlying Social Behavior , 2014, Cell.

[68]  G. Stuber,et al.  Neural encoding of cocaine‐seeking behavior is coincident with phasic dopamine release in the accumbens core and shell , 2009, The European journal of neuroscience.

[69]  R. Wightman,et al.  Phasic Nucleus Accumbens Dopamine Encodes Risk-Based Decision-Making Behavior , 2012, Biological Psychiatry.

[70]  B. Balleine,et al.  Learning and Motivational Processes Contributing to Pavlovian-Instrumental Transfer and Their Neural Bases: Dopamine and Beyond. , 2016, Current topics in behavioral neurosciences.

[71]  K. Berridge,et al.  Intra-Accumbens Amphetamine Increases the Conditioned Incentive Salience of Sucrose Reward: Enhancement of Reward “Wanting” without Enhanced “Liking” or Response Reinforcement , 2000, The Journal of Neuroscience.

[72]  S. Nicola,et al.  Dopamine Invigorates Reward Seeking by Promoting Cue-Evoked Excitation in the Nucleus Accumbens , 2014, The Journal of Neuroscience.

[73]  R. Wise,et al.  Intracranial self-administration of morphine into the ventral tegmental area in rats. , 1981, Life sciences.

[74]  D. Lovinger,et al.  Associative and sensorimotor cortico‐basal ganglia circuit roles in effects of abused drugs , 2017, Genes, brain, and behavior.

[75]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[76]  R. Wightman,et al.  Coordinated Accumbal Dopamine Release and Neural Activity Drive Goal-Directed Behavior , 2007, Neuron.

[77]  S. B. Evans,et al.  Absence of NMDA receptors in dopamine neurons attenuates dopamine release but not conditioned approach during Pavlovian conditioning , 2010, Proceedings of the National Academy of Sciences.

[78]  G. Stuber,et al.  Dopaminergic Terminals in the Nucleus Accumbens But Not the Dorsal Striatum Corelease Glutamate , 2010, The Journal of Neuroscience.

[79]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[80]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[81]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[82]  Samuel M. McClure,et al.  BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area , 2008, Science.

[83]  Garret D Stuber,et al.  Overoxidation of carbon-fiber microelectrodes enhances dopamine adsorption and increases sensitivity. , 2003, The Analyst.

[84]  L. Saksida,et al.  GluN2B in corticostriatal circuits governs choice learning and choice shifting , 2013, Nature Neuroscience.

[85]  K. Deisseroth,et al.  Input-specific control of reward and aversion in the ventral tegmental area , 2012, Nature.

[86]  P. Rudebeck,et al.  The neural basis of reversal learning: An updated perspective , 2017, Neuroscience.

[87]  Josiah R. Boivin,et al.  Positive Reinforcement Mediated by Midbrain Dopamine Neurons Requires D1 and D2 Receptor Activation in the Nucleus Accumbens , 2014, PloS one.

[88]  Pavel Takmakov,et al.  Flexible software platform for fast-scan cyclic voltammetry data acquisition and analysis. , 2013, Analytical chemistry.

[89]  K. Berridge,et al.  Dopamine or opioid stimulation of nucleus accumbens similarly amplify cue‐triggered ‘wanting’ for reward: entire core and medial shell mapped as substrates for PIT enhancement , 2013, The European journal of neuroscience.

[90]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[91]  Kari A. Johnson,et al.  Endocannabinoid Actions on Cortical Terminals Orchestrate Local Modulation of Dopamine Release in the Nucleus Accumbens , 2017, Neuron.

[92]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[93]  D. Denys,et al.  Regionally distinct phasic dopamine release patterns in the striatum during reversal learning , 2017, Neuroscience.

[94]  K. Deisseroth,et al.  Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning , 2009, Science.

[95]  W. Schultz Updating dopamine reward signals , 2013, Current Opinion in Neurobiology.

[96]  William W. Taylor,et al.  Dorsolateral Striatum Engagement Interferes with Early Discrimination Learning , 2018, Cell reports.

[97]  S. Ostlund,et al.  Phasic Mesolimbic Dopamine Signaling Encodes the Facilitation of Incentive Motivation Produced by Repeated Cocaine Exposure , 2014, Neuropsychopharmacology.

[98]  C. Fiorillo,et al.  Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement , 2012, PloS one.