Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens

The ability to predict favorable outcomes using environmental cues is an essential part of learned behavior. Dopamine neurons in the midbrain encode such stimulus-reward relationships in a manner consistent with contemporary learning models, but it is unclear how encoding this translates into actual dopamine release in target regions. Here, we sampled dopamine levels in the rat nucleus accumbens on a rapid (100 ms) timescale using electrochemical technology during a classical conditioning procedure. Early in conditioning, transient dopamine-release events signaled a primary reward, but not predictive cues. After repeated cue-reward pairings, dopamine signals shifted in time to predictive cue onset and were no longer observed at reward delivery. In the absence of stimulus-reward conditioning, there was no shift in the dopamine signal. Consistent with proposed roles in reward prediction and incentive salience, these results indicate that rapid dopamine release provides a reward signal that is dynamically modified by associative learning.

[1]  Douglas L. Jones,et al.  From motivation to action: Functional interface between the limbic system and the motor system , 1980, Progress in Neurobiology.

[2]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[3]  E. Richfield,et al.  Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system , 1989, Neuroscience.

[4]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[5]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[6]  V Bassareo,et al.  Differential Influence of Associative and Nonassociative Learning Mechanisms on the Responsiveness of Prefrontal and Accumbal Dopamine Transmission to Food Stimuli in Rats Fed Ad Libitum , 1997, The Journal of Neuroscience.

[7]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[8]  C. Cepeda,et al.  Dopamine and N-Methyl-D- Aspartate Receptor Interactions in the Neostriatum , 1998, Developmental Neuroscience.

[9]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[10]  P. Garris,et al.  Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation , 1999, Nature.

[11]  T. Robbins,et al.  Dissociation in Effects of Lesions of the Nucleus Accumbens Core and Shell on Appetitive Pavlovian Approach Behavior and the Potentiation of Conditioned Reinforcement and Locomotor Activity byd-Amphetamine , 1999, The Journal of Neuroscience.

[12]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[13]  J. Wickens,et al.  Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. , 2001, Journal of neurophysiology.

[14]  B. Everitt,et al.  Differential Involvement of NMDA, AMPA/Kainate, and Dopamine Receptors in the Nucleus Accumbens Core in the Acquisition and Performance of Pavlovian Approach Behavior , 2001, The Journal of Neuroscience.

[15]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[16]  P. Greengard The neurobiology of slow synaptic transmission. , 2001, Science.

[17]  T. Robbins,et al.  Limbic-Striatal Memory Systems and Drug Addiction , 2002, Neurobiology of Learning and Memory.

[18]  G. Di Chiara Nucleus accumbens shell and core dopamine: differential role in behavior and addiction. , 2002, Behavioural brain research.

[19]  T. Robbins,et al.  Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function , 2002, Behavioural Brain Research.

[20]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[21]  G. Chiara Nucleus accumbens shell and core dopamine: differential role in behavior and addiction , 2002, Behavioural Brain Research.

[22]  T. Robbins,et al.  Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshaping performance in rats. , 2002, Behavioral neuroscience.

[23]  Garret D Stuber,et al.  Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. , 2003, Methods in molecular medicine.

[24]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[25]  J. Horvitz,et al.  Opposing Roles of D1 and D2 Receptors in Appetitive Conditioning , 2003, The Journal of Neuroscience.

[26]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[27]  G. Schoenbaum,et al.  Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning , 2003, Neuron.

[28]  S. Cragg Variable Dopamine Release Probability and Short-Term Plasticity between Functional Domains of the Primate Striatum , 2003, The Journal of Neuroscience.

[29]  R. Wise Dopamine, learning and motivation , 2004, Nature Reviews Neuroscience.

[30]  P. Montague,et al.  Dynamic Gain Control of Dopamine Delivery in Freely Moving Animals , 2004, The Journal of Neuroscience.

[31]  J. Bolam,et al.  Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli , 2004, Science.

[32]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[33]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[34]  R. Wightman,et al.  Resolving neurotransmitters detected by fast-scan cyclic voltammetry. , 2004, Analytical chemistry.

[35]  D. Sulzer,et al.  Frequency-dependent modulation of dopamine release by nicotine , 2004, Nature Neuroscience.

[36]  S. Nicola,et al.  The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues , 2004, The Journal of Neuroscience.

[37]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[38]  R. Wightman,et al.  Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[39]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[40]  J. Mayhew,et al.  How Visual Stimuli Activate Dopaminergic Neurons at Short Latency , 2005, Science.

[41]  Trevor W. Robbins,et al.  Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[42]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[43]  W. Pan,et al.  Pedunculopontine Tegmental Nucleus Controls Conditioned Responses of Midbrain Dopamine Neurons in Behaving Rats , 2005, The Journal of Neuroscience.

[44]  M. Roitman,et al.  Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output , 2005, Neuron.

[45]  S. Cragg Meaningful silences: how dopamine listens to the ACh pause , 2006, Trends in Neurosciences.

[46]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[47]  M. Roitman,et al.  Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm , 2006, The European journal of neuroscience.

[48]  T. Robbins,et al.  Erratum: Neural systems of reinforcement for drug addition: from actions to habits to compulsion , 2006, Nature Neuroscience.

[49]  Jason M. Uslaner,et al.  The attribution of incentive salience to a stimulus that signals an intravenous injection of cocaine , 2006, Behavioural Brain Research.

[50]  Elyssa B. Margolis,et al.  The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? , 2006, The Journal of physiology.

[51]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[52]  Robert T Kennedy,et al.  In vivo measurements of neurotransmitters by microdialysis sampling. , 2006, Analytical chemistry.

[53]  R. K. Simpson Nature Neuroscience , 2022 .