Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards

Predictions about future rewarding events have a powerful influence on behaviour. The phasic spike activity of dopamine-containing neurons, and corresponding dopamine transients in the striatum, are thought to underlie these predictions, encoding positive and negative reward prediction errors. However, many behaviours are directed towards distant goals, for which transient signals may fail to provide sustained drive. Here we report an extended mode of reward-predictive dopamine signalling in the striatum that emerged as rats moved towards distant goals. These dopamine signals, which were detected with fast-scan cyclic voltammetry (FSCV), gradually increased or—in rare instances—decreased as the animals navigated mazes to reach remote rewards, rather than having phasic or steady tonic profiles. These dopamine increases (ramps) scaled flexibly with both the distance and size of the rewards. During learning, these dopamine signals showed spatial preferences for goals in different locations and readily changed in magnitude to reflect changing values of the distant rewards. Such prolonged dopamine signalling could provide sustained motivational drive, a control mechanism that may be important for normal behaviour and that can be impaired in a range of neurologic and neuropsychiatric disorders.

[1]  I. Whishaw,et al.  Dopamine depletion, stimulation or blockade in the rat disrupts spatial navigation and locomotion dependent upon beacon or distal cues , 1985, Behavioural Brain Research.

[2]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[3]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[4]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[5]  W. Schultz.  Getting Formal with Dopamine and Reward , 2002, Neuron.

[6]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[7]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[8]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[9]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[10]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[11]  P. Dayan,et al.  Dopamine, uncertainty and TD learning , 2005, Behavioral and Brain Functions.

[12]  K. Berridge.  The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[13]  P. Redgrave,et al.  The short-latency dopamine signal: a role in discovering novel actions? , 2006, Nature Reviews Neuroscience.

[14]  J. Salamone,et al.  Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits , 2007, Psychopharmacology.

[15]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[16]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[17]  R. Palmiter,et al.  Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior , 2009, Proceedings of the National Academy of Sciences.

[18]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[19]  R. Wightman,et al.  Multivariate concentration determination using principal component regression with residual analysis. , 2009, Trends in analytical chemistry : TRAC.

[20]  M. Walton,et al.  Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine , 2009, Nature Neuroscience.

[21]  Nephi Stella,et al.  Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals , 2009, Nature Methods.

[22]  Joshua L. Jones,et al.  Phasic Nucleus Accumbens Dopamine Release Encodes Effort- and Delay-Related Costs , 2010, Biological Psychiatry.

[23]  E. Moser,et al.  A manifold of spatial maps in the brain , 2010, Trends in Cognitive Sciences.

[24]  Erratum to “Multivariate concentration determination using principal component regression with residual analysis” [Trends Anal. Chem. 28 (2009) 1127–1136] , 2010 .

[25]  T. Robinson,et al.  A selective role for dopamine in reward learning , 2010, Nature.

[26]  J. Tsien,et al.  NMDA Receptors in Dopaminergic Neurons Are Crucial for Habit Learning , 2011, Neuron.

[27]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[28]  J. Salamone,et al.  The Mysterious Motivational Functions of Mesolimbic Dopamine , 2012, Neuron.

[29]  C. Vorhees,et al.  Dorsal striatal dopamine depletion impairs both allocentric and egocentric navigation in rats , 2012, Neurobiology of Learning and Memory.