Neuron-type specific signals for reward and punishment in the ventral tegmental area

Dopamine has a central role in motivation and reward. Dopaminergic neurons in the ventral tegmental area (VTA) signal the discrepancy between expected and actual rewards (that is, reward prediction error), but how they compute such signals is unknown. We recorded the activity of VTA neurons while mice associated different odour cues with appetitive and aversive outcomes. We found three types of neuron based on responses to odours and outcomes: approximately half of the neurons (type I, 52%) showed phasic excitation after reward-predicting odours and rewards in a manner consistent with reward prediction error coding; the other half of neurons showed persistent activity during the delay between odour and outcome that was modulated positively (type II, 31%) or negatively (type III, 18%) by the value of outcomes. Whereas the activity of type I neurons was sensitive to actual outcomes (that is, when the reward was delivered as expected compared to when it was unexpectedly omitted), the activity of type II and type III neurons was determined predominantly by reward-predicting odours. We ‘tagged’ dopaminergic and GABAergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to optical stimulation while recording. All identified dopaminergic neurons were of type I and all GABAergic neurons were of type II. These results show that VTA GABAergic neurons signal expected reward, a key variable for dopaminergic neurons to calculate reward prediction error.

[1]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[2]  L. Swanson,et al.  The projections of the ventral tegmental area and adjacent regions: A combined fluorescent retrograde tracer and immunofluorescence study in the rat , 1982, Brain Research Bulletin.

[3]  R. North,et al.  Opioids excite dopamine neurons by hyperpolarization of local interneurons , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[5]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[6]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[7]  S. Henriksen,et al.  Electrophysiological Characterization of GABAergic Neurons in the Ventral Tegmental Area , 1998, The Journal of Neuroscience.

[8]  S. Sesack,et al.  Projections from the Rat Prefrontal Cortex to the Ventral Tegmental Area: Target Specificity in the Synaptic Associations with Mesoaccumbens and Mesocortical Neurons , 2000, The Journal of Neuroscience.

[9]  B. Szabo,et al.  SHORT COMMUNICATION Inhibition of GABAergic neurotransmission in the ventral tegmental area by cannabinoids , 2002, The European journal of neuroscience.

[10]  H. Mansvelder,et al.  Synaptic Mechanisms Underlie Nicotine-Induced Excitability of Brain Reward Areas , 2002, Neuron.

[11]  Z. Mainen,et al.  Speed and accuracy of olfactory discrimination in the rat , 2003, Nature Neuroscience.

[12]  E. Bamberg,et al.  Channelrhodopsin-2, a directly light-gated cation-selective membrane channel , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[13]  A. Redish,et al.  Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. , 2004, Journal of neurophysiology.

[14]  O. Hikosaka,et al.  A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. , 2004, Journal of neurophysiology.

[15]  A. Redish,et al.  Addiction as a Computational Process Gone Awry , 2004, Science.

[16]  K. Deisseroth,et al.  Millisecond-timescale, genetically targeted optical control of neural activity , 2005, Nature Neuroscience.

[17]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[18]  S. Hyman,et al.  Neural mechanisms of addiction: the role of reward-related learning and memory. , 2006, Annual review of neuroscience.

[19]  Elyssa B. Margolis,et al.  The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? , 2006, The Journal of physiology.

[20]  B. Hoffer,et al.  Characterization of a mouse strain expressing Cre recombinase from the 3′ untranslated region of the dopamine transporter locus , 2006, Genesis.

[21]  W. Schultz.  Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[22]  O. Hikosaka,et al.  Lateral habenula as a source of negative reward signals in dopamine neurons , 2007, Nature.

[23]  W. Newsome,et al.  The temporal precision of reward prediction in dopamine neurons , 2008, Nature Neuroscience.

[24]  S. Lammel,et al.  Unique Properties of Mesoprefrontal Neurons within a Dual Mesocorticolimbic Dopamine System , 2008, Neuron.

[25]  J. Paul Bolam,et al.  Faculty Opinions recommendation of Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. , 2008 .

[26]  S. Sternson,et al.  A FLEX Switch Targets Channelrhodopsin-2 to Multiple Cell Types for Imaging and Long-Range Circuit Mapping , 2008, The Journal of Neuroscience.

[27]  J. Bolam,et al.  Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat , 2008, Neuroscience.

[28]  Susana Q. Lima,et al.  PINP: A New Method of Tagging Neuronal Populations for Identification during In Vivo Electrophysiological Recording , 2009, PloS one.

[29]  Yasushi Kobayashi,et al.  Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards , 2009, The Journal of Neuroscience.

[30]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[31]  Mark G. Baxter,et al.  The Rostromedial Tegmental Nucleus (RMTg), a GABAergic Afferent to Midbrain Dopamine Neurons, Encodes Aversive Stimuli and Inhibits Motor Responses , 2009, Neuron.

[32]  K. Deisseroth,et al.  Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning , 2009, Science.

[33]  Natalia Omelchenko,et al.  Ultrastructural analysis of local collaterals of rat ventral tegmental area neurons: GABA phenotype and synapses onto dopamine and GABA cells , 2009, Synapse.

[34]  Kelly R. Tan,et al.  Neural bases for addictive properties of benzodiazepines , 2010, Nature.

[35]  Elyssa B. Margolis,et al.  Glutamatergic and Nonglutamatergic Neurons of the Ventral Tegmental Area Establish Local Synaptic Contacts with Dopaminergic and Nondopaminergic Neurons , 2010, The Journal of Neuroscience.

[36]  R. Malenka,et al.  Drug-Evoked Synaptic Plasticity in Addiction: From Molecular Changes to Circuit Remodeling , 2011, Neuron.

[37]  Linh Vong,et al.  Leptin Action on GABAergic Neurons Prevents Obesity and Reduces Inhibitory Tone to POMC Neurons , 2011, Neuron.

[38]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[39]  G. Feng,et al.  Cell type–specific channelrhodopsin-2 transgenic mice for optogenetic dissection of neural circuitry function , 2011, Nature Methods.