Habenula Lesions Reveal that Multiple Mechanisms Underlie Dopamine Prediction Errors

Dopamine (DA) neurons are thought to facilitate learning by signaling reward prediction errors (RPEs), the discrepancy between actual and expected reward. However, how RPEs are calculated remains unknown. It has been hypothesized that DA neurons receive RPE signals from the lateral habenula. Here, we tested how lesions of the habenular complex affect the response of optogenetically identified DA neurons in mice. We found that lesions impaired specific aspects of RPE signaling in DA neurons. The inhibitory responses caused by reward omission were greatly diminished while inhibitory responses to aversive stimuli, such as air puff-predictive cues or air puff, remained unimpaired. Furthermore, we found that after habenula lesions, DA neurons' ability to signal graded levels of positive RPEs became unreliable, yet significant excitatory responses still remained. These results demonstrate that the habenula plays a critical role in DA RPE signaling but suggest that it is not the exclusive source of RPE signals.

[1]  K. Brinschwitz,et al.  Glutamatergic axons from the lateral habenula mainly terminate on GABAergic neurons of the ventral midbrain , 2010, Neuroscience.

[2]  K. Wilcox,et al.  Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Joshua H. Jennings,et al.  Tools for Resolving Functional Activity and Connectivity within Intact Neural Circuits , 2014, Current Biology.

[4]  O. Hikosaka,et al.  Electrical Stimulation of the Primate Lateral Habenula Suppresses Saccadic Eye Movement through a Learning Mechanism , 2011, PloS one.

[5]  W. Wildman,et al.  Theoretical Neuroscience , 2014 .

[6]  S. Higashijima,et al.  The Habenulo-Raphe Serotonergic Circuit Encodes an Aversive Expectation Value Essential for Adaptive Active Avoidance of Danger , 2014, Neuron.

[7]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[8]  B. Hangya,et al.  Distinct behavioural and network correlates of two interneuron types in prefrontal cortex , 2013, Nature.

[9]  G. Silberberg,et al.  A Whole-Brain Atlas of Inputs to Serotonergic Neurons of the Dorsal and Median Raphe Nuclei , 2014, Neuron.

[10]  Jeremiah Y. Cohen,et al.  Serotonergic neurons signal reward and punishment on multiple timescales , 2015, eLife.

[11]  K. Tye,et al.  BLA to vHPC Inputs Modulate Anxiety-Related Behaviors , 2013, Neuron.

[12]  David L. Molfese,et al.  The medial habenula: still neglected , 2013, Front. Hum. Neurosci..

[13]  Liqun Luo,et al.  Diversity of Transgenic Mouse Models for Selective Targeting of Midbrain Dopamine Neurons , 2015, Neuron.

[14]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[15]  W. Nauta,et al.  Efferent connections of the habenular nuclei in the rat , 1979, The Journal of comparative neurology.

[16]  Jadin C. Jackson,et al.  Quantitative measures of cluster quality for use in extracellular recordings , 2005, Neuroscience.

[17]  Sachie K. Ogawa,et al.  Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons , 2012, Neuron.

[18]  Stan B. Floresco,et al.  What’s better for me? Fundamental role for lateral habenula in promoting subjective decision biases , 2013, Nature Neuroscience.

[19]  Liqun Luo,et al.  Presynaptic Partners of Dorsal Raphe Serotonergic and GABAergic Neurons , 2014, Neuron.

[20]  Z. Mainen,et al.  Speed and accuracy of olfactory discrimination in the rat , 2003, Nature Neuroscience.

[21]  Alice M Stamatakis,et al.  Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance , 2012, Nature Neuroscience.

[22]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[23]  S. Sesack,et al.  Lateral habenula projections to dopamine and GABA neurons in the rat ventral tegmental area , 2009, The European journal of neuroscience.

[24]  S. Sternson,et al.  A FLEX Switch Targets Channelrhodopsin-2 to Multiple Cell Types for Imaging and Long-Range Circuit Mapping , 2008, The Journal of Neuroscience.

[25]  Mark G. Baxter,et al.  The Rostromedial Tegmental Nucleus (RMTg), a GABAergic Afferent to Midbrain Dopamine Neurons, Encodes Aversive Stimuli and Inhibits Motor Responses , 2009, Neuron.

[26]  B. Hoffer,et al.  Characterization of a mouse strain expressing Cre recombinase from the 3′ untranslated region of the dopamine transporter locus , 2006, Genesis.

[27]  D. Fage,et al.  Evidence for, and nature of, the tonic inhibitory influence of habenulointerpeduncular pathways upon cerebral dopaminergic transmission in the rat , 1986, Brain Research.

[28]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[29]  R. Strecker,et al.  Regulation of striatal serotonin release by the lateral habenula-dorsal raphe pathway in the rat as demonstrated by in vivo microdialysis: role of excitatory amino acids and GABA , 1989, Brain Research.

[30]  W. Klemm Habenular and interpeduncularis nuclei: shared components in multiple-function networks. , 2004, Medical science monitor : international medical journal of experimental and clinical research.

[31]  G. Aghajanian,et al.  Habenular and other midbrain raphe afferents demonstrated by a modified retrograde tracing technique , 1977, Brain Research.

[32]  Naoshige Uchida,et al.  Robust Odor Coding via Inhalation-Coupled Transient Activity in the Mammalian Olfactory Bulb , 2010, Neuron.

[33]  S. Nakanishi,et al.  Aversive behavior induced by optogenetic inactivation of ventral tegmental area dopamine neurons is mediated by dopamine D2 receptors in the nucleus accumbens , 2014, Proceedings of the National Academy of Sciences.

[34]  E. Thornton,et al.  Effort and stress influence the effect of lesion of the habenula complex in one-way active avoidance learning , 1989, Physiology & Behavior.

[35]  O. Hikosaka,et al.  Representation of negative motivational value in the primate lateral habenula , 2009, Nature Neuroscience.

[36]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[37]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[38]  Lief E. Fenno,et al.  Amygdala circuitry mediating reversible and bidirectional control of anxiety , 2011, Nature.

[39]  P. Shepard,et al.  Lateral Habenula Stimulation Inhibits Rat Midbrain Dopamine Neurons through a GABAA Receptor-Mediated Mechanism , 2007, The Journal of Neuroscience.

[40]  George Paxinos,et al.  The Mouse Brain in Stereotaxic Coordinates , 2001 .

[41]  O. Hikosaka,et al.  Lateral habenula as a source of negative reward signals in dopamine neurons , 2007, Nature.

[42]  E. Thornton,et al.  A water-maze discrimination learning deficit in the rat following lesion of the habenula , 1991, Physiology & Behavior.

[43]  P. Kelly,et al.  A conductor hidden in the orchestra? Role of the habenular complex in monoamine transmission and cognition , 2007, Neuroscience & Biobehavioral Reviews.

[44]  Susana Q. Lima,et al.  PINP: A New Method of Tagging Neuronal Populations for Identification during In Vivo Electrophysiological Recording , 2009, PloS one.

[45]  Kelly R. Tan,et al.  GABA Neurons of the VTA Drive Conditioned Place Aversion , 2012, Neuron.

[46]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[47]  S. Higashijima,et al.  The habenula is crucial for experience-dependent modification of fear responses in zebrafish , 2010, Nature Neuroscience.

[48]  H. Kimura,et al.  The efferent projections of the rat lateral habenular nucleus revealed by the PHA-L anterograde tracing method , 1988, Brain Research.

[49]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[50]  Naoshige Uchida,et al.  Organization of monosynaptic inputs to the serotonin and dopamine neuromodulatory systems. , 2014, Cell reports.

[51]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[52]  Simon Hong,et al.  Negative Reward Signals from the Lateral Habenula to Dopamine Neurons Are Mediated by Rostromedial Tegmental Nucleus in Primates , 2011, The Journal of Neuroscience.

[53]  L. Kamin Predictability, surprise, attention, and conditioning , 1967 .

[54]  Robert J. Sutherland,et al.  The dorsal diencephalic conduction system: A review of the anatomy and functions of the habenular complex , 1982, Neuroscience & Biobehavioral Reviews.