A basal ganglia circuit for evaluating action outcomes

The basal ganglia, a group of subcortical nuclei, play a crucial role in decision-making by selecting actions and evaluating their outcomes. While much is known about the function of the basal ganglia circuitry in selection, how these nuclei contribute to outcome evaluation is less clear. Here we show that neurons in the habenula-projecting globus pallidus (GPh) in mice are essential for evaluating action outcomes and are regulated by a specific set of inputs from the basal ganglia. We find in a classical conditioning task that individual mouse GPh neurons bidirectionally encode whether an outcome is better or worse than expected. Mimicking these evaluation signals with optogenetic inhibition or excitation is sufficient to reinforce or discourage actions in a decision-making task. Moreover, cell-type-specific synaptic manipulations reveal that the inhibitory and excitatory inputs to the GPh are necessary for mice to appropriately evaluate positive and negative feedback, respectively. Finally, using rabies-virus-assisted monosynaptic tracing, we show that the GPh is embedded in a basal ganglia circuit wherein it receives inhibitory input from both striosomal and matrix compartments of the striatum, and excitatory input from the ‘limbic’ regions of the subthalamic nucleus. Our results provide evidence that information about the selection and evaluation of actions is channelled through distinct sets of basal ganglia circuits, with the GPh representing a key locus in which information of opposing valence is integrated to determine whether action outcomes are better or worse than expected.

[1]  Simon Hong,et al.  A pallidus-habenula-dopamine pathway signals inferred stimulus values. , 2010, Journal of neurophysiology.

[2]  Naoshige Uchida,et al.  Habenula Lesions Reveal that Multiple Mechanisms Underlie Dopamine Prediction Errors , 2015, Neuron.

[3]  A. Gittis,et al.  Transgenic Mouse Lines Subdivide External Segment of the Globus Pallidus (GPe) Neurons and Reveal Distinct GPe Output Pathways , 2014, The Journal of Neuroscience.

[4]  C. Baunez,et al.  The Good and Bad Differentially Encoded within the Subthalamic Nucleus in Rats , 2015, eNeuro.

[5]  Simon Hong,et al.  Negative Reward Signals from the Lateral Habenula to Dopamine Neurons Are Mediated by Rostromedial Tegmental Nucleus in Primates , 2011, The Journal of Neuroscience.

[6]  F. Fujiyama,et al.  Exclusive and common targets of neostriatofugal projections of rat striosome neurons: a single neuron‐tracing study using a viral vector , 2011, The European journal of neuroscience.

[7]  L. Wilbrecht,et al.  Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value , 2012, Nature Neuroscience.

[8]  Anatol C. Kreitzer,et al.  Reassessing models of basal ganglia function and dysfunction. , 2014, Annual review of neuroscience.

[9]  Simon Hong,et al.  The Globus Pallidus Sends Reward-Related Signals to the Lateral Habenula , 2008, Neuron.

[10]  O. Hikosaka Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement , 2007, Annals of the New York Academy of Sciences.

[11]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[12]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[13]  Miao He,et al.  ErbB4 regulation of a thalamic reticular nucleus circuit for sensory selection , 2014, Nature Neuroscience.

[14]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[15]  L. Luo,et al.  Visualizing the Distribution of Synapses from Individual Neurons in the Mouse Brain , 2010, PloS one.

[16]  N. Rajakumar,et al.  Compartmental origin of the striato‐entopeduncular projection in the rat , 1993, The Journal of comparative neurology.

[17]  Ken-ichi Amemori,et al.  Shifting Responsibly: The Importance of Striatal Modularity to Reinforcement Learning in Uncertain Environments , 2011, Front. Hum. Neurosci..

[18]  Jadin C. Jackson,et al.  Quantitative measures of cluster quality for use in extracellular recordings , 2005, Neuroscience.

[19]  Christophe D. Proulx,et al.  Input to the Lateral Habenula from the Basal Ganglia Is Excitatory, Aversive, and Suppressed by Serotonin , 2012, Neuron.

[20]  P. Somogyi,et al.  From synapse to behavior: rapid modulation of defined neuronal types with engineered GABAA receptors , 2007, Nature Neuroscience.

[21]  S. Salinas,et al.  An Update on Canine Adenovirus Type 2 and Its Vectors , 2010, Viruses.

[22]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[23]  Sten Grillner,et al.  Independent circuits in the basal ganglia for the evaluation and selection of actions , 2013, Proceedings of the National Academy of Sciences.

[24]  M. D. Crutcher,et al.  Primate globus pallidus and subthalamic nucleus: functional organization. , 1985, Journal of neurophysiology.

[25]  S. Vincent,et al.  Somatostatin immunoreactivity in the entopeduncular projection to the lateral habenula in the rat , 1986, Neuroscience Letters.

[26]  Liqun Luo,et al.  Monosynaptic Circuit Tracing with Glycoprotein-Deleted Rabies Viruses , 2015, The Journal of Neuroscience.

[27]  Wolfram Schultz,et al.  Dopamine reward prediction-error signalling: a two-component response , 2016, Nature Reviews Neuroscience.

[28]  J. Saint-Cyr,et al.  The subthalamic nucleus in the context of movement disorders. , 2004, Brain : a journal of neurology.

[29]  H. Kita,et al.  Efferent projections of the subthalamic nucleus in the rat: Light and electron microscopic analysis with the PHA‐L method , 1987, The Journal of comparative neurology.

[30]  Nikolaos Karalis,et al.  Prefrontal parvalbumin interneurons shape neuronal activity to drive fear expression , 2013, Nature.

[31]  Alice M Stamatakis,et al.  Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance , 2012, Nature Neuroscience.

[32]  Michael Q. Zhang,et al.  SNARE Protein Recycling by αSNAP and βSNAP Supports Synaptic Vesicle Priming , 2012, Neuron.

[33]  Mark G. Baxter,et al.  The Rostromedial Tegmental Nucleus (RMTg), a GABAergic Afferent to Midbrain Dopamine Neurons, Encodes Aversive Stimuli and Inhibits Motor Responses , 2009, Neuron.

[34]  A. Parent,et al.  Two types of projection neurons in the internal pallidum of primates: Single‐axon tracing and three‐dimensional reconstruction , 2001, The Journal of comparative neurology.

[35]  Jason Tucciarone,et al.  The paraventricular thalamus controls a central amygdala fear circuit , 2014, Nature.

[36]  O. Hikosaka,et al.  Lateral habenula as a source of negative reward signals in dopamine neurons , 2007, Nature.