Representation of negative motivational value in the primate lateral habenula

An action may lead to either a reward or a punishment. Therefore, an appropriate action needs to be chosen on the basis of the values of both expected rewards and expected punishments. To understand the underlying neural mechanisms, we conditioned monkeys using a Pavlovian procedure with two distinct contexts: one in which rewards were available and another in which punishments were feared. We found that the population of lateral habenula neurons was most strongly excited by a conditioned stimulus associated with the most unpleasant event in each context: the absence of the reward or the presence of the punishment. The population of lateral habenula neurons was also excited by the punishment itself and inhibited by the reward itself, especially when they were less predictable. These results suggest that the lateral habenula has the potential to adaptively control both reward-seeking and punishment-avoidance behaviors, presumably through its projections to dopaminergic and serotonergic systems.

[1]  R. Solomon,et al.  An opponent-process theory of motivation. I. Temporal dynamics of affect. , 1974, Psychological review.

[2]  W. Nauta,et al.  Afferent connections of the habenular nuclei in the rat. A horseradish peroxidase study, with a note on the fiber‐of‐passage problem , 1977, The Journal of comparative neurology.

[3]  G. Aghajanian,et al.  Physiological evidence for habenula as major link between forebrain and midbrain raphe. , 1977, Science.

[4]  R. Solomon,et al.  An Opponent-Process Theory of Motivation , 1978 .

[5]  W. Nauta,et al.  Efferent connections of the habenular nuclei in the rat , 1979, The Journal of comparative neurology.

[6]  A. Parent,et al.  The origin of forebrain afferents to the habenula in rat, cat and monkey , 1981, Brain Research Bulletin.

[7]  Robert J. Sutherland,et al.  The dorsal diencephalic conduction system: A review of the anatomy and functions of the habenular complex , 1982, Neuroscience & Biobehavioral Reviews.

[8]  K. Wilcox,et al.  Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[10]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[12]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[13]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[14]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[15]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[16]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[17]  R. Wise Dopamine, learning and motivation , 2004, Nature Reviews Neuroscience.

[18]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[19]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[20]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[21]  P. Glimcher Indeterminacy in brain and behavior. , 2005, Annual review of psychology.

[22]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[23]  山田 洋 Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action , 2005 .

[24]  Dirk J. Heslenfeld,et al.  Activity in human reward-sensitive brain areas is strongly context dependent , 2005, NeuroImage.

[25]  N. J. Gandhi,et al.  Temporal interactions of air-puff-evoked blinks and saccadic eye movements: insights into motor preparation. , 2005, Journal of neurophysiology.

[26]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[27]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[28]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[29]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[30]  P. Shepard,et al.  Lateral Habenula Stimulation Inhibits Rat Midbrain Dopamine Neurons through a GABAA Receptor-Mediated Mechanism , 2007, The Journal of Neuroscience.

[31]  O. Hikosaka,et al.  Lateral habenula as a source of negative reward signals in dopamine neurons , 2007, Nature.

[32]  P. Kelly,et al.  A conductor hidden in the orchestra? Role of the habenular complex in monoamine transmission and cognition , 2007, Neuroscience & Biobehavioral Reviews.

[33]  Joseph J. Paton,et al.  Expectation Modulates Neural Responses to Pleasant and Aversive Stimuli in Primate Amygdala , 2007, Neuron.

[34]  E. Procyk,et al.  Expectations, gains, and losses in the anterior cingulate cortex , 2007, Cognitive, affective & behavioral neuroscience.

[35]  R. Dolan,et al.  The neurobiology of punishment , 2007, Nature Reviews Neuroscience.

[36]  B. Moghaddam,et al.  Differential tonic influence of lateral habenula on prefrontal cortex and nucleus accumbens dopamine release , 2008, European Journal of Neuroscience.

[37]  Kae Nakamura,et al.  Reward-Dependent Modulation of Neuronal Activity in the Primate Dorsal Raphe Nucleus , 2008, The Journal of Neuroscience.

[38]  P. Glimcher,et al.  Value Representations in the Primate Striatum during Matching Behavior , 2008, Neuron.

[39]  Hua Zhao,et al.  Lateral habenula lesions improve the behavioral response in depressed rats via increasing the serotonin level in dorsal raphe nucleus , 2008, Behavioural Brain Research.

[40]  T. Robbins,et al.  Serotoninergic regulation of emotional and behavioural control processes , 2008, Trends in Cognitive Sciences.

[41]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .