Linking reward processing to behavioral output: motor and motivational integration in the primate subthalamic nucleus

The expectation and detection of motivationally relevant events is a major determinant of goal-directed behavior and there is a strong interest in the contribution of basal ganglia in the integration of motivational processes into behavioral output. Recent research has focused on the role of the subthalamic nucleus (STN) in the motivational control of action, but it remains to be determined how information about reward is encoded in this nucleus. We recorded the activity of single neurons in the STN of two behaving monkeys to examine whether activity was influenced by the delivery of reward in an instrumental task, a Pavlovian stimulus-reward association, or outside of a task context. We confirmed preliminary findings indicating that STN neurons were sensitive not only to rewards obtained during task performance, but also to the expectation of reward when its delivery was delayed in time. Most of the modulations at the onset of reaching movement were combined with modulations following reward delivery, suggesting the convergence of signals related to the animal’s movement and its outcome in the same neurons. Some neurons were also influenced by the visuomotor contingencies of the task, i.e., target location and/or movement direction. In addition, modulations were observed under conditions where reward delivery was not contingent on an instrumental response, even in the absence of a reward predictive cue. Taken as a whole, these results demonstrate a potential contribution of the STN to motivational control of behavior in the non-human primate, although problems in distinguishing neuronal signals related to reward from those related to motor behavior should be considered. Characterizing the specificity of reward processing in the STN remains challenging and could have important implications for understanding the influence of this key component of basal ganglia circuitry on emotional and motivated behaviors under normal and pathological conditions.

[1]  R. Poldrack,et al.  Cortical and Subcortical Contributions to Stop Signal Response Inhibition: Role of the Subthalamic Nucleus , 2006, The Journal of Neuroscience.

[2]  P. Brown,et al.  Activation of the subthalamic region during emotional processing in Parkinson disease , 2005, Neurology.

[3]  H. Freund,et al.  Deep brain stimulation of the subthalamic nucleus enhances emotional processing in Parkinson disease. , 2003, Archives of general psychiatry.

[4]  H. Groenewegen,et al.  Connections of the subthalamic nucleus with ventral striatopallidal parts of the basal ganglia in the rat , 1990, The Journal of comparative neurology.

[5]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[6]  Paul Apicella,et al.  Modulation of neuronal activity in the monkey putamen associated with changes in the habitual order of sequential movements. , 2010, Journal of neurophysiology.

[7]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[8]  P. Apicella,et al.  Reward-related neuronal activity in the subthalamic nucleus of the monkey , 2005, Neuroreport.

[9]  B. Forstmann,et al.  Ultra-High 7T MRI of Structural Age-Related Changes of the Subthalamic Nucleus , 2012, The Journal of Neuroscience.

[10]  E. Montgomery,et al.  The Subthalamic Nucleus , 2014 .

[11]  Sabrina Ravel,et al.  Influence of spatial information on responses of tonically active neurons in the monkey striatum. , 1998, Journal of neurophysiology.

[12]  O. Hikosaka,et al.  Role for Subthalamic Nucleus Neurons in Switching from Automatic to Controlled Eye Movement , 2008, The Journal of Neuroscience.

[13]  T. Robbins,et al.  Enhanced Food-Related Motivation after Bilateral Lesions of the Subthalamic Nucleus , 2002, The Journal of Neuroscience.

[14]  M. D. Crutcher,et al.  Relations between parameters of step-tracking movements and single cell discharge in the globus pallidus and subthalamic nucleus of the behaving monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Y. Agid,et al.  Compulsions, Parkinson's disease, and stimulation , 2002, The Lancet.

[16]  C. Baunez,et al.  Deep brain stimulation for addiction: why the subthalamic nucleus should be favored , 2013, Current Opinion in Neurobiology.

[17]  T. Robbins,et al.  Effects of dopamine depletion of the dorsal striatum and further interaction with subthalamic nucleus lesions in an attentional task in the rat , 1999, Neuroscience.

[18]  S. Haber,et al.  The Organization of Prefrontal-Subthalamic Inputs in Primates Provides an Anatomical Substrate for Both Functional Specificity and Integration: Implications for Basal Ganglia Models and Deep Brain Stimulation , 2013, The Journal of Neuroscience.

[19]  Michael J. Frank,et al.  Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism , 2007, Science.

[20]  Y. Agid,et al.  Stimulation of the subthalamic nucleus in Parkinson’s disease: a 5 year follow up , 2005, Journal of Neurology, Neurosurgery & Psychiatry.

[21]  D. Hellwig Effect of subthalamic stimulation on mood state in Parkinson’s disease: evaluation of previous facts and problems , 2005, Neurosurgical Review.

[22]  R. Brown,et al.  Behavioural disorders, Parkinson's disease, and subthalamic stimulation , 2002, Journal of neurology, neurosurgery, and psychiatry.

[23]  Rajita Sinha,et al.  Subcortical processes of motor response inhibition during a stop signal task , 2008, NeuroImage.

[24]  Didier Grandjean,et al.  Author's Personal Copy Neuroscience and Biobehavioral Reviews Subthalamic Nucleus: a Key Structure for Emotional Component Synchronization in Humans Author's Personal Copy , 2022 .

[25]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[26]  M. Delgado,et al.  Reward‐Related Responses in the Human Striatum , 2007, Annals of the New York Academy of Sciences.

[27]  M. Amalric,et al.  The subthalamic nucleus exerts opposite control on cocaine and 'natural' rewards , 2005, Nature Neuroscience.

[28]  P. Brown,et al.  The subthalamic region is activated during valence‐related emotional processing in patients with Parkinson's disease , 2007, The European journal of neuroscience.

[29]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[30]  K. Kurisu,et al.  Effect of subthalamic stimulation on mood state in Parkinson’s disease: evaluation of previous facts and problems , 2005, Neurosurgical Review.

[31]  H. Bergman,et al.  The primate subthalamic nucleus. I. Functional properties in intact animals. , 1994, Journal of neurophysiology.

[32]  Eric Legallet,et al.  Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states , 1997, Experimental Brain Research.

[33]  Aviva Abosch,et al.  Stimulation of the Subthalamic Nucleus in Parkinson’s Disease Does Not Produce Striatal Dopamine Release , 2003, Neurosurgery.

[34]  P. Apicella,et al.  Reward Unpredictability inside and outside of a Task Context as a Determinant of the Responses of Tonically Active Neurons in the Monkey Striatum , 2001, The Journal of Neuroscience.

[35]  C. Baunez,et al.  Beyond the reward pathway: coding reward magnitude and error in the rat subthalamic nucleus. , 2009, Journal of neurophysiology.

[36]  P. Apicella,et al.  Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context , 2009, The European journal of neuroscience.

[37]  J. Régis,et al.  Addiction in Parkinson's disease: Impact of subthalamic nucleus deep brain stimulation , 2005, Movement disorders : official journal of the Movement Disorder Society.

[38]  Paul Krack,et al.  Mirthful laughter induced by subthalamic nucleus stimulation , 2001, Movement disorders : official journal of the Movement Disorder Society.

[39]  G. Rebec,et al.  Subthalamic and striatal neurons concurrently process motor, limbic, and associative information in rats performing an operant task. , 2007, Journal of neurophysiology.

[40]  L. Tremblay,et al.  The pallidosubthalamic projection: An anatomical substrate for nonmotor functions of the subthalamic nucleus in primates , 2005, Movement disorders : official journal of the Movement Disorder Society.

[41]  J. Yelnik,et al.  Neuronal activity correlated with checking behaviour in the subthalamic nucleus of patients with obsessive-compulsive disorder. , 2013, Brain : a journal of neurology.

[42]  J. Régis,et al.  Subthalamic nucleus stimulation and compulsive use of dopaminergic medication in Parkinson's disease , 2013, Journal of Neurology, Neurosurgery & Psychiatry.

[43]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[44]  Eric Seigneuret,et al.  Subthalamic stimulation in Parkinson's disease: restoring the balance of motivated behaviours. , 2012, Brain : a journal of neurology.

[45]  T. Robbins,et al.  Bilateral Lesions of the Subthalamic Nucleus Induce Multiple Deficits in an Attentional Task in Rats , 1997, The European journal of neuroscience.

[46]  C. Baunez,et al.  Different populations of subthalamic neurons encode cocaine vs. sucrose reward and predict future error. , 2013, Journal of neurophysiology.

[47]  M. Inase,et al.  Organization of inputs from cingulate motor areas to basal ganglia in macaque monkey , 2001, The European journal of neuroscience.

[48]  M. D. Crutcher,et al.  Primate globus pallidus and subthalamic nucleus: functional organization. , 1985, Journal of neurophysiology.

[49]  O. Hikosaka,et al.  Visual and oculomotor functions of monkey subthalamic nucleus. , 1992, Journal of neurophysiology.

[50]  A. Benabid,et al.  Acute psychotropic effects of bilateral subthalamic nucleus stimulation and levodopa in Parkinson's disease , 2003, Movement disorders : official journal of the Movement Disorder Society.

[51]  J. Yelnik,et al.  Six questions on the subthalamic nucleus: lessons from animal models and from stimulated patients , 2011, Neuroscience.