Independent Coding of Movement Direction and Reward Prediction by Single Pallidal Neurons

Associating action with its reward value is a basic ability needed by adaptive organisms and requires the convergence of limbic, motor, and associative information. To chart the basal ganglia (BG) involvement in this association, we recorded the activity of 61 well isolated neurons in the external segment of the globus pallidus (GPe) of two monkeys performing a probabilistic visuomotor task. Our results indicate that most (96%) neurons responded to multiple phases of the task. The activity of many (34%) pallidal neurons was modulated solely by direction of movement, and the activity of only a few (3%) pallidal neurons was modulated exclusively by reward prediction. However, the activity of a large number (41%) of single pallidal neurons was comodulated by both expected trial outcome and direction of arm movement. The information carried by the neuronal activity of single pallidal neurons dynamically changed as the trial progressed. The activity was predominantly modulated by both outcome prediction and future movement direction at the beginning of trials and became modulated mainly by movement-direction toward the end of trials. GPe neurons can either increase or decrease their discharge rate in response to predicted future reward. The effects of movement-direction and reward probability on neural activity are linearly summed and thus reflect two independent modulations of pallidal activity. We propose that GPe neurons are uniquely suited for independent processing of a multitude of parameters. This is enabled by the funnel-structure characteristic of the BG architecture, as well as by the anatomical and physiological properties of GPe neurons.

[1]  E. Vaadia,et al.  Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons , 2004, Neuron.

[2]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[3]  A. Redish,et al.  Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. , 2004, Journal of neurophysiology.

[4]  M. Delong,et al.  The primate globus pallidus: neuronal activity related to direction of movement , 2004, Experimental Brain Research.

[5]  H. Bergman,et al.  Information processing, dimensionality reduction and reinforcement learning in the basal ganglia , 2003, Progress in Neurobiology.

[6]  O. Hikosaka,et al.  Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus , 2003, The Journal of Neuroscience.

[7]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[8]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[9]  Sabrina Ravel,et al.  Responses of Tonically Active Neurons in the Monkey Striatum Discriminate between Motivationally Opposing Stimuli , 2003, The Journal of Neuroscience.

[10]  Barbara J Knowlton,et al.  Analysis of probabilistic classification learning in patients with Parkinson's disease before and after pallidotomy surgery. , 2003, Learning & memory.

[11]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[12]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[13]  J. Dostrovsky,et al.  Synchronized Neuronal Discharge in the Basal Ganglia of Parkinsonian Patients Is Limited to Oscillatory Activity , 2002, The Journal of Neuroscience.

[14]  Okihide Hikosaka,et al.  Role of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement , 2002, The Journal of Neuroscience.

[15]  Wolfram Schultz,et al.  Behavioral reactions reflecting differential reward expectations in monkeys , 2001, Experimental Brain Research.

[16]  W. Schultz,et al.  Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. , 2001, Journal of neurophysiology.

[17]  J C Houk,et al.  Context dependency in the globus pallidus internal segment during targeted arm movements. , 2001, Journal of neurophysiology.

[18]  Y Agid,et al.  Functional mapping of the human globus pallidus: contrasting effect of stimulation in the internal and external pallidum in Parkinson’s disease , 2000, Neuroscience.

[19]  H. Kita,et al.  Excitatory Cortical Inputs to Pallidal Neurons Via the Subthalamic Nucleus in the Monkey , 2000 .

[20]  J. Bolam,et al.  Synaptic organisation of the basal ganglia , 2000, Journal of anatomy.

[21]  P. Glimcher,et al.  Contextual modulation of substantia nigra pars reticulata neurons. , 2000, Journal of neurophysiology.

[22]  J. Price,et al.  Effects of excitotoxic lesions in the ventral striatopallidal–thalamocortical pathway on odor reversal learning: inability to extinguish an incorrect response , 2000, Experimental Brain Research.

[23]  Richard F. Martin,et al.  Primate brain maps : structure of the macaque brain , 2000 .

[24]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[25]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[26]  D. Plenz,et al.  A basal ganglia pacemaker formed by the subthalamic nucleus and external globus pallidus , 1999, Nature.

[27]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[28]  Ivan Toni,et al.  Prefrontal-basal ganglia pathways are involved in the learning of arbitrary visuomotor associations: a PET study , 1999, Experimental Brain Research.

[29]  M. Hariz Decrease in akinesia seems to result from chronic electrical stimulation in the external (GPe) rather than internal (Gpi) pallidum , 1999, Movement disorders : official journal of the Movement Disorder Society.

[30]  J. Bolam,et al.  Selective Innervation of Neostriatal Interneurons by a Subclass of Neuron in the Globus Pallidus of the Rat , 1998, The Journal of Neuroscience.

[31]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[32]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[33]  J. Hollerman,et al.  Modifications of reward expectation-related neuronal activity during learning in primate striatum. , 1998, Journal of neurophysiology.

[34]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[35]  Y. Smith,et al.  Microcircuitry of the direct and indirect pathways of the basal ganglia. , 1998, Neuroscience.

[36]  O. Hikosaka,et al.  Differential roles of monkey striatum in learning of sequential hand movement , 1997, Experimental Brain Research.

[37]  A. E. Lang,et al.  Identification and characterization of neurons with tremor-frequency activity in human globus pallidus , 1997, Experimental Brain Research.

[38]  M. E. Anderson,et al.  Pallidal discharge related to the kinematics of reaching movements in two dimensions. , 1997, Journal of neurophysiology.

[39]  J. Bolam,et al.  Synaptic Integration of Functionally Diverse Pallidal Information in the Entopeduncular Nucleus and Subthalamic Nucleus in the Rat , 1997, The Journal of Neuroscience.

[40]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[41]  A. D. Smith,et al.  The substantia nigra as a site of synaptic integration of functionally diverse information arising from the ventral pallidum and the globus pallidus in the rat , 1996, Neuroscience.

[42]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[43]  D. Oorschot Total number of neurons in the neostriatal, pallidal, subthalamic, and substantia nigral nuclei of the rat basal ganglia: A stereological study using the cavalieri and optical disector methods , 1996, The Journal of comparative neurology.

[44]  R. Llinás,et al.  Electrophysiology of globus pallidus neurons in vitro. , 1994, Journal of neurophysiology.

[45]  D. Brooks,et al.  Motor sequence learning: a study with positron emission tomography , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  A. Graybiel,et al.  Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  P. Strick,et al.  Multiple output channels in the basal ganglia. , 1993, Science.

[48]  H. Kita Responses of globus pallidus neurons to cortical stimulation: intracellular study in the rat , 1992, Brain Research.

[49]  H. Kita,et al.  Intracellular study of rat globus pallidus neurons: membrane properties and responses to neostriatal, subthalamic and nigral stimulation , 1991, Brain Research.

[50]  G. Percheron,et al.  Parallel processing in the basal ganglia: up to a point , 1991, Trends in Neurosciences.

[51]  M. Delong,et al.  Activity of identified wrist-related pallidal neurons during step and ramp wrist movements in the monkey. , 1990, Journal of neurophysiology.

[52]  M. Delong,et al.  Primate models of movement disorders of basal ganglia origin , 1990, Trends in Neurosciences.

[53]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[54]  S. Lehman The Neural and Behavioural Organization of Goal‐Directed Movements , 1990, Neurology.

[55]  S. T. Kitai,et al.  Firing patterns and synaptic potentials of identified giant aspiny interneurons in the rat neostriatum , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[57]  M. Packard,et al.  Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  W. T. Thach,et al.  Preferential relation of pallidal neurons to ballistic movements , 1987, Brain Research.

[59]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[60]  M. D. Crutcher,et al.  Primate globus pallidus and subthalamic nucleus: functional organization. , 1985, Journal of neurophysiology.

[61]  T. Ono,et al.  Movement and non-movement related pallidal unit activity during bar press feeding behavior in the monkey , 1985, Behavioural Brain Research.

[62]  G. Percheron,et al.  A Golgi analysis of the primate globus pallidus. II. Quantitative morphology and spatial orientation of dendritic arborizations , 1984, The Journal of comparative neurology.

[63]  G. Percheron,et al.  A Golgi analysis of the primate globus pallidus. III. Spatial organization of the striato‐pallidal complex , 1984, The Journal of comparative neurology.

[64]  W. Cowan,et al.  A stereotaxic atlas of the brain of the cynomolgus monkey (Macaca fascicularis) , 1984, The Journal of comparative neurology.

[65]  M. Delong,et al.  Activity of pallidal neurons during movement. , 1971, Journal of neurophysiology.

[66]  Wilfrid Rall,et al.  Theoretical significance of dendritic trees for neuronal input-output relations , 1964 .