Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement.

Recent studies have suggested that the basal ganglia are related to motivational control of behavior. To study how motivational signals modulate motor signals in the basal ganglia, we examined activity of midbrain dopamine (DA) neurons and caudate (CD) projection neurons while monkeys were performing a one-direction-rewarded version (1DR) of memory-guided saccade task. The cue stimulus indicated the goal position for an upcoming saccade and the presence or absence of reward after the trial. Among four monkeys we studied, three were sensitive to reward such that saccade velocity was significantly higher in the rewarded trials than in the nonrewarded trials; one monkey was insensitive to reward. In the reward-sensitive monkeys, both DA and CD neurons responded differentially to reward-indicating and no-reward-indicating cues. Thus DA neurons responded with excitation to a reward-indicating cue and with inhibition to a no-reward-indicating cue. A group of CD neurons responded to the cue in their response fields (mostly contralateral) and the cue response was usually enhanced when it indicated reward. In the reward-insensitive monkey, DA neurons showed no response to the cue, while the cue responses of CD neurons were not modulated by reward. Many CD neurons in the reward-sensitive monkeys, but not the reward-insensitive monkey, showed precue activity. These results suggest that DA neurons, with their connection to CD neurons, modulate the spatially selective signals in CD neurons in the reward-predicting manner and CD neurons in turn modulate saccade parameters with their polysynaptic connections to the oculomotor brain stem.

[1]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[2]  K. Fuxe,et al.  DEMONSTRATION AND MAPPING OUT OF NIGRO-NEOSTRIATAL DOPAMINE NEURONS. , 1964, Life sciences.

[3]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[4]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. , 1983, Journal of neurophysiology.

[5]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades. , 1983, Journal of neurophysiology.

[6]  Jérôme Yelnik,et al.  A histological atlas of the macaque (Macaca, mulatta) substantia nigra in ventricular coordinates , 1985, Brain Research Bulletin.

[7]  P. Goldman-Rakic,et al.  Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  W. Schultz,et al.  Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. , 1987, Journal of neurophysiology.

[9]  S. Siris,et al.  Implications of normal brain development for the pathogenesis of schizophrenia. , 1988, Archives of general psychiatry.

[10]  O Hikosaka,et al.  Functional properties of monkey caudate neurons. II. Visual and auditory responses. , 1989, Journal of neurophysiology.

[11]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. , 1989, Journal of neurophysiology.

[12]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[13]  J. Hedreen,et al.  Organization of striatopallidal, striatonigral, and nigrostriatal projections in the macaque , 1991, The Journal of comparative neurology.

[14]  D. Pandya,et al.  Prefrontostriatal connections in relation to cortical architectonic organization in rhesus monkeys , 1991, The Journal of comparative neurology.

[15]  A. Graybiel,et al.  Distributed but convergent ordering of corticostriatal projections: analysis of the frontal eye field and the supplementary eye field in the macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Okihide Hikosaka,et al.  Visual and oculomotor functions of monkey subthalamic nucleus. , 1992 .

[17]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[18]  A. Parent,et al.  Multiple striatal representation in primate substantia nigra , 1994, The Journal of comparative neurology.

[19]  Andrew G. Barto,et al.  Reinforcement learning control , 1994, Current Opinion in Neurobiology.

[20]  S. Haber,et al.  The organization of midbrain projections to the striatum in the primate: Sensorimotor-related striatum versus ventral striatum , 1994, Neuroscience.

[21]  A. Graybiel,et al.  Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. , 1994, Science.

[22]  O. Hikosaka,et al.  Visual hemineglect induced by unilateral striatal dopamine deficiency in monkeys. , 1995, Neuroreport.

[23]  JM Tepper,et al.  GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  O. Hikosaka,et al.  Eye movements in monkeys with local dopamine depletion in the caudate nucleus. II. Deficits in voluntary saccades , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[26]  O. Hikosaka,et al.  Eye movements in monkeys with local dopamine depletion in the caudate nucleus. I. Deficits in spontaneous saccades , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  A. Powers,et al.  An Explanation for Reflex Blink Hyperexcitability in Parkinson’s Disease. I. Superior Colliculus , 1996, The Journal of Neuroscience.

[28]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  M. A. Basso,et al.  An Explanation for Reflex Blink Hyperexcitability in Parkinson’s Disease. II. Nucleus Raphe Magnus , 1996, The Journal of Neuroscience.

[30]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[31]  R. Wise,et al.  The neurobiology of addiction , 2019, Annals of the New York Academy of Sciences.

[32]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[33]  J. Bargas,et al.  D1 Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca2+ Conductance , 1997, The Journal of Neuroscience.

[34]  P. Calabresi,et al.  The neostriatum beyond the motor function: experimental and clinical evidence. , 1997, Neuroscience.

[35]  J. Bargas,et al.  D 1 Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca 2 1 Conductance , 1997 .

[36]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[37]  D. Brooks,et al.  Evidence for striatal dopamine release during a video game , 1998, Nature.

[38]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[39]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[40]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[41]  J. Bargas,et al.  D2 Dopamine Receptors in Striatal Medium Spiny Neurons Reduce L-Type Ca2+ Currents and Excitability via a Novel PLCβ1–IP3–Calcineurin-Signaling Cascade , 2000, The Journal of Neuroscience.

[42]  R. Malenka,et al.  Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. , 2000, Annual review of neuroscience.

[43]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[44]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[45]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[46]  A. Graybiel,et al.  Neurons in the thalamic CM-Pf complex supply striatal neurons with information about behaviorally significant sensory events. , 2001, Journal of neurophysiology.

[47]  Michael E. Hasselmo,et al.  Faculty Opinions recommendation of A framework for mesencephalic dopamine systems based on predictive Hebbian learning. , 2001 .

[48]  Okihide Hikosaka,et al.  Role of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement , 2002, The Journal of Neuroscience.

[49]  Anthony A Grace,et al.  Opposite Influences of Endogenous Dopamine D1 and D2 Receptor Activation on Activity States and Electrophysiological Properties of Striatal Neurons: Studies CombiningIn Vivo Intracellular Recordings and Reverse Microdialysis , 2002, The Journal of Neuroscience.

[50]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[51]  O. Hikosaka,et al.  Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. , 2002, Journal of neurophysiology.

[52]  O. Hikosaka,et al.  Saccade Parameters in Reward-Oriented Behavior Correlation of Primate Caudate Neural Activity and , 2003 .

[53]  J. Yelnik,et al.  Topographic distribution of the axonal endings from the sensorimotor and associative striatum in the macaque pallidum and substantia nigra , 2004, Experimental Brain Research.

[54]  O. Hikosaka,et al.  Effects of caudate nucleus stimulation on substantia nigra cell activity in monkey , 2004, Experimental Brain Research.

[55]  K. Campbell,et al.  A neural correlate of response bias in monkey caudate nucleus , 2022 .