Positive and negative modulation of motor response in primate superior colliculus by reward expectation.

Expectation of reward is crucial for goal-directed behavior of animals. However, little is known about how reward information is used in the brain at the time of action. We investigated this question by recording from single neurons in the macaque superior colliculus (SC) while the animal was performing a memory-guided saccade task with an asymmetrical reward schedule. The SC is an ideal structure to ask this question because it receives inputs from many brain areas including the prefrontal cortex and the basal ganglia where reward information is thought to be encoded and sends motor commands to the brain stem saccade generators. We found two groups of SC neurons that encoded reward information in the presaccadic period: positive reward-coding neurons that showed higher activity when reward was expected and negative reward-coding neurons that showed higher activity when reward was not expected. The positive reward-coding usually started even before a cue for target position was presented, whereas the negative reward-coding was largely restricted to the presaccadic period. The two kinds of reward-coding may be useful for the animal to select an appropriate behavior in a complex environment.

[1]  Christopher D. Carello,et al.  Manipulating Intent Evidence for a Causal Role of the Superior Colliculus in Target Selection , 2004, Neuron.

[2]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[3]  Okihide Hikosaka,et al.  Role of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement , 2002, The Journal of Neuroscience.

[4]  O. Hikosaka,et al.  Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus , 2003, The Journal of Neuroscience.

[5]  J Schlag,et al.  Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. , 2000, Journal of neurophysiology.

[6]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[7]  Denis Pélisson,et al.  Early head movements elicited by visual stimuli or collicular electrical stimulation in the cat , 2001, Vision Research.

[8]  O. Hikosaka,et al.  Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. , 2002, Journal of neurophysiology.

[9]  S. Tsujimoto,et al.  Neuronal activity representing temporal prediction of reward in the primate prefrontal cortex. , 2005, Journal of neurophysiology.

[10]  W T Newsome,et al.  Target selection for saccadic eye movements: direction-selective visual responses in the superior colliculus. , 2001, Journal of neurophysiology.

[11]  O. Hikosaka,et al.  Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque , 2006, The Journal of Neuroscience.

[12]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[13]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[14]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[15]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. 3. Cells discharging before eye movements. , 1972, Journal of neurophysiology.

[16]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[17]  P Redgrave,et al.  Movements resembling orientation or avoidance elicited by electrical stimulation of the superior colliculus in rats , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[19]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[20]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[21]  A. Hariri,et al.  Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity , 2006, The Journal of Neuroscience.

[22]  J. Yeomans,et al.  An uncrossed tectopontine pathway mediates ipsiversive circling , 1993, Behavioural Brain Research.

[23]  K. Johnston,et al.  Monkey Dorsolateral Prefrontal Cortex Sends Task-Selective Signals Directly to the Superior Colliculus , 2006, The Journal of Neuroscience.

[24]  T. Robbins,et al.  Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice , 2004, The Journal of Neuroscience.

[25]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[26]  Y Shinoda,et al.  Physiological characterization of synaptic inputs to inhibitory burst neurons from the rostral and caudal superior colliculus. , 2005, Journal of neurophysiology.

[27]  Okihide Hikosaka,et al.  Functional differences between macaque prefrontal cortex and caudate nucleus during eye movements with and without reward , 2006, Experimental Brain Research.

[28]  E. Keller,et al.  Colliculoreticular organization in primate oculomotor system. , 1977, Journal of neurophysiology.

[29]  O. Hikosaka,et al.  Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task , 2002, The Journal of Neuroscience.

[30]  K. Campbell,et al.  A neural correlate of response bias in monkey caudate nucleus , 2022 .

[31]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[32]  D. Munoz,et al.  Saccadic Probability Influences Motor Preparation Signals and Time to Saccadic Initiation , 1998, The Journal of Neuroscience.

[33]  N. J. Gandhi,et al.  Spatial distribution and discharge characteristics of superior colliculus neurons antidromically activated from the omnipause region in monkey. , 1997, Journal of neurophysiology.

[34]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[35]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. II. Effect of attention on neuronal responses. , 1972, Journal of neurophysiology.

[36]  A. Berthoz,et al.  Reticulo-spinal neurons participating in the control of synergic eye and head movements during orienting in the cat , 1987, Experimental Brain Research.

[37]  L. Mays,et al.  Neurons During Saccades Accompanied by Vergence Discharge of Saccade-Related Superior Colliculus , 2003 .

[38]  D L Robinson,et al.  Covert orienting of attention in macaques. III. Contributions of the superior colliculus. , 1995, Journal of neurophysiology.

[39]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[40]  R. Krauzlis,et al.  Neural Correlates of Target Choice for Pursuit and Saccades in the Primate Superior Colliculus , 2002, Neuron.

[41]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[42]  Yoshikazu Shinoda,et al.  Synaptic Inputs and Their Pathways from Fixation and Saccade Zones of the Superior Colliculus to Inhibitory Burst Neurons and Pause Neurons , 2005, Annals of the New York Academy of Sciences.

[43]  R. Wurtz,et al.  Reversible inactivation of monkey superior colliculus. I. Curvature of saccadic trajectory. , 1998, Journal of neurophysiology.

[44]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[45]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[46]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[47]  Robert M. McPeek,et al.  Deficits in saccade target selection after inactivation of superior colliculus , 2004, Nature Neuroscience.

[48]  Etienne Olivier,et al.  Neck muscle responses to stimulation of monkey superior colliculus. I. Topography and manipulation of stimulation parameters. , 2002, Journal of neurophysiology.

[49]  R. Wurtz,et al.  Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells. , 1995, Journal of neurophysiology.

[50]  Etienne Olivier,et al.  Visual Responses on Neck Muscles Reveal Selective Gating that Prevents Express Saccades , 2004, Neuron.

[51]  W T Newsome,et al.  Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task. , 2001, Journal of neurophysiology.

[52]  O. Hikosaka,et al.  Saccade Parameters in Reward-Oriented Behavior Correlation of Primate Caudate Neural Activity and , 2003 .

[53]  P. Dean,et al.  Output pathways from the rat superior colliculus mediating approach and avoidance have different sensory properties , 2006, Experimental Brain Research.

[54]  H Shimazu,et al.  Monosynaptic activation of medium-lead burst neurons from the superior colliculus in the alert cat. , 1996, Journal of neurophysiology.

[55]  D L Sparks,et al.  Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. , 1986, Physiological reviews.

[56]  Michael L. Platt,et al.  Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques , 2005, Current Biology.

[57]  E. Keller,et al.  Saccade target selection in the superior colliculus during a visual search task. , 2002, Journal of neurophysiology.

[58]  R. Wurtz,et al.  Modification of saccadic eye movements by GABA-related substances. I. Effect of muscimol and bicuculline in monkey superior colliculus. , 1985, Journal of neurophysiology.

[59]  D. Sparks,et al.  Size and distribution of movement fields in the monkey superior colliculus , 1976, Brain Research.

[60]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[61]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.