Reward Action in the Initiation of Smooth Pursuit Eye Movements

Reward has a powerful influence on motor behavior. To probe how and where reward systems alter motor behavior, we studied smooth pursuit eye movements in monkeys trained to associate the color of a visual cue with the size of the reward to be issued at the end of the target motion. When the tracking task presented two different colored targets that moved orthogonally, monkeys biased the initiation of pursuit toward the direction of motion of the target that led to larger reward. The bias was larger than expected given the modest effects of reward size on tracking of single targets. Experiments with three different reward sizes suggested that the bias afforded a given target depends mainly on the size of the larger reward. To analyze the effect of reward on directional learning in pursuit, monkeys tracked a single moving target that changed direction 250 ms after the onset of motion. Expectation of a larger reward led to a larger learned eye movement during the acquisition of the learned response and during subsequent probes of what had been learned, implying that reward influenced the expression rather than the acquisition of learning. The specific effects of reward size on learning and two-target stimuli imply that the site of reward modulation is at a level where multiple target motions compete for control of eye movement, downstream from sensory processing and learning and upstream from final motor processing.

[1]  S. Lisberger,et al.  Attention and target selection for smooth pursuit eye movements , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  S. Lisberger,et al.  Sensory versus motor loci for integration of multiple motion signals in smooth pursuit eye movements and human motion perception. , 2011, Journal of neurophysiology.

[3]  J. Lynch,et al.  Pursuit subregion of the frontal eye field projects to the caudate nucleus in monkeys. , 2003, Journal of neurophysiology.

[4]  E. Vaadia,et al.  Independent Coding of Movement Direction and Reward Prediction by Single Pallidal Neurons , 2004, The Journal of Neuroscience.

[5]  H. Blodgett,et al.  The effect of the introduction of reward upon the maze performance of rats , 1929 .

[6]  Richard J Krauzlis,et al.  Inactivation and stimulation of the frontal pursuit area change pursuit metrics without affecting pursuit target selection. , 2011, Journal of neurophysiology.

[7]  Katherine I. Nagel,et al.  Cortical Mechanisms of Smooth Eye Movements Revealed by Dynamic Covariations of Neural and Behavioral Responses , 2008, Neuron.

[8]  S G Lisberger,et al.  Neuronal responses in visual areas MT and MST during smooth pursuit target selection. , 1997, Journal of neurophysiology.

[9]  Kikuro Fukushima,et al.  Memory and Decision Making in the Frontal Cortex during Visual Motion Processing for Smooth Pursuit Eye Movements , 2009, Neuron.

[10]  Alan C. Evans,et al.  Functional neuroanatomy of smooth pursuit and predictive saccades , 2000, Neuroreport.

[11]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[12]  M. Tanaka,et al.  Neuronal responses related to smooth pursuit eye movements in the periarcuate cortical area of monkeys. , 1998, Journal of neurophysiology.

[13]  Maninder K. Kahlon,et al.  Vector Averaging Occurs Downstream from Learning in Smooth Pursuit Eye Movements of Monkeys , 1999, The Journal of Neuroscience.

[14]  W. Newsome,et al.  Deficits in visual motion processing following ibotenic acid lesions of the middle temporal visual area of the macaque monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Stephen G. Lisberger,et al.  The Representation of Time for Motor Learning , 2005, Neuron.

[16]  O. Hikosaka,et al.  Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque , 2006, The Journal of Neuroscience.

[17]  S G Lisberger,et al.  Vector Averaging for Smooth Pursuit Eye Movements Initiated by Two Moving Targets in Monkeys , 1997, The Journal of Neuroscience.

[18]  C. Bruce,et al.  Neural responses related to smooth-pursuit eye movements and their correspondence with electrically elicited smooth eye movements in the primate frontal eye field. , 1994, Journal of neurophysiology.

[19]  R. Krauzlis,et al.  Neural activity in the frontal pursuit area does not underlie pursuit target selection , 2011, Vision Research.

[20]  V. Ferrera Task-dependent modulation of the sensorimotor transformation for smooth pursuit eye movements. , 2000, Journal of neurophysiology.

[21]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[22]  W T Newsome,et al.  How Is a Sensory Map Read Out? Effects of Microstimulation in Visual Area MT on Saccades and Smooth Pursuit Eye Movements , 1997, The Journal of Neuroscience.

[23]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  S. Lisberger,et al.  Normal performance and expression of learning in the vestibulo-ocular reflex (VOR) at high frequencies. , 2005, Journal of neurophysiology.

[25]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[26]  E. Vaadia,et al.  Midbrain Dopaminergic Neurons and Striatal Cholinergic Interneurons Encode the Difference between Reward and Aversive Events at Different Epochs of Probabilistic Classical Conditioning Trials , 2008, The Journal of Neuroscience.

[27]  Stephen G Lisberger,et al.  Learning on multiple timescales in smooth pursuit eye movements. , 2010, Journal of neurophysiology.

[28]  Richard J Krauzlis,et al.  Superior Colliculus Inactivation Alters the Weighted Integration of Visual Stimuli , 2011, The Journal of Neuroscience.

[29]  Stephen G. Lisberger,et al.  Learned Timing of Motor Behavior in the Smooth Eye Movement Region of the Frontal Eye Fields , 2011, Neuron.

[30]  Stephen G. Lisberger,et al.  Regulation of the gain of visually guided smooth-pursuit eye movements by frontal cortex , 2001, Nature.

[31]  S. Lisberger,et al.  Role of arcuate frontal cortex of monkeys in smooth pursuit eye movements. I. Basic response properties to retinal image motion and position. , 2002, Journal of neurophysiology.

[32]  Jennifer J. Pokorny,et al.  Activity of substantia nigra pars reticulata neurons during smooth pursuit eye movements in monkeys , 2005, The European journal of neuroscience.

[33]  Megan R. Carey,et al.  Instructive signals for motor learning from visual cortical area MT , 2005, Nature Neuroscience.

[34]  Naoshige Uchida,et al.  Odor Representations in Olfactory Cortex: Distributed Rate Coding and Decorrelated Population Activity , 2012, Neuron.

[35]  J. Lynch,et al.  Subcortical Input to the Smooth and Saccadic Eye Movement Subregions of the Frontal Eye Field in Cebus Monkey , 1997, The Journal of Neuroscience.

[36]  Justin L. Gardner,et al.  Linked Target Selection for Saccadic and Smooth Pursuit Eye Movements , 2001, The Journal of Neuroscience.

[37]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[38]  Stephen G Lisberger,et al.  Directional Cuing of Target Choice in Human Smooth Pursuit Eye Movements , 2006, The Journal of Neuroscience.

[39]  Vincent P Ferrera,et al.  Coordination of smooth pursuit and saccade target selection in monkeys. , 2007, Journal of neurophysiology.

[40]  G H Recanzone,et al.  Shift in smooth pursuit initiation and MT and MST neuronal activity under different stimulus conditions. , 1999, Journal of neurophysiology.

[41]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[42]  Joonyeol Lee,et al.  Attentional Modulation of MT Neurons with Single or Multiple Stimuli in Their Receptive Fields , 2010, The Journal of Neuroscience.