Encoding of Reward and Decoding Movement from the Frontal Eye Field during Smooth Pursuit Eye Movements

Expectation of reward potentiates sensorimotor transformations to drive vigorous movements. One of the main challenges in studying reward is to determine how representations of reward interact with the computations that drive behavior. We recorded activity in smooth pursuit neurons in the frontal eye field (FEF) of two male rhesus monkeys while controlling the eye speed by manipulating either reward size or target speed. The neurons encoded the different reward conditions more strongly than the different target speed conditions. This pattern could not be explained by differences in the eye speed, since the eye speed sensitivity of the neurons was also larger for the reward conditions. Pooling the responses by the preferred direction of the neurons attenuated the reward modulation and led to a tighter association between neural activity and behavior. Therefore, a plausible decoder such as the population vector could explain how the FEF both drives behavior and encodes reward beyond behavior. SIGNIFICANCE STATEMENT Motor areas combine sensory and reward information to drive movement. To disambiguate these sources, we manipulated the speed of smooth pursuit eye movements by controlling either the size of the reward or the speed of the visual motion signals. We found that the relationship between activity in frontal eye field and eye kinematics varied: the eye speed sensitivity was larger for the different reward conditions than for the different target speed conditions. Decoders that pooled signals by the preferred direction of the neurons attenuated the reward modulations. These decoders may indicate how reward can be both encoded beyond eye kinematics at the single neuron level and drive movement at the population level.

[1]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[2]  B. Hayden,et al.  Neurons in Anterior Cingulate Cortex Multiplex Information about Reward and Action , 2010, The Journal of Neuroscience.

[3]  Christian K. Machens,et al.  Demixing Population Activity in Higher Cortical Areas , 2009, Front. Comput. Neurosci..

[4]  Stephen J. Gotts,et al.  Cell-Type-Specific Synchronization of Neural Activity in FEF with V 4 during Attention , 2022 .

[5]  J. L. Gordon,et al.  A model of the smooth pursuit eye movement system , 1986, Biological Cybernetics.

[6]  P. van Donkelaar,et al.  Spatiotemporal modulation of attention during smooth pursuit eye movements. , 1999, Neuroreport.

[7]  Stephen G Lisberger,et al.  A framework for using signal, noise, and variation to determine whether the brain controls movement synergies or single muscles. , 2014, Journal of neurophysiology.

[8]  D A Robinson,et al.  The use of control systems analysis in the neurophysiology of eye movements. , 1981, Annual review of neuroscience.

[9]  Stephen G Lisberger,et al.  Directional Cuing of Target Choice in Human Smooth Pursuit Eye Movements , 2006, The Journal of Neuroscience.

[10]  Richard J. Krauzlis,et al.  Spatial allocation of attention during smooth pursuit eye movements , 2009, Vision Research.

[11]  L. Luo,et al.  Cerebellar granule cells encode the expectation of reward , 2017, Nature.

[12]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[13]  Daeyeol Lee,et al.  Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain , 2011, Neuron.

[14]  T. Albright Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[15]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[16]  Stephen G. Lisberger,et al.  The Interaction of Bayesian Priors and Sensory Data and Its Neural Circuit Implementation in Visually Guided Movement , 2012, The Journal of Neuroscience.

[17]  F A Miles,et al.  Role of the oculomotor vermis in generating pursuit and saccades: effects of microstimulation. , 1998, Journal of neurophysiology.

[18]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[19]  Stephen G Lisberger,et al.  Visual Guidance of Smooth-Pursuit Eye Movements: Sensation, Action, and What Happens in Between , 2010, Neuron.

[20]  E. Vaadia,et al.  Midbrain Dopaminergic Neurons and Striatal Cholinergic Interneurons Encode the Difference between Reward and Aversive Events at Different Epochs of Probabilistic Classical Conditioning Trials , 2008, The Journal of Neuroscience.

[21]  M. Joshua,et al.  Dissecting patterns of preparatory activity in the frontal eye fields during pursuit target selection. , 2017, Journal of neurophysiology.

[22]  Genela Morris,et al.  Spatial Rule Learning and Corresponding CA1 Place Cell Reorientation Depend on Local Dopamine Release , 2018, Current Biology.

[23]  C. Bruce,et al.  Neural responses related to smooth-pursuit eye movements and their correspondence with electrically elicited smooth eye movements in the primate frontal eye field. , 1994, Journal of neurophysiology.

[24]  Konrad Paul Kording,et al.  Role of expected reward in frontal eye field during natural scene search. , 2016, Journal of neurophysiology.

[25]  Paul van Donkelaar,et al.  Spatiotemporal modulation of attention during smooth pursuit eye movements. , 1999 .

[26]  M. Roesch,et al.  Neuronal activity dependent on anticipated and elapsed delay in macaque prefrontal cortex, frontal and supplementary eye fields, and premotor cortex. , 2005, Journal of neurophysiology.

[27]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[28]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[29]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[30]  Stephen G. Lisberger,et al.  Regulation of the gain of visually guided smooth-pursuit eye movements by frontal cortex , 2001, Nature.

[31]  R. Krauzlis Recasting the smooth pursuit eye movement system. , 2004, Journal of neurophysiology.

[32]  C. Rashbass,et al.  The relationship between saccadic and smooth tracking eye movements , 1961, The Journal of physiology.

[33]  T Moore,et al.  Control of eye movements and spatial attention. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Emilio Bizzi,et al.  Discharge of frontal eye field neurons during saccadic and following eye movements in unanesthetized monkeys , 1968, Experimental Brain Research.

[35]  A. Fuchs,et al.  Role of primate flocculus during rapid behavioral modification of vestibuloocular reflex. I. Purkinje cell activity during visually guided horizontal smooth-pursuit eye movements and passive head rotation. , 1978, Journal of neurophysiology.

[36]  W. Bialek,et al.  The Neural Basis for Combinatorial Coding in a Cortical Population Response , 2008, The Journal of Neuroscience.

[37]  T. Moore,et al.  CONTROL OF VISUAL CORTICAL SIGNALS BY PREFRONTAL DOPAMINE , 2011, Nature.

[38]  O. Hikosaka,et al.  Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque , 2006, The Journal of Neuroscience.

[39]  C. Bruce,et al.  Smooth eye movements elicited by microstimulation in the primate frontal eye field. , 1993, Journal of neurophysiology.

[40]  Stephen G Lisberger,et al.  Reward Action in the Initiation of Smooth Pursuit Eye Movements , 2012, The Journal of Neuroscience.

[41]  Junying Yuan,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2022 .

[42]  W T Newsome,et al.  How Is a Sensory Map Read Out? Effects of Microstimulation in Visual Area MT on Saccades and Smooth Pursuit Eye Movements , 1997, The Journal of Neuroscience.

[43]  D. Sparks The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.

[44]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[45]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[46]  M. Tanaka,et al.  Neuronal responses related to smooth pursuit eye movements in the periarcuate cortical area of monkeys. , 1998, Journal of neurophysiology.

[47]  Takashi R Sato,et al.  Neuronal Basis of Covert Spatial Attention in the Frontal Eye Field , 2005, The Journal of Neuroscience.

[48]  S G Lisberger,et al.  Vector Averaging for Smooth Pursuit Eye Movements Initiated by Two Moving Targets in Monkeys , 1997, The Journal of Neuroscience.

[49]  Robert A. Wilson I, Primate , 2002 .

[50]  Stephen J. Gotts,et al.  Cell-Type-Specific Synchronization of Neural Activity in FEF with V4 during Attention , 2012, Neuron.

[51]  Miriam Spering,et al.  Similar Effects of Feature-Based Attention on Motion Perception and Pursuit Eye Movements at Different Levels of Awareness , 2012, The Journal of Neuroscience.

[52]  Stephen G Lisberger,et al.  Diversity of Neural Responses in the Brainstem during Smooth Pursuit Eye Movements Constrains the Circuit Mechanisms of Neural Integration , 2013, The Journal of Neuroscience.

[53]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[54]  Karolina M. Lempert,et al.  Modulation of Saccade Vigor during Value-Based Decision Making , 2015, The Journal of Neuroscience.

[55]  S G Lisberger,et al.  Responses during eye movements of brain stem neurons that receive monosynaptic inhibition from the flocculus and ventral paraflocculus in monkeys. , 1994, Journal of neurophysiology.

[56]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[57]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[58]  Seiji Ono,et al.  Smooth Pursuit–Related Information Processing in Frontal Eye Field Neurons that Project to the NRTP , 2008, Cerebral cortex.