Visual–Motor Transformations Within Frontal Eye Fields During Head-Unrestrained Gaze Shifts in the Monkey

A fundamental question in sensorimotor control concerns the transformation of spatial signals from the retina into eye and head motor commands required for accurate gaze shifts. Here, we investigated these transformations by identifying the spatial codes embedded in visually evoked and movement-related responses in the frontal eye fields (FEFs) during head-unrestrained gaze shifts. Monkeys made delayed gaze shifts to the remembered location of briefly presented visual stimuli, with delay serving to dissociate visual and movement responses. A statistical analysis of nonparametric model fits to response field data from 57 neurons (38 with visual and 49 with movement activities) eliminated most effector-specific, head-fixed, and space-fixed models, but confirmed the dominance of eye-centered codes observed in head-restrained studies. More importantly, the visual response encoded target location, whereas the movement response mainly encoded the final position of the imminent gaze shift (including gaze errors). This spatiotemporal distinction between target and gaze coding was present not only at the population level, but even at the single-cell level. We propose that an imperfect visual–motor transformation occurs during the brief memory interval between perception and action, and further transformations from the FEF's eye-centered gaze motor code to effector-specific codes in motor frames occur downstream in the subcortical areas.

[1]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[2]  M. Segraves,et al.  Muscimol-induced inactivation of monkey frontal eye field: effects on visually and memory-guided saccades. , 1999, Journal of neurophysiology.

[3]  Shintaro Funahashi,et al.  Space representation in the prefrontal cortex , 2013, Progress in Neurobiology.

[4]  N. J. Gandhi,et al.  Motor functions of the superior colliculus. , 2011, Annual review of neuroscience.

[5]  J. L. Conway,et al.  Effects of frontal eye field and superior colliculus ablations on eye movements. , 1979, Science.

[6]  D. Guitton,et al.  Brain stem omnipause neurons and the control of combined eye-head gaze saccades in the alert cat. , 1998, Journal of neurophysiology.

[7]  R. Wurtz,et al.  Composition and topographic organization of signals sent from the frontal eye field to the superior colliculus. , 2000, Journal of neurophysiology.

[8]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. II. Behavioral modulation. , 1999, Journal of neurophysiology.

[9]  L Longtang Chen,et al.  Head movements evoked by electrical stimulation in the frontal eye field of the monkey: evidence for independent eye and head control. , 2006, Journal of neurophysiology.

[10]  C. Bruce,et al.  Frontal eye field efferents in the macaque monkey: II. Topography of terminal fields in midbrain and pons , 1988, The Journal of comparative neurology.

[11]  Jeffrey D Schall,et al.  Macrocircuits: Decision Networks This Review Comes from a Themed Issue on Macrocircuits Decide That — Categorization and Stimulus Selection , 2022 .

[12]  R. Andersen,et al.  Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. , 1996, Journal of neurophysiology.

[13]  Eliana M. Klier,et al.  The superior colliculus encodes gaze commands in retinal coordinates , 2001, Nature Neuroscience.

[14]  G. B. Stanton,et al.  Cytoarchitectural characteristic of the frontal eye fields in macaque monkeys , 1989, The Journal of comparative neurology.

[15]  D Tweed,et al.  Implications of rotational kinematics for the oculomotor system in three dimensions. , 1987, Journal of neurophysiology.

[16]  J. Bullier,et al.  Topography of visual cortex connections with frontal eye field in macaque: convergence and segregation of processing streams , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  W Pieter Medendorp,et al.  Three-dimensional transformations for goal-directed action. , 2011, Annual review of neuroscience.

[18]  M. Goldberg,et al.  Activity of neurons in the lateral intraparietal area of the monkey during an antisaccade task , 1999, Nature Neuroscience.

[19]  S. Funahashi,et al.  Population vector analysis of primate prefrontal activity during spatial working memory. , 2004, Cerebral cortex.

[20]  M. Schlag-Rey,et al.  How the frontal eye field can impose a saccade goal on superior colliculus neurons. , 1992, Journal of neurophysiology.

[21]  New functions for an old structure: superior colliculus and head-only movements. Focus on "the role of primate superior colliculus in the control of head movements". , 2007, Journal of neurophysiology.

[22]  L. Snyder Coordinate transformations for eye and arm movements in the brain , 2000, Current Opinion in Neurobiology.

[23]  Vincent P Ferrera,et al.  Computing vector differences using a gain field‐like mechanism in monkey frontal eye field , 2007, The Journal of physiology.

[24]  R. Wurtz,et al.  Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells. , 1995, Journal of neurophysiology.

[25]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[26]  E G Keating,et al.  Electrical stimulation of the frontal eye field in a monkey produces combined eye and head movements. , 2000, Journal of neurophysiology.

[27]  Xiaogang Yan,et al.  Neural mechanisms for predictive head movement strategies during sequential gaze shifts. , 2012, Journal of neurophysiology.

[28]  D. Munoz,et al.  Look away: the anti-saccade task and the voluntary control of eye movement , 2004, Nature Reviews Neuroscience.

[29]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[30]  G. S. Russo,et al.  Neurons in the supplementary eye field of rhesus monkeys code visual targets and saccadic eye movements in an oculocentric coordinate system. , 1996, Journal of neurophysiology.

[31]  Julio C. Martinez-Trujillo,et al.  Frames of Reference for Eye-Head Gaze Commands in Primate Supplementary Eye Fields , 2004, Neuron.

[32]  D. Sparks,et al.  Eye-head coordination during head-unrestrained gaze shifts in rhesus monkeys. , 1997, Journal of neurophysiology.

[33]  C. Bruce,et al.  Topography of projections to posterior cortical areas from the macaque frontal eye fields , 1995, The Journal of comparative neurology.

[34]  J. Douglas Crawford,et al.  A method for mapping response fields and determining intrinsic reference frames of single-unit activity: Applied to 3D head-unrestrained gaze shifts , 2009, Journal of Neuroscience Methods.

[35]  J. Douglas Crawford,et al.  Neural Activity in Superior Parietal Cortex during Rule-based Visual-motor Transformations , 2013, Journal of Cognitive Neuroscience.

[36]  D Guitton,et al.  Analysis of primate IBN spike trains using system identification techniques. I. Relationship To eye movement dynamics during head-fixed saccades. , 1997, Journal of neurophysiology.

[37]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. I. Effects of training. , 1999, Journal of neurophysiology.

[38]  E. J. Tehovnik,et al.  Eye fields in the frontal lobes of primates , 2000, Brain Research Reviews.

[39]  R. Wurtz,et al.  Progression in neuronal processing for saccadic eye movements from parietal cortex area lip to superior colliculus. , 2001, Journal of neurophysiology.

[40]  T. Vilis,et al.  Remapping the remembered target location for anti-saccades in human posterior parietal cortex. , 2005, Journal of neurophysiology.

[41]  S. Funahashi,et al.  Thalamic mediodorsal nucleus and working memory , 2012, Neuroscience & Biobehavioral Reviews.

[42]  P. Goldman-Rakic,et al.  Neuronal activity related to saccadic eye movements in the monkey's dorsolateral prefrontal cortex. , 1991, Journal of neurophysiology.

[43]  M. Barinaga Life-Death Balance Within the Cell , 1996, Science.

[44]  L. Optican,et al.  Model of the control of saccades by superior colliculus and cerebellum. , 1999, Journal of neurophysiology.

[45]  D Guitton,et al.  Visual-motor transformations required for accurate and kinematically correct saccades. , 1997, Journal of neurophysiology.

[46]  Jeffrey D. Schall,et al.  CONCURRENT, DISTRIBUTED CONTROL OF SACCADE INITIATION IN THE FRONTAL EYE FIELD AND SUPERIOR COLLICULUS , 2003 .

[47]  Yale E. Cohen,et al.  A common reference frame for movement plans in the posterior parietal cortex , 2002, Nature Reviews Neuroscience.

[48]  David L. Sparks,et al.  Systematic errors for saccades to remembered targets: Evidence for a dissociation between saccade metrics and activity in the superior colliculus , 1994, Vision Research.

[49]  Hongying Wang,et al.  Interstitial nucleus of cajal encodes three-dimensional head orientations in Fick-like coordinates. , 2007, Journal of neurophysiology.

[50]  M. Schlag-Rey,et al.  Evidence for a supplementary eye field. , 1987, Journal of neurophysiology.

[51]  S. Hutton Cognitive control of saccadic eye movements , 2008, Brain and Cognition.

[52]  M. Segraves,et al.  Acute activation and inactivation of macaque frontal eye field with GABA-related drugs. , 1995, Journal of neurophysiology.

[53]  Tutis Vilis,et al.  Human parietal "reach region" primarily encodes intrinsic visual direction, not extrinsic movement direction, in a visual motor dissociation task. , 2007, Cerebral cortex.

[54]  D. Guitton,et al.  Three-dimensional eye-head coordination during gaze saccades in the primate. , 1999, Journal of neurophysiology.

[55]  D Guitton,et al.  Analysis of primate IBN spike trains using system identification techniques. III. Relationship To motor error during head-fixed saccades and head-free gaze shifts. , 1997, Journal of neurophysiology.

[56]  Jeffrey D Schall,et al.  Functional distinction between visuomovement and movement neurons in macaque frontal eye field during saccade countermanding. , 2009, Journal of neurophysiology.

[57]  Frame-up. Focus on "eye-centered, head-centered, and complex coding of visual and auditory targets in the intraparietal sulcus". , 2005, Journal of neurophysiology.

[58]  D L Sparks,et al.  Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. , 1986, Physiological reviews.

[59]  D. Sparks,et al.  Dissociation of visual and saccade-related responses in superior colliculus neurons. , 1980, Journal of neurophysiology.

[60]  Richard A. Andersen,et al.  Sensorimotor transformation during eye movements to remembered visual targets , 1991, Vision Research.

[61]  Emilio Bizzi,et al.  Discharge of frontal eye field neurons during saccadic and following eye movements in unanesthetized monkeys , 1968, Experimental Brain Research.

[62]  Gunnar Blohm,et al.  Decoding the cortical transformations for visually guided reaching in 3D space. , 2009, Cerebral cortex.

[63]  Jeffrey D. Schall,et al.  The detection of visual signals by macaque frontal eye field during masking , 1999, Nature Neuroscience.

[64]  T Vilis,et al.  Violations of Listing's law after large eye and head gaze shifts. , 1992, Journal of neurophysiology.

[65]  David L. Sparks,et al.  Saccades to remembered target locations: an analysis of systematic and variable errors , 1994, Vision Research.

[66]  P. Thier,et al.  Eye position information is used to compensate the consequences of ocular torsion on V1 receptive fields , 2014, Nature Communications.

[67]  R. Wurtz,et al.  Signal transformations from cerebral cortex to superior colliculus for the generation of saccades , 2001, Vision Research.

[68]  Stefan Everling,et al.  Cortical activation associated with midtrial change of instruction in a saccade task , 2002, Experimental Brain Research.

[69]  R. Wurtz,et al.  What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamus. , 2004, Journal of neurophysiology.

[70]  M. Schlag-Rey,et al.  The frontal eye field provides the goal of saccadic eye movement , 2004, Experimental Brain Research.

[71]  M. Segraves Activity of monkey frontal eye field neurons projecting to oculomotor regions of the pons. , 1992, Journal of neurophysiology.

[72]  Michael A Smith,et al.  Distributed population mechanism for the 3-D oculomotor reference frame transformation. , 2005, Journal of neurophysiology.

[73]  C. Curtis,et al.  Common neural mechanisms supporting spatial working memory, attention and motor intention , 2011, Neuropsychologia.

[74]  Richard A. Andersen,et al.  Coordinate transformations in the representation of spatial information , 1993, Current Opinion in Neurobiology.

[75]  A. Fuchs,et al.  Eye movements evoked by stimulation of frontal eye fields. , 1969, Journal of neurophysiology.

[76]  A. Opstal,et al.  Monkey Superior Colliculus Activity During Short-Term Saccadic Adaptation , 1997, Brain Research Bulletin.

[77]  N. P. Bichot,et al.  A visual salience map in the primate frontal eye field. , 2005, Progress in brain research.

[78]  G. Muehllehner,et al.  Positron emission tomography , 2006, Physics in medicine and biology.

[79]  Brian D Corneil,et al.  Widespread presaccadic recruitment of neck muscles by stimulation of the primate frontal eye fields. , 2007, Journal of neurophysiology.

[80]  Y. Cohen,et al.  Eye-centered, head-centered, and complex coding of visual and auditory targets in the intraparietal sulcus. , 2005, Journal of neurophysiology.

[81]  Richard P. Heitz,et al.  Biophysical support for functionally distinct cell types in the frontal eye field. , 2009, Journal of neurophysiology.

[82]  Hongying Wang,et al.  Three-dimensional eye-head coordination is implemented downstream from the superior colliculus. , 2003, Journal of neurophysiology.

[83]  J. F. Soechting,et al.  Early stages in a sensorimotor transformation , 1992, Behavioral and Brain Sciences.

[84]  G. S. Russo,et al.  Frontal eye field activity preceding aurally guided saccades. , 1994, Journal of neurophysiology.

[85]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[86]  M. Mintun,et al.  Positron emission tomography study of voluntary saccadic eye movements and spatial working memory. , 1996, Journal of neurophysiology.

[87]  R. Wurtz,et al.  Saccade-related activity in monkey superior colliculus. II. Spread of activity during saccades. , 1995, Journal of neurophysiology.

[88]  A. Pouget,et al.  Reference frames for representing visual and tactile locations in parietal cortex , 2005, Nature Neuroscience.

[89]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[90]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[91]  Jeffrey D. Schall,et al.  Supplementary Eye Field during Visual Search: Salience, Cognitive Control, and Performance Monitoring , 2012, The Journal of Neuroscience.

[92]  C. Bruce,et al.  Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements. , 1985, Journal of neurophysiology.

[93]  D P Munoz,et al.  Role of Primate Superior Colliculus in Preparation and Execution of Anti-Saccades and Pro-Saccades , 1999, The Journal of Neuroscience.

[94]  Michele A. Basso,et al.  Modulation of neuronal activity by target uncertainty , 1997, Nature.

[95]  Tadashi Isa,et al.  Brainstem control of head movements during orienting; organization of the premotor circuits , 2002, Progress in Neurobiology.

[96]  Thérèse Collins,et al.  Visual versus motor vector inversions in the antisaccade task: a behavioral investigation with saccadic adaptation. , 2008, Journal of neurophysiology.

[97]  M. Goldberg,et al.  Effect of short-term saccadic adaptation on saccades evoked by electrical stimulation in the primate superior colliculus. , 2002, Journal of neurophysiology.

[98]  P. Goldman-Rakic,et al.  Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task , 1993, Nature.

[99]  D. Hoffman,et al.  Sensorimotor transformations in cortical motor areas , 2003, Neuroscience Research.

[100]  Emilio Bizzi,et al.  Single unit activity in the frontal eye fields of unanesthetized monkeys during eye and head movement , 2004, Experimental Brain Research.

[101]  C R Olson,et al.  Object-centered direction selectivity in the macaque supplementary eye field , 1995, Science.

[102]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[103]  D. Guitton,et al.  Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. , 1987, Journal of neurophysiology.

[104]  Hongying Wang,et al.  Role of superior colliculus in adaptive eye-head coordination during gaze shifts. , 2004, Journal of neurophysiology.

[105]  Tirin Moore,et al.  Dissociation of Response Variability from Firing Rate Effects in Frontal Eye Field Neurons during Visual Stimulation, Working Memory, and Attention , 2012, The Journal of Neuroscience.

[106]  M. Goldberg,et al.  Oculocentric spatial representation in parietal cortex. , 1995, Cerebral cortex.

[107]  R. Wurtz,et al.  Visual receptive fields of frontal eye field neurons. , 1973, Brain research.

[108]  Takashi R Sato,et al.  Effects of Stimulus-Response Compatibility on Neural Selection in Frontal Eye Field , 2003, Neuron.

[109]  D. Guitton,et al.  Gaze-related activity of brainstem omnipause neurons during combined eye-head gaze shifts in the alert cat , 2004, Experimental Brain Research.

[110]  Paul W. Glimcher,et al.  Response fields of intraparietal neurons quantified with multiple saccadic targets , 1998, Experimental Brain Research.

[111]  Julio Martinez-Trujillo,et al.  Electrical stimulation of the frontal eye fields in the head-free macaque evokes kinematically normal 3D gaze shifts. , 2010, Journal of neurophysiology.

[112]  D P Munoz,et al.  Neuronal Correlates for Preparatory Set Associated with Pro-Saccades and Anti-Saccades in the Primate Frontal Eye Field , 2000, The Journal of Neuroscience.

[113]  Gunnar Blohm,et al.  Intrinsic Reference Frames of Superior Colliculus Visuomotor Receptive Fields during Head-Unrestrained Gaze Shifts , 2011, The Journal of Neuroscience.

[114]  Ken-ichi Amemori,et al.  Rule‐dependent shifting of sensorimotor representation in the primate prefrontal cortex , 2006, The European journal of neuroscience.

[115]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[116]  Hongying Wang,et al.  Frames of reference for eye–head gaze shifts evoked during frontal eye field stimulation , 2013, The European journal of neuroscience.

[117]  Beng Hong. Goh,et al.  Effects of training. , 2001 .

[118]  D L Sparks,et al.  Activity of cells in the deeper layers of the superior colliculus of the rhesus monkey: evidence for a gaze displacement command. , 1997, Journal of neurophysiology.

[119]  Gwen Shaffer Frame-Up , 2007 .

[120]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[121]  D. Sparks The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.

[122]  Mingsha Zhang,et al.  Neuronal switching of sensorimotor transformations for antisaccades , 2000, Nature.

[123]  Stefan Everling,et al.  Frontoparietal activation with preparation for antisaccades. , 2007, Journal of neurophysiology.

[124]  W. C. Hall,et al.  The Superior Colliculus : New Approaches for Studying Sensorimotor Integration , 2003 .

[125]  Neeraj J Gandhi,et al.  Role of the primate superior colliculus in the control of head movements. , 2007, Journal of neurophysiology.

[126]  M. Sahani,et al.  Cortical control of arm movements: a dynamical systems perspective. , 2013, Annual review of neuroscience.

[127]  Michael E Goldberg,et al.  The lateral intraparietal area codes the location of saccade targets and not the dimension of the saccades that will be made to acquire them. , 2013, Journal of neurophysiology.

[128]  Albert F Fuchs,et al.  Contribution of the frontal eye field to gaze shifts in the head-unrestrained monkey: effects of microstimulation. , 2007, Journal of neurophysiology.

[129]  T. A. Knight,et al.  Contribution of the frontal eye field to gaze shifts in the head-unrestrained rhesus monkey: Neuronal activity , 2012, Neuroscience.

[130]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[131]  G. Mandl,et al.  Frontal ‘oculomotor’ area in alert cat. I. Eye movements and neck activity evoked by stimulation , 1978, Brain Research.

[132]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[133]  R. Andersen,et al.  The influence of the angle of gaze upon the excitability of the light- sensitive neurons of the posterior parietal cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[134]  D. Guitton,et al.  Control of eye—head coordination during orienting gaze shifts , 1992, Trends in Neurosciences.

[135]  D. Ferrier The Functions of the Brain , 1887, Edinburgh Medical Journal.

[136]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.