The Dorsal Visual System Predicts Future and Remembers Past Eye Position

Eye movements are essential to primate vision but introduce potentially disruptive displacements of the retinal image. To maintain stable vision, the brain is thought to rely on neurons that carry both visual signals and information about the current direction of gaze in their firing rates. We have shown previously that these neurons provide an accurate representation of eye position during fixation, but whether they are updated fast enough during saccadic eye movements to support real-time vision remains controversial. Here we show that not only do these neurons carry a fast and accurate eye-position signal, but also that they support in parallel a range of time-lagged variants, including predictive and post dictive signals. We recorded extracellular activity in four areas of the macaque dorsal visual cortex during a saccade task, including the lateral and ventral intraparietal areas (LIP, VIP), and the middle temporal (MT) and medial superior temporal (MST) areas. As reported previously, neurons showed tonic eye-position-related activity during fixation. In addition, they showed a variety of transient changes in activity around the time of saccades, including relative suppression, enhancement, and pre-saccadic bursts for one saccade direction over another. We show that a hypothetical neuron that pools this rich population activity through a weighted sum can produce an output that mimics the true spatiotemporal dynamics of the eye. Further, with different pooling weights, this downstream eye position signal (EPS) could be updated long before (<100 ms) or after (<200 ms) an eye movement. The results suggest a flexible coding scheme in which downstream computations have access to past, current, and future eye positions simultaneously, providing a basis for visual stability and delay-free visually-guided behavior.

[1]  C. Galletti,et al.  Eye Position Influence on the Parieto‐occipital Area PO (V6) of the Macaque Monkey , 1995, The European journal of neuroscience.

[2]  J Douglas Crawford,et al.  Cortical mechanisms for trans-saccadic memory and integration of multiple object features , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  S. Celebrini,et al.  Gaze direction controls response gain in primary visual-cortex neurons , 1999, Nature.

[4]  Christopher D Chambers,et al.  Parietal stimulation destabilizes spatial updating across saccadic eye movements , 2007, Proceedings of the National Academy of Sciences.

[5]  Frank Bremmer,et al.  Eye-Position Signals in the Dorsal Visual System Are Accurate and Precise on Short Timescales , 2013, The Journal of Neuroscience.

[6]  Bart Krekelberg,et al.  Postsaccadic visual references generate presaccadic compression of space , 2000, Nature.

[7]  Angel R. Martinez,et al.  Computational Statistics Handbook with MATLAB , 2001 .

[8]  C. Galletti,et al.  Gaze-dependent visual neurons in area V3A of monkey prestriate cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Patrick McCrae,et al.  A computational model for the influence of cross modal context upon syntactic parsing , 2010 .

[10]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[11]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.

[12]  R. Andersen,et al.  Saccade-related activity in the lateral intraparietal area. I. Temporal properties; comparison with area 7a. , 1991, Journal of neurophysiology.

[13]  Tobias Teichert,et al.  Perisaccadic mislocalization as optimal percept. , 2010, Journal of vision.

[14]  Arnulf B. A. Graf,et al.  Inferring eye position from populations of lateral intraparietal neurons , 2014, eLife.

[15]  Alexandre Pouget,et al.  Perceived geometrical relationships affected by eye-movement signals , 1997, Nature.

[16]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[17]  Marc A Sommer,et al.  Frontal Eye Field Neurons Assess Visual Stability Across Saccades , 2012, The Journal of Neuroscience.

[18]  H. Honda The time courses of visual mislocalization and of extraretinal eye position signals at the time of vertical saccades , 1991, Vision Research.

[19]  D. Boussaoud,et al.  Gaze effects in the cerebral cortex: reference frames for space coding and action , 1999, Experimental Brain Research.

[20]  S. Sterbing-D’Angelo,et al.  Behavioral/systems/cognitive Multisensory Space Representations in the Macaque Ventral Intraparietal Area , 2022 .

[21]  K. Hoffmann,et al.  Neural Dynamics of Saccadic Suppression , 2009, Journal of Neuroscience.

[22]  Markus Lappe,et al.  Anticipatory Saccade Target Processing and the Presaccadic Transfer of Visual Features , 2011, The Journal of Neuroscience.

[23]  Michael E. Goldberg,et al.  The Postsaccadic Unreliability of Gain Fields Renders It Unlikely that the Motor System Can Use Them to Calculate Target Position in Space , 2012, Neuron.

[24]  João F. Henriques,et al.  SPATIAL TRANSFORMATIONS , 2017 .

[25]  Nicholas A. Steinmetz,et al.  Visual Space is Compressed in Prefrontal Cortex Before Eye Movements , 2014, Nature.

[26]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[27]  P Dassonville,et al.  Oculomotor localization relies on a damped representation of saccadic eye displacement in human and nonhuman primates , 1992, Visual Neuroscience.

[28]  F Bremmer,et al.  Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. , 1998, Journal of neurophysiology.

[29]  M. Ibbotson,et al.  Visual perception and saccadic eye movements , 2011, Current Opinion in Neurobiology.

[30]  Frank Bremmer,et al.  Neural Correlates of Visual Localization and Perisaccadic Mislocalization , 2003, Neuron.

[31]  R. Andersen,et al.  Saccade-related activity in the lateral intraparietal area. II. Spatial properties. , 1991, Journal of neurophysiology.

[32]  J F Soechting,et al.  Moving in three-dimensional space: frames of reference, vectors, and coordinate systems. , 1992, Annual review of neuroscience.

[33]  F. Hamker,et al.  A Computational Model for the Influence of Corollary Discharge and Proprioception on the Perisaccadic Mislocalization of Briefly Presented Stimuli in Complete Darkness , 2011, The Journal of Neuroscience.

[34]  K. Hoffmann,et al.  Eye position effects in monkey cortex. I. Visual and pursuit-related activity in extrastriate areas MT and MST. , 1997, Journal of neurophysiology.

[35]  Silvio P. Sabatini,et al.  Eye Position Encoding in Three-Dimensional Space: Integration of Version and Vergence Signals in the Medial Posterior Parietal Cortex , 2012, The Journal of Neuroscience.

[36]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[37]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[38]  M M Hayhoe,et al.  Spatio-temporal organization of behavior. , 2000, Spatial vision.

[39]  Jordan Pola,et al.  Models of the mechanism underlying perceived location of a perisaccadic flash , 2004, Vision Research.

[40]  Gregor Schöner,et al.  A neural mechanism for coordinate transformation predicts pre-saccadic remapping , 2012, Biological Cybernetics.

[41]  Frank Bremmer,et al.  Dynamics of Eye-Position Signals in the Dorsal Visual System , 2012, Current Biology.

[42]  F. Windels,et al.  Neuronal activity , 2006, Molecular Neurobiology.

[43]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[44]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[45]  Alexandre Pouget,et al.  A computational perspective on the neural basis of multisensory spatial representations , 2002, Nature Reviews Neuroscience.

[46]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[47]  F Bremmer,et al.  Eye position encoding in the macaque ventral intraparietal area (VIP). , 1999, Neuroreport.

[48]  Arnold Ziesche,et al.  Brain circuits underlying visual stability across eye movements—converging evidence for a neuro-computational model of area LIP , 2014, Front. Comput. Neurosci..

[49]  Mingsha Zhang,et al.  The proprioceptive representation of eye position in monkey primary somatosensory cortex , 2007, Nature Neuroscience.

[50]  Vincent P Ferrera,et al.  Computing vector differences using a gain field‐like mechanism in monkey frontal eye field , 2007, The Journal of physiology.

[51]  J. Douglas Crawford,et al.  Optimal transsaccadic integration explains distorted spatial perception , 2003, Nature.

[52]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[53]  Frank Bremmer,et al.  Eye position effects in macaque area V4 , 2000, Neuroreport.

[54]  Afferent delays and the mislocalization of perisaccadic stimuli , 2001, Vision Research.

[55]  K. Hoffmann,et al.  Eye position effects in monkey cortex. II. Pursuit- and fixation-related activity in posterior parietal areas LIP and 7A. , 1997, Journal of neurophysiology.

[56]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[57]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.