Nonretinocentric localization of successively presented flashes during smooth pursuit eye movements

Keeping track of objects in our environment across body and eye movements is essential for perceptual stability and localization of external objects. As of yet, it is largely unknown how this perceptual stability is achieved. A common behavioral approach to investigate potential neuronal mechanisms underlying spatial vision has been the presentation of one brief visual stimulus across eye movements. Here, we adopted this approach and aimed to determine the reference frame of the perceptual localization of two successively presented flashes during fixation and smooth pursuit eye movements (SPEMs). To this end, eccentric flashes with a stimulus onset asynchrony of zero or ± 200 ms had to be localized with respect to each other during fixation and SPEMs. The results were used to evaluate different models predicting the reference frame in which the spatial information is represented. First, we were able to reproduce the well-known effect of relative mislocalization during fixation. Second, smooth pursuit led to a characteristic relative mislocalization, different from that during fixation. A model assuming that relative localization takes place in a nonretinocentric reference frame described our data best. This suggests that the relative localization judgment is performed at a stage of visual processing in which retinal and nonretinal information is available.

[1]  A Straube,et al.  Mislocalization of peripheral targets during fixation , 2001, Vision Research.

[2]  S. Mateeff,et al.  Peripheral vision and perceived visual direction , 1983, Biological Cybernetics.

[3]  Frank Bremmer,et al.  The Dorsal Visual System Predicts Future and Remembers Past Eye Position , 2016, Front. Syst. Neurosci..

[4]  Alexandre Pouget,et al.  Perceived geometrical relationships affected by eye-movement signals , 1997, Nature.

[5]  D. Boussaoud,et al.  Gaze effects in the cerebral cortex: reference frames for space coding and action , 1999, Experimental Brain Research.

[6]  Gereon R. Fink,et al.  Space Coding in Primate Posterior Parietal Cortex , 2001, NeuroImage.

[7]  K. Hoffmann,et al.  Eye position effects in monkey cortex. I. Visual and pursuit-related activity in extrastriate areas MT and MST. , 1997, Journal of neurophysiology.

[8]  D M Wolpert,et al.  Sensorimotor integration compensates for visual localization errors during smooth pursuit eye movements. , 2001, Journal of neurophysiology.

[9]  Gunnar Blohm,et al.  Neural correlate of spatial (mis‐)localization during smooth eye movements , 2016, The European journal of neuroscience.

[10]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[11]  Ingo Fründ,et al.  Inference for psychometric functions in the presence of nonstationary behavior. , 2011, Journal of vision.

[12]  E. Brenner,et al.  Judging relative positions across saccades , 2005, Vision Research.

[13]  J. Müsseler,et al.  Effects of attention on a relative mislocalization with successively presented stimuli , 2010, Vision Research.

[14]  Frank Bremmer,et al.  Eye position effects in macaque area V4 , 2000, Neuroreport.

[15]  Xiaogang Yan,et al.  Transition from Target to Gaze Coding in Primate Frontal Eye Field during Memory Delay and Memory–Motor Transformation , 2016, eNeuro.

[16]  Thora Tenbrink,et al.  Reference Frames , 2017, Encyclopedia of GIS.

[17]  Gunnar Blohm,et al.  The default allocation of attention is broadly ahead of smooth pursuit. , 2010, Journal of vision.

[18]  F. Bremmer,et al.  Localization of visual targets during optokinetic eye movements , 2007, Vision Research.

[19]  G. Barnes,et al.  Cognitive processes involved in smooth pursuit eye movements , 2008, Brain and Cognition.

[20]  Eli Brenner,et al.  Mislocalization of flashes during smooth pursuit hardly depends on the lighting conditions , 2006, Vision Research.

[21]  F. Bremmer,et al.  An fMRI study of optokinetic nystagmus and smooth-pursuit eye movements in humans , 2005, Experimental Brain Research.

[22]  Eli Brenner,et al.  Separate simultaneous processing of egocentric and relative positions , 2000, Vision Research.

[23]  Wolfram Erlhagen,et al.  Relative mislocalization of successively presented stimuli , 2008, Vision Research.

[24]  F. Bremmer,et al.  Localization of visual and auditory stimuli during smooth pursuit eye movements. , 2010, Journal of vision.

[25]  Heiner Deubel,et al.  Relative mislocalization of briefly presented stimuli in the retinal periphery , 1999, Perception & psychophysics.

[26]  A. Pouget,et al.  Reference frames for representing visual and tactile locations in parietal cortex , 2005, Nature Neuroscience.

[27]  F. Bremmer,et al.  Seeing and Acting at the Same Time Challenges for Brain (and) Research , 2003, Neuron.

[28]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[29]  S. Sterbing-D’Angelo,et al.  Behavioral/systems/cognitive Multisensory Space Representations in the Macaque Ventral Intraparietal Area , 2022 .

[30]  Matteo Valsecchi,et al.  Attention is allocated closely ahead of the target during smooth pursuit eye movements: Evidence from EEG frequency tagging , 2017, Neuropsychologia.

[31]  Adam P. Morris,et al.  A Stable Visual World in Primate Primary Visual Cortex , 2019, Current Biology.

[32]  D. Kerzel.  Memory for the position of stationary objects: disentangling foveal bias and memory averaging , 2002, Vision Research.

[33]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[34]  Frank Bremmer,et al.  Dynamics of Eye-Position Signals in the Dorsal Visual System , 2012, Current Biology.

[35]  Daniël Lakens,et al.  Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs , 2013, Front. Psychol..

[36]  H Kingma,et al.  On the time course and accuracy of spatial localization: basic data and a two-process model. , 1993, Acta psychologica.

[37]  Frank Bremmer,et al.  Eye-Position Signals in the Dorsal Visual System Are Accurate and Precise on Short Timescales , 2013, The Journal of Neuroscience.

[38]  Maria Concetta Morrone,et al.  Spatiotopic neural representations develop slowly across saccades , 2013, Current Biology.

[39]  Marcia Grabowecky,et al.  Simultaneous shape repulsion and global assimilation in the perception of aspect ratio. , 2011, Journal of vision.

[40]  L F Abbott,et al.  Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. , 2001, Progress in brain research.

[41]  Eli Brenner,et al.  Flashes are localised as if they were moving with the eyes , 2005, Vision Research.

[42]  S. Celebrini,et al.  Gaze direction controls response gain in primary visual-cortex neurons , 1999, Nature.

[43]  J. Douglas Crawford,et al.  A method for mapping response fields and determining intrinsic reference frames of single-unit activity: Applied to 3D head-unrestrained gaze shifts , 2009, Journal of Neuroscience Methods.

[44]  H. Abdi.  Holm's Sequential Bonferroni Procedure , 2010 .

[45]  Bremmer,et al.  Eye position encoding in the macaque posterior parietal cortex , 1998, The European journal of neuroscience.

[46]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[47]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[48]  A. Fuchs,et al.  Relationship between eye acceleration and retinal image velocity during foveal smooth pursuit in man and monkey. , 1981, Journal of neurophysiology.

[49]  Francesca C. Fortenbaugh,et al.  Exploring the edges of visual space: the influence of visual boundaries on peripheral localization. , 2012, Journal of vision.

[50]  Xiaogang Yan,et al.  Timing Determines Tuning: A Rapid Spatial Transformation in Superior Colliculus Neurons during Reactive Gaze Shifts , 2019, eNeuro.

[51]  Francesco Lacquaniti,et al.  Cognitive allocentric representations of visual space shape pointing errors , 2002, Experimental Brain Research.

[52]  G. DeAngelis,et al.  Flexible egocentric and allocentric representations of heading signals in parietal cortex , 2018, Proceedings of the National Academy of Sciences.

[53]  F Bremmer,et al.  Eye position encoding in the macaque ventral intraparietal area (VIP). , 1999, Neuroreport.