Spatiotopic updating across saccades revealed by spatially-specific fMRI adaptation

ABSTRACT Brain representations of visual space are predominantly eye‐centred (retinotopic) yet our experience of the world is largely world‐centred (spatiotopic). A long‐standing question is how the brain creates continuity between these reference frames across successive eye movements (saccades). Here we use functional magnetic resonance imaging (fMRI) to address whether spatially specific repetition suppression (RS) is evident during trans‐saccadic perception. We presented two successive Gabor patches (S1 and S2) in either the upper or lower visual field, left or right of fixation. Spatial congruency was manipulated by having S1 and S2 occur in the same or different upper/lower visual field. On half the trials, a saccade was cued between S1 and S2, placing spatiotopic and retinotopic reference frames in opposition. Equivalent RS was observed in the posterior parietal cortex and frontal eye fields when S1‐S2 were spatiotopically congruent, irrespective of whether retinotopic and spatiotopic coordinates were in accord or were placed in opposition by a saccade. Additionally the post‐saccadic response to S2 demonstrated spatially‐specific RS in retinotopic visual regions, with stronger RS in extrastriate than striate cortex. Collectively, these results are consistent with a robust trans‐saccadic spatial updating mechanism for object position that directly influences even the earliest levels of visual processing. HIGHLIGHTSRepetition suppression (RS) was measured using fMRI.Trans‐saccadic RS occurs when the world centred stimulus location is the same.This spatially‐specific RS was found across saccades in early visual cortex.Oculomotor regions showed similar RS with and without saccades.Findings are consistent with trans‐saccadic spatial updating.

[1]  Johan Wagemans,et al.  Transsaccadic identification of highly similar artificial shapes. , 2009, Journal of vision.

[2]  D. Mackay Visual stability. , 1972, Investigative ophthalmology.

[3]  Ehud Zohary,et al.  Motion adaptation reveals that the motion vector is represented in multiple coordinate frames. , 2012, Journal of vision.

[4]  Katrin Amunts,et al.  Cortical Folding Patterns and Predicting Cytoarchitecture , 2007, Cerebral cortex.

[5]  J. Gottlieb From Thought to Action: The Parietal Cortex as a Bridge between Perception, Action, and Cognition , 2007, Neuron.

[6]  C. Genovese,et al.  Spatial Updating in Human Parietal Cortex , 2003, Neuron.

[7]  Alessio Fracasso,et al.  Spatiotopic updating facilitates perception immediately after saccades , 2016, Scientific Reports.

[8]  Nathan J Hall,et al.  Remapping for visual stability , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[9]  Wilsaan M. Joiner,et al.  Neuronal mechanisms for visual stability: progress and problems , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  Ehud Zohary,et al.  Beyond retinotopic mapping: the spatial representation of objects in the human lateral occipital complex. , 2007, Cerebral cortex.

[11]  C. Colby,et al.  Trans-saccadic perception , 2008, Trends in Cognitive Sciences.

[12]  U. Ilg,et al.  Visual Stability and the Motion Aftereffect: A Psychophysical Study Revealing Spatial Updating , 2011, PloS one.

[13]  K. Verfaillie,et al.  Parametric integration of visual form across saccades , 2010, Vision Research.

[14]  R. Porter Progress in Brain Research , 1965, Nature.

[15]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[16]  Maria Concetta Morrone,et al.  Spatiotopic neural representations develop slowly across saccades , 2013, Current Biology.

[17]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[18]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[19]  Alfonso Caramazza,et al.  Continuous perception of motion and shape across saccadic eye movements. , 2010, Journal of vision.

[20]  Marvin M Chun,et al.  Eye movements help link different views in scene-selective cortex. , 2011, Cerebral cortex.

[21]  Nicholas A. Steinmetz,et al.  Visual Space is Compressed in Prefrontal Cortex Before Eye Movements , 2014, Nature.

[22]  Caroline Van Eccelpoel,et al.  Coding of identity-diagnostic information in transsaccadic object perception. , 2008, Journal of vision.

[23]  Jonas Larsson,et al.  fMRI repetition suppression: neuronal adaptation or stimulus expectation? , 2012, Cerebral cortex.

[24]  David Whitney,et al.  Saccadic remapping of object-selective information , 2014, Attention, perception & psychophysics.

[25]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[26]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[27]  Jim M. Monti,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008, Nature Neuroscience.

[28]  R. Vogels,et al.  Repetition Probability Does Not Affect fMRI Repetition Suppression for Objects , 2013, The Journal of Neuroscience.

[29]  Maria Concetta Morrone,et al.  Spatiotopic coding and remapping in humans , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  Marc A Sommer,et al.  The frontal eye field as a prediction map. , 2008, Progress in brain research.

[31]  O. Woolpert Biological Sciences , 1980, Nature.

[32]  Maria Concetta Morrone,et al.  Nonretinotopic visual processing in the brain , 2015, Visual Neuroscience.

[33]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[34]  Sang Chul Chong,et al.  The background is remapped across saccades , 2013, Experimental Brain Research.

[35]  Avishai Henik,et al.  Hemispheric Asymmetry in the Remapping and Maintenance of Visual Saliency Maps: A TMS Study , 2010, Journal of Cognitive Neuroscience.

[36]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[37]  J. Bisley,et al.  Psychophysical evidence for spatiotopic processing in area MT in a short-term memory for motion task. , 2009, Journal of neurophysiology.

[38]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[39]  Johan Wagemans,et al.  Perceptual Grouping of Object Contours Survives Saccades , 2011, PloS one.

[40]  Jens Schwarzbach,et al.  A simple framework (ASF) for behavioral and neuroimaging experiments based on the psychophysics toolbox for MATLAB , 2011, Behavior research methods.

[41]  Sarah D. Vollmer,et al.  Object continuity and the transsaccadic representation of form , 2008, Perception & psychophysics.

[42]  D. Burr,et al.  Spatiotopic selectivity of BOLD responses to visual motion in human area MT , 2007, Nature Neuroscience.

[43]  Alessio Fracasso,et al.  Remapping of the line motion illusion across eye movements , 2012, Experimental Brain Research.

[44]  Thomas Wachtler,et al.  Perceptual evidence for saccadic updating of color stimuli. , 2008, Journal of vision.

[45]  J. Douglas Crawford,et al.  Trans-saccadic interactions in human parietal and occipital cortex during the retention and comparison of object orientation , 2016, Cortex.

[46]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[47]  T. Vilis,et al.  Remapping the remembered target location for anti-saccades in human posterior parietal cortex. , 2005, Journal of neurophysiology.

[48]  J. Crawford,et al.  Transsaccadic integration of visual features in a line intersection task , 2006, Experimental Brain Research.

[49]  M. Hayhoe,et al.  Integration of Form across Saccadic Eye Movements , 1991, Perception.

[50]  R. K. Simpson Nature Neuroscience , 2022 .

[51]  Paul M Bays,et al.  Spatial remapping of the visual world across saccades , 2007, Neuroreport.

[52]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.