Predictive orientation remapping maintains a stable retinal percept

Despite motion on the retina with every saccade, we perceive the world as stable. But whether this stability is a result of neurons constructing a spatial map or continually remapping a retinal representation is unclear. Previous work has focused on the perceptual consequences of shifts in the horizontal and vertical dimensions, but torsion is another key component in ocular orienting that – unlike horizontal and vertical movements – produces a natural misalignment between spatial and retinal coordinates. Here we took advantage of oblique eye orientation-induced retinal torsion to examine perisaccadic orientation perception. We found that orientation perception was largely predicted by the retinal image throughout each trial. Surprisingly however, we observed a significant presaccadic remapping of the percept consistent with maintaining a stable (but spatially inaccurate) retinotopic perception throughout the saccade. These findings strongly suggest that our seamless perceptual stability relies on retinotopic signals that are remapped with each saccade.

[1]  M Concetta Morrone,et al.  Neural mechanisms for timing visual events are spatially selective in real-world coordinates , 2007, Nature Neuroscience.

[2]  P. Dayan,et al.  A mathematical model explains saturating axon guidance responses to molecular gradients , 2016, eLife.

[3]  R. Wurtz,et al.  What the brain stem tells the frontal cortex. II. Role of the SC-MD-FEF pathway in corollary discharge. , 2004, Journal of neurophysiology.

[4]  Frank Bremmer,et al.  Neural Correlates of Visual Localization and Perisaccadic Mislocalization , 2003, Neuron.

[5]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[6]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[7]  Nancy Kanwisher,et al.  Feature-Binding Errors After Eye Movements and Shifts of Attention , 2014, Psychological science.

[8]  M. Landy,et al.  The effect of viewpoint on perceived visual roughness. , 2007, Journal of vision.

[9]  Maria Concetta Morrone,et al.  Spatiotopic neural representations develop slowly across saccades , 2013, Current Biology.

[10]  Gunnar Blohm,et al.  Quantifying effects of stochasticity in reference frame transformations on posterior distributions , 2015, Front. Comput. Neurosci..

[11]  G. Rhodes,et al.  Sex-specific norms code face identity. , 2011, Journal of vision.

[12]  Gunnar Blohm,et al.  Depth estimation from retinal disparity requires eye and head orientation signals. , 2008, Journal of vision.

[13]  J. Crawford,et al.  Gaze-Centered Remapping of Remembered Visual Space in an Open-Loop Pointing Task , 1998, The Journal of Neuroscience.

[14]  Gunnar Blohm,et al.  Multi-Sensory Weights Depend on Contextual Noise in Reference Frame Transformations , 2010, Front. Hum. Neurosci..

[15]  Markus Lappe,et al.  Anticipatory Saccade Target Processing and the Presaccadic Transfer of Visual Features , 2011, The Journal of Neuroscience.

[16]  Jorge Otero-Millan,et al.  Knowing what the brain is seeing in three dimensions: A novel, noninvasive, sensitive, accurate, and low-noise technique for measuring ocular torsion. , 2015, Journal of vision.

[17]  Julie D. Golomb,et al.  The Native Coordinate System of Spatial Attention Is Retinotopic , 2008, The Journal of Neuroscience.

[18]  David Burr,et al.  Spatiotopic perceptual maps in humans: evidence from motion adaptation , 2012, Proceedings of the Royal Society B: Biological Sciences.

[19]  Gunnar Blohm,et al.  Evidence for a retinal velocity memory underlying the direction of anticipatory smooth pursuit eye movements. , 2013, Journal of neurophysiology.

[20]  Nancy Kanwisher,et al.  Retinotopic memory is more precise than spatiotopic memory , 2012, Proceedings of the National Academy of Sciences.

[21]  Gunnar Blohm,et al.  Head roll influences perceived hand position. , 2011, Journal of vision.

[22]  K. Nakayama,et al.  Listing's law, eye position sense, and perception of the vertical , 1977, Vision Research.

[23]  Gunnar Blohm,et al.  Computations for geometrically accurate visually guided reaching in 3-D space. , 2007, Journal of vision.

[24]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[25]  Maria Concetta Morrone,et al.  Spatiotopic Visual Maps Revealed by Saccadic Adaptation in Humans , 2011, Current Biology.

[26]  F. Bremmer,et al.  Visual Neuroscience: The Puzzle of Perceptual Stability , 2016, Current Biology.

[27]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.

[28]  Kenji Kawano,et al.  Neurons in cortical area MST remap the memory trace of visual motion across saccadic eye movements , 2014, Proceedings of the National Academy of Sciences.

[29]  Martin V. Butz,et al.  Simultaneous learning and filtering without delusions: a Bayes-optimal combination of Predictive Inference and Adaptive Filtering , 2015, Front. Comput. Neurosci..

[30]  Julie D. Golomb,et al.  Attentional Facilitation throughout Human Visual Cortex Lingers in Retinotopic Coordinates after Eye Movements , 2010, The Journal of Neuroscience.

[31]  T. Moore,et al.  Saccades and shifting receptive fields: anticipating consequences or selecting targets? , 2014, Trends in Cognitive Sciences.

[32]  Jan Theeuwes,et al.  Evidence for the predictive remapping of visual attention , 2009, Experimental Brain Research.

[33]  Philip N. Sabes,et al.  Multisensory Integration during Motor Planning , 2003, The Journal of Neuroscience.

[34]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[35]  W. Haustein,et al.  Evaluation of retinal orientation and gaze direction in the perception of the vertical , 1990, Vision Research.

[36]  Jason B. Mattingley,et al.  Pre-Saccadic Shifts of Visual Attention , 2012, PloS one.

[37]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[38]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[39]  K. Shapiro,et al.  The contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink , 2008 .

[40]  Guillaume Leclercq,et al.  Computations underlying the visuomotor transformation for smooth pursuit eye movements. , 2015, Journal of neurophysiology.

[41]  Stefan Treue,et al.  Visual attention is available at a task-relevant location rapidly after a saccade , 2016, eLife.

[42]  W. P. Medendorp,et al.  Pointing to remembered visual targets after active one-step self-displacements within reaching space , 1999, Experimental Brain Research.

[43]  M. Concetta Morrone,et al.  Apparent Position of Visual Targets during Real and Simulated Saccadic Eye Movements , 1997, The Journal of Neuroscience.

[44]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[45]  K. Hoffmann,et al.  Neural Dynamics of Saccadic Suppression , 2009, Journal of Neuroscience.

[46]  Erik J Schlicht,et al.  Impact of coordinate transformation uncertainty on human sensorimotor control. , 2007, Journal of neurophysiology.

[47]  Frank Bremmer,et al.  The Dorsal Visual System Predicts Future and Remembers Past Eye Position , 2016, Front. Syst. Neurosci..

[48]  Bart Krekelberg,et al.  Postsaccadic visual references generate presaccadic compression of space , 2000, Nature.

[49]  D. Melcher.  Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[50]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[51]  Si Wu,et al.  Perisaccadic Receptive Field Expansion in the Lateral Intraparietal Area , 2016, Neuron.

[52]  M. Goldberg,et al.  Oculocentric spatial representation in parietal cortex. , 1995, Cerebral cortex.

[53]  Gunnar Blohm,et al.  Visuomotor velocity transformations for smooth pursuit eye movements. , 2010, Journal of neurophysiology.

[54]  Peter J Bex,et al.  Integrating Retinotopic Features in Spatiotopic Coordinates , 2014, The Journal of Neuroscience.

[55]  D. Melcher.  Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[56]  Nicholas A. Steinmetz,et al.  Visual Space is Compressed in Prefrontal Cortex Before Eye Movements , 2014, Nature.

[57]  S. Rétaux,et al.  Evolutionary Shift from Fighting to Foraging in Blind Cavefish through Changes in the Serotonin Network , 2013, Current Biology.