Object identity determines trans-saccadic integration

Humans make two to four rapid eye movements (saccades) per second, which, surprisingly, does not lead to abrupt changes in vision. To the contrary, we perceive a stable world. Hence, an important question is how information is integrated across saccades. To investigate this question, we used the sequential metacontrast paradigm (SQM), where two expanding streams of lines are presented. When one line is spatially offset, the other lines are perceived as being offset, too. When more lines are offset, all offsets integrate mandatorily; that is, observers cannot report the individual offsets but perceive one integrated offset. Here, we asked observers to make a saccade during the SQM. Even though the saccades caused a highly disrupted motion trajectory on the retina, offsets presented before and after the saccade integrated mandatorily. When observers made no saccade and the streams were displaced on the screen so that a similarly disrupted retinal image occurred as in the previous condition, no integration occurred. We suggest that trans-saccadic integration and perception are determined by object identity in spatiotopic coordinates and not by the retinal image.

[1]  H. Helmholtz Theorie der Luftschwingungen in Röhren mit offenen Enden. , 1860 .

[2]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[3]  D. Mackay Visual stability. , 1972, Investigative ophthalmology.

[4]  B. Bridgeman,et al.  Failure to integrate visual information from successive fixations , 1983 .

[5]  David E. Irwin,et al.  Failure to integrate information from successive fixations. , 1983, Science.

[6]  K. Rayner,et al.  Is visual information integrated across saccades? , 1983, Perception & psychophysics.

[7]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[8]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[9]  M. Bach,et al.  The Freiburg Visual Acuity test--automatic measurement of visual acuity. , 1996, Optometry and vision science : official publication of the American Academy of Optometry.

[10]  B. Bridgeman,et al.  Postsaccadic target blanking prevents saccadic suppression of image displacement , 1996, Vision Research.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[13]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[14]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[15]  Thomas U. Otto,et al.  The flight path of the phoenix--the visible trace of invisible elements in human vision. , 2006, Journal of vision.

[16]  Haluk Öğmen,et al.  Perceptual grouping induces non-retinotopic feature attribution in human vision , 2006, Vision Research.

[17]  D. Melcher Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[18]  Thomas Wachtler,et al.  Perceptual evidence for saccadic updating of color stimuli. , 2008, Journal of vision.

[19]  David Melcher,et al.  Dynamic, object-based remapping of visual features in trans-saccadic perception. , 2008, Journal of vision.

[20]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[21]  Joseph Krummenacher,et al.  A (fascinating) litmus test for human retino- vs. non-retinotopic processing. , 2009, Journal of vision.

[22]  Thomas U. Otto,et al.  Feature integration across space, time, and orientation. , 2009, Journal of experimental psychology. Human perception and performance.

[23]  K. Verfaillie,et al.  Parametric integration of visual form across saccades , 2010, Vision Research.

[24]  Alfonso Caramazza,et al.  Continuous perception of motion and shape across saccadic eye movements. , 2010, Journal of vision.

[25]  Michael H. Herzog,et al.  The Geometry of Visual Perception: Retinotopic and Nonretinotopic Representations in the Human Visual System , 2010, Proceedings of the IEEE.

[26]  D. Alais,et al.  Orientation tuning of contrast masking caused by motion streaks. , 2010, Journal of vision.

[27]  J. Enns,et al.  Space and Time in Perception and Action: Object updating: a force for perceptual continuity and scene stability in human vision , 2010 .

[28]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[29]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[30]  Maria Concetta Morrone,et al.  Spatiotopic Visual Maps Revealed by Saccadic Adaptation in Humans , 2011, Current Biology.

[31]  Patrick Cavanagh,et al.  Spatiotopic apparent motion reveals local variations in space constancy. , 2011, Journal of vision.

[32]  A. Hollingworth,et al.  An object-mediated updating account of insensitivity to transsaccadic change. , 2012, Journal of vision.

[33]  J. Badler,et al.  Divergence between oculomotor and perceptual causality. , 2012, Journal of vision.

[34]  Haluk Öğmen,et al.  Non-retinotopic feature processing in the absence of retinotopic spatial layout and the construction of perceptual space from motion , 2012, Vision Research.

[35]  D. Burr,et al.  Transient spatiotopic integration across saccadic eye movements mediates visual stability. , 2013, Journal of neurophysiology.

[36]  Peter J Bex,et al.  Integrating Retinotopic Features in Spatiotopic Coordinates , 2014, The Journal of Neuroscience.

[37]  Andrew Hollingworth,et al.  The representation of the saccade target object depends on visual stability , 2014, Visual cognition.

[38]  Patrick Cavanagh,et al.  Masking produces compression of space and time in the absence of eye movements. , 2014, Journal of neurophysiology.

[39]  Arvid Herwig,et al.  Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition , 2015, Front. Syst. Neurosci..

[40]  Haluk Öğmen,et al.  The effective reference frame in perceptual judgments of motion direction , 2015, Vision Research.

[41]  Alexander C. Schütz,et al.  Trans-saccadic integration of peripheral and foveal feature information is close to optimal. , 2015, Journal of vision.

[42]  Eero P. Simoncelli,et al.  Near-optimal integration of orientation information across saccades. , 2015, Journal of vision.

[43]  Maria Concetta Morrone,et al.  Nonretinotopic visual processing in the brain , 2015, Visual Neuroscience.

[44]  L. Marshall,et al.  Evidence for Optimal Integration of Visual Feature Representations across Saccades , 2015, The Journal of Neuroscience.

[45]  R. Shapley,et al.  Noise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception. , 2015, Journal of vision.

[46]  David Whitney,et al.  Saccadic remapping of object-selective information , 2014, Attention, perception & psychophysics.

[47]  Alessio Fracasso,et al.  Spatiotopic updating facilitates perception immediately after saccades , 2016, Scientific Reports.

[48]  Patrick Cavanagh,et al.  Transsaccadic perceptual fusion. , 2017, Journal of vision.

[49]  Alexander C. Schütz,et al.  Numerosity estimation benefits from transsaccadic information integration , 2017, Journal of vision.

[50]  P. Tiňo,et al.  Learning predictive statistics from temporal sequences: Dynamics and strategies , 2017, Journal of vision.

[51]  E Zimmermann,et al.  Perception during double-step saccades , 2018, Scientific Reports.

[52]  Alexander C. Schütz,et al.  Optimal trans-saccadic integration relies on visual working memory , 2018, Vision Research.

[53]  Guido Marco Cicchini,et al.  Trans-saccadic integration of orientation information. , 2018, Journal of vision.

[54]  Katja Doerschner,et al.  Seeing through transparent layers. , 2017, Journal of vision.

[55]  Haluk Öğmen,et al.  Unconscious retinotopic motion processing affects non-retinotopic motion perception , 2018, Consciousness and Cognition.

[56]  Michael H. Herzog,et al.  Feature integration within discrete time windows , 2019, Nature Communications.

[57]  S. Phinn,et al.  Australian vegetated coastal ecosystems as global hotspots for climate change mitigation , 2019, Nature Communications.