Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition

Visual perception is based on information processing during periods of eye fixations that are interrupted by fast saccadic eye movements. The ability to sample and relate information on task-relevant objects across fixations implies that correspondence between presaccadic and postsaccadic objects is established. Postsaccadic object information usually updates and overwrites information on the corresponding presaccadic object. The presaccadic object representation is then lost. In contrast, the presaccadic object is conserved when object correspondence is broken. This helps transsaccadic memory but it may impose attentional costs on object recognition. Therefore, we investigated how breaking object correspondence across the saccade affects postsaccadic object recognition. In Experiment 1, object correspondence was broken by a brief postsaccadic blank screen. Observers made a saccade to a peripheral object which was displaced during the saccade. This object reappeared either immediately after the saccade or after the blank screen. Within the postsaccadic object, a letter was briefly presented (terminated by a mask). Observers reported displacement direction and letter identity in different blocks. Breaking object correspondence by blanking improved displacement identification but deteriorated postsaccadic letter recognition. In Experiment 2, object correspondence was broken by changing the object’s contrast-polarity. There were no object displacements and observers only reported letter identity. Again, breaking object correspondence deteriorated postsaccadic letter recognition. These findings identify transsaccadic object correspondence as a key determinant of object recognition across the saccade. This is in line with the recent hypothesis that breaking object correspondence results in separate representations of presaccadic and postsaccadic objects which then compete for limited attentional processing resources (Schneider, 2013). Postsaccadic object recognition is then deteriorated because less resources are available for processing postsaccadic objects.

[1]  Jochen J. Steil,et al.  Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention , 2010, Cognitive Computation.

[2]  Jukka Hyönä,et al.  The brain's eye : neurobiological and clinical aspects of oculomotor research , 2002 .

[3]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[4]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[5]  Arvid Herwig,et al.  Predicting object features across saccades , 2014 .

[6]  Arvid Herwig,et al.  Transsaccadic integration and perceptual continuity. , 2015, Journal of vision.

[7]  M. Ibbotson,et al.  Visual perception and saccadic eye movements , 2011, Current Opinion in Neurobiology.

[8]  Johan Wagemans,et al.  Object form discontinuity facilitates displacement discrimination across saccades. , 2010, Journal of vision.

[9]  Jan Theeuwes,et al.  Visual attention and stability , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[11]  Werner X. Schneider,et al.  Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[12]  Christian H. Poth,et al.  Effects of monitoring for visual events on distinct components of attention , 2014, Front. Psychol..

[13]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[14]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[15]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[16]  David E. Irwin Robert D. Gordon Eye Movements, Attention and Trans-saccadic Memory , 1998 .

[17]  Robert W. Hered Looking and Acting: Vision and Eye Movements in Natural Behaviour, Michael F. Land, Benjamin W. Tatler. Oxford University Press, Oxford, United Kingdom (2009), 320 pp, $59.95, ISBN: 978-0-19-857094-3 , 2010 .

[18]  Johan Wagemans,et al.  Transsaccadic identification of highly similar artificial shapes. , 2009, Journal of vision.

[19]  Heiner Deubel,et al.  Transsaccadic memory of position and form. , 2002, Progress in brain research.

[20]  A. Allport,et al.  Selection for action: Some behavioral and neurophysiological considerations of attention and action , 1987 .

[21]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[22]  Denis Pélisson,et al.  Brain Processing of Visual Information during Fast Eye Movements Maintains Motor Performance , 2013, PloS one.

[23]  Masahiro Takei,et al.  Human resource development and visualization , 2009, J. Vis..

[24]  Jochen J. Steil,et al.  Integrating Inhomogeneous Processing and Proto-object Formation in a Computational Model of Visual Attention , 2009, Human Centered Robot Systems, Cognition, Interaction, Technology.

[25]  J. Enns,et al.  What’s new in visual masking? , 2000, Trends in Cognitive Sciences.

[26]  R. Wurtz Brain Mechanisms for Active Vision , 2015, Daedalus.

[27]  Bruce Bridgeman,et al.  A theory of visual stability across saccadic eye movements , 1994, Behavioral and Brain Sciences.

[28]  O. Neumann Beyond capacity: A functional view of attention , 1987 .

[29]  A. Hollingworth,et al.  An object-mediated updating account of insensitivity to transsaccadic change. , 2012, Journal of vision.

[30]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[31]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[32]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[33]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[34]  J. Reynolds,et al.  Contrast Dependence of Smooth Pursuit Eye Movements following a Saccade to Superimposed Targets , 2012, PloS one.

[35]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[36]  W. Schneider,et al.  Predicting object features across saccades: evidence from object recognition and visual search. , 2014, Journal of experimental psychology. General.

[37]  Tirin Moore,et al.  The Influence of Gaze Control on Visual Perception: Eye Movements and Visual Stability. , 2014, Cold Spring Harbor symposia on quantitative biology.

[38]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[39]  W. Schneider VAM: A neuro-cognitive model for visual attention control of segmentation, object recognition, and space-based motor action , 1995 .

[40]  Arvid Herwig,et al.  A “blanking effect” for surface features: Transsaccadic spatial-frequency discrimination is improved by postsaccadic blanking , 2015, Attention, Perception, & Psychophysics.

[41]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[42]  James W Bisley,et al.  The what, where, and why of priority maps and their interactions with visual working memory , 2015, Annals of the New York Academy of Sciences.

[43]  B. Bridgeman,et al.  Immediate post-saccadic information mediates space constancy , 1998, Vision Research.

[44]  Alexander C. Schütz,et al.  Trans-saccadic integration of peripheral and foveal feature information is close to optimal. , 2015, Journal of vision.

[45]  Eero P. Simoncelli,et al.  Near-optimal integration of orientation information across saccades. , 2015, Journal of vision.

[46]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[47]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[48]  C. Bundesen,et al.  A neural theory of visual attention: bridging cognition and neurophysiology. , 2005, Psychological review.

[49]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[50]  Arvid Herwig,et al.  Neuroscience and Biobehavioral Reviews Linking Perception and Action by Structure or Process? toward an Integrative Perspective , 2022 .

[51]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[52]  M D Anes,et al.  Roles of object-file review and type priming in visual identification within and across eye fixations. , 1994, Journal of experimental psychology. Human perception and performance.

[53]  C. Cierpka,et al.  Particle imaging techniques for volumetric three-component (3D3C) velocity measurements in microfluidics , 2011, Journal of Visualization.

[54]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[55]  Claus Bundesen,et al.  Measuring and modeling attentional dwell time , 2012, Psychonomic bulletin & review.

[56]  P. Subramanian Active Vision: The Psychology of Looking and Seeing , 2006 .

[57]  B. Bridgeman,et al.  Postsaccadic target blanking prevents saccadic suppression of image displacement , 1996, Vision Research.

[58]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[59]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[60]  Heiner Deubel,et al.  Perceptual stability and postsaccadic visual information: Can man bridge a gap? , 1994, Behavioral and Brain Sciences.

[61]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.