The Binding Problem after an eye movement

Spatial attention is thought to be the “glue” that binds features together (e.g., Treisman & Gelade, 1980 , Psychology , 12 [1], 97–136)—but attention is dynamic, constantly moving across multiple goals and locations. For example, when a person moves her eyes, visual inputs that are coded relative to the eyes (retinotopic) must be rapidly updated to maintain stable world-centered (spatiotopic) representations. Here, we examined how dynamic updating of spatial attention after a saccadic eye movement affects object-feature binding. Immediately after a saccade, participants were simultaneously presented with four colored and oriented bars (one at a precued spatiotopic target location) and instructed to reproduce both the color and orientation of the target item. Object-feature binding was assessed by applying probabilistic mixture models to the joint distribution of feature errors: feature reports for the target item could be correlated (and thus bound together) or independent. We found that compared with holding attention without an eye movement, attentional updating after an eye movement produced more independent errors, including illusory conjunctions, in which one feature of the item at the spatiotopic target location was misbound with the other feature of the item at the initial retinotopic location. These findings suggest that even when only one spatiotopic location is task relevant, spatial attention—and thus object-feature binding—is malleable across and after eye movements, heightening the challenge that eye movements pose for the binding problem and for visual stability.

[1]  Timothy F. Brady,et al.  Modeling visual working memory with the MemToolbox. , 2013, Journal of vision.

[2]  Julie D. Golomb,et al.  Attention doesn’t slide: spatiotopic updating after eye movements instantiates a new, discrete attentional locus , 2011, Attention, perception & psychophysics.

[3]  Sebastian Schneegans,et al.  New perspectives on binding in visual working memory. , 2018, British journal of psychology.

[4]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.

[5]  Emma Wu Dowd,et al.  Object-Feature Binding Survives Dynamic Shifts of Spatial Attention , 2018, Psychological science.

[6]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[7]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[8]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[9]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[10]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[11]  Sebastian Schneegans,et al.  Neural Architecture for Feature Binding in Visual Working Memory , 2017, The Journal of Neuroscience.

[12]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[13]  J. Theeuwes,et al.  Gradual Remapping Results in Early Retinotopic and Late Spatiotopic Inhibition of Return , 2010, Psychological science.

[14]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[15]  Julie D. Golomb,et al.  Object-location binding across a saccade: A retinotopic spatial congruency bias , 2017, Attention, perception & psychophysics.

[16]  Jan Theeuwes,et al.  A Retinotopic Attentional Trace after Saccadic Eye Movements: Evidence from Event-related Potentials , 2013, Journal of Cognitive Neuroscience.

[17]  J. Wolfe,et al.  The Psychophysical Evidence for a Binding Problem in Human Vision , 1999, Neuron.

[18]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[19]  Emma Y. Wu,et al.  Storage and binding of object features in visual working memory , 2011, Neuropsychologia.

[20]  Julie D. Golomb Remapping locations and features across saccades: a dual-spotlight theory of attentional updating. , 2019, Current opinion in psychology.

[21]  John K Kruschke,et al.  Bayesian Assessment of Null Values Via Parameter Estimation and Model Comparison , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[22]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[23]  Masud Husain,et al.  The privileged role of location in visual working memory , 2014, Attention, perception & psychophysics.

[24]  L. Marshall,et al.  Evidence for Optimal Integration of Visual Feature Representations across Saccades , 2015, The Journal of Neuroscience.

[25]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[26]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[27]  Julie D Golomb,et al.  Divided spatial attention and feature-mixing errors , 2015, Attention, Perception, & Psychophysics.

[28]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[29]  J-M Hopf,et al.  Dynamics of feature binding during object-selective attention , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[30]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[31]  Paul M Bays,et al.  Evaluating and excluding swap errors in analogue tests of working memory , 2016, Scientific Reports.

[32]  Werner X. Schneider,et al.  Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[33]  E. Vul,et al.  Independent Sampling of Features Enables Conscious Perception of Bound Objects , 2010, Psychological science.

[34]  Julie D. Golomb,et al.  The Native Coordinate System of Spatial Attention Is Retinotopic , 2008, The Journal of Neuroscience.

[35]  Julie D. Golomb,et al.  Attentional Facilitation throughout Human Visual Cortex Lingers in Retinotopic Coordinates after Eye Movements , 2010, The Journal of Neuroscience.

[36]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[37]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[38]  Emma Y. Wu,et al.  torage and binding of object features in visual working memory , 2011 .

[39]  Patrick Cavanagh,et al.  Allocation of attention across saccades , 2012 .

[40]  Nancy Kanwisher,et al.  Feature-Binding Errors After Eye Movements and Shifts of Attention , 2014, Psychological science.

[41]  Arvid Herwig,et al.  Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition , 2015, Front. Syst. Neurosci..

[42]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[43]  P. De Weerd,et al.  Visual spatial attention to multiple locations at once: the jury is still out. , 2010, Psychological review.