Feature-Binding Errors After Eye Movements and Shifts of Attention

When people move their eyes, the eye-centered (retinotopic) locations of objects must be updated to maintain world-centered (spatiotopic) stability. Here, we demonstrated that the attentional-updating process temporarily distorts the fundamental ability to bind object locations with their features. Subjects were simultaneously presented with four colors after a saccade—one in a precued spatiotopic target location—and were instructed to report the target’s color using a color wheel. Subjects’ reports were systematically shifted in color space toward the color of the distractor in the retinotopic location of the cue. Probabilistic modeling exposed both crude swapping errors and subtler feature mixing (as if the retinotopic color had blended into the spatiotopic percept). Additional experiments conducted without saccades revealed that the two types of errors stemmed from different attentional mechanisms (attention shifting vs. splitting). Feature mixing not only reflects a new perceptual phenomenon, but also provides novel insight into how attention is remapped across saccades.

[1]  Timothy F. Brady,et al.  Hierarchical Encoding in Visual Working Memory , 2010, Psychological science.

[2]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[3]  Nancy Kanwisher,et al.  Cerebral Cortex doi:10.1093/cercor/bhr357 Higher Level Visual Cortex Represents Retinotopic, Not Spatiotopic, Object Location , 2011 .

[4]  D. Burr,et al.  Saccades compress space, time and number , 2010, Trends in Cognitive Sciences.

[5]  P.-J. Hsieh,et al.  Feature mixing rather than feature replacement during perceptual filling-in , 2009, Vision Research.

[6]  Yale E. Cohen,et al.  A common reference frame for movement plans in the posterior parietal cortex , 2002, Nature Reviews Neuroscience.

[7]  R. M. Siegel,et al.  Maps of Visual Space in Human Occipital Cortex Are Retinotopic, Not Spatiotopic , 2008, The Journal of Neuroscience.

[8]  D. Burr,et al.  Spatiotopic selectivity of BOLD responses to visual motion in human area MT , 2007, Nature Neuroscience.

[9]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[10]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[11]  D. Burr,et al.  Changes in visual perception at the time of saccades , 2001, Trends in Neurosciences.

[12]  David C. Burr,et al.  Compression of visual space before saccades , 1997, Nature.

[13]  Julie D. Golomb,et al.  The Native Coordinate System of Spatial Attention Is Retinotopic , 2008, The Journal of Neuroscience.

[14]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.

[15]  Nancy Kanwisher,et al.  Retinotopic memory is more precise than spatiotopic memory , 2012, Proceedings of the National Academy of Sciences.

[16]  Julie D. Golomb,et al.  Attentional Facilitation throughout Human Visual Cortex Lingers in Retinotopic Coordinates after Eye Movements , 2010, The Journal of Neuroscience.

[17]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[18]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[19]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[20]  David C. Burr,et al.  Spatiotopic Coding of BOLD Signal in Human Visual Cortex Depends on Spatial Attention , 2011, PloS one.

[21]  P. Latour Visual threshold during eye movements , 1962 .

[22]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[23]  R. Sekuler,et al.  Distortions in recall from visual memory: two classes of attractors at work. , 2010, Journal of vision.

[24]  Julie D. Golomb,et al.  Attention doesn’t slide: spatiotopic updating after eye movements instantiates a new, discrete attentional locus , 2011, Attention, perception & psychophysics.

[25]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[26]  Patrick Cavanagh,et al.  Remapped visual masking. , 2011, Journal of vision.

[27]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[28]  Thomas Wachtler,et al.  Perceptual evidence for saccadic updating of color stimuli. , 2008, Journal of vision.