Attention in Active Vision: A Perspective on Perceptual Continuity Across Saccades

Alfred L. Yarbus was among the first to demonstrate that eye movements actively serve our perceptual and cognitive goals, a crucial recognition that is at the heart of today’s research on active vision. He realized that not the changes in fixation stick in memory but the changes in shifts of attention. Indeed, oculomotor control is tightly coupled to functions as fundamental as attention and memory. This tight relationship offers an intriguing perspective on transsaccadic perceptual continuity, which we experience despite the fact that saccades cause rapid shifts of the image across the retina. Here, I elaborate this perspective based on a series of psychophysical findings. First, saccade preparation shapes the visual system’s priorities; it enhances visual performance and perceived stimulus intensity at the targets of the eye movement. Second, before saccades, the deployment of visual attention is updated, predictively facilitating perception at those retinal locations that will be relevant once the eyes land. Third, saccadic eye movements strongly affect the contents of visual memory, highlighting their crucial role for which parts of a scene we remember or forget. Together, these results provide insights on how attentional processes enable the visual system to cope with the retinal consequences of saccades.

[1]  Martin Rolfs,et al.  Reach preparation enhances visual performance and appearance , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  Jan Theeuwes,et al.  A reinvestigation of the reference frame of the tilt-adaptation aftereffect , 2013, Scientific Reports.

[3]  M Concetta Morrone,et al.  Neural mechanisms for timing visual events are spatially selective in real-world coordinates , 2007, Nature Neuroscience.

[4]  P. Cavanagh,et al.  The gender-specific face aftereffect is based in retinotopic not spatiotopic coordinates across several natural image transformations. , 2009, Journal of vision.

[5]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[6]  Edward Awh,et al.  A Neural Measure of Precision in Visual Working Memory , 2013, Journal of Cognitive Neuroscience.

[7]  Eric Castet,et al.  Motion perception of saccade-induced retinal translation , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[8]  James W Bisley,et al.  Anticipatory Remapping of Attentional Priority across the Entire Visual Field , 2012, The Journal of Neuroscience.

[9]  Inci Ayhan,et al.  Retinotopic adaptation-based visual duration compression. , 2010, Journal of vision.

[10]  David E. Irwin,et al.  Evidence against visual integration across saccadic eye movements , 1983, Perception & psychophysics.

[11]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[12]  Heiner Deubel,et al.  Attentional selection during preparation of prehension movements , 2003 .

[13]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[14]  D. E. Irwin,et al.  Covert shifts of attention precede involuntary eye movements. , 2010, Perception & psychophysics.

[15]  Daniel J. Simons,et al.  Inattentional blindness , 2007, Scholarpedia.

[16]  Lawrence H Snyder,et al.  The Responses of Visual Neurons in the Frontal Eye Field Are Biased for Saccades , 2009, The Journal of Neuroscience.

[17]  M. Morgan A bias-free measure of retinotopic tilt adaptation. , 2014, Journal of vision.

[18]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[19]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[20]  J. O'Regan,et al.  Integrating visual information from successive fixations:Does trans-saccadic fusion exist? , 1983, Vision Research.

[21]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[22]  Alexandre Zénon,et al.  Attention deficits without cortical neuronal deficits , 2012, Nature.

[23]  D. E. Irwin,et al.  Eye movements and scene perception: Memory for things observed , 2002, Perception & psychophysics.

[24]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[25]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[26]  E. Maris,et al.  Movement preparation improves touch perception without awareness , 2015, Cognition.

[27]  P. Wenderoth,et al.  Retinotopic encoding of the direction aftereffect , 2008, Vision Research.

[28]  Patrick Cavanagh,et al.  The reference frame of the motion aftereffect is retinotopic. , 2009, Journal of vision.

[29]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[30]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[31]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[32]  Patrick Cavanagh,et al.  Attentional trade-offs maintain the tracking of moving objects across saccades. , 2015, Journal of neurophysiology.

[33]  P. Cavanagh,et al.  Spatial constancy of attention across eye movements is mediated by the presence of visual objects , 2015, Attention, Perception, & Psychophysics.

[34]  Bart Krekelberg,et al.  Summation of Visual Motion across Eye Movements Reflects a Nonspatial Decision Mechanism , 2010, The Journal of Neuroscience.

[35]  H. Deubel,et al.  Independent Allocation of Attention to Eye and Hand Targets in Coordinated Eye-Hand Movements , 2011, Psychological science.

[36]  James R Müller,et al.  Microstimulation of the superior colliculus focuses attention without moving the eyes. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Etienne Olivier,et al.  A Deficit in Covert Attention after Parietal Cortex Inactivation in the Monkey , 2004, Neuron.

[38]  A. Belopolsky,et al.  Target–Distractor Competition in the Oculomotor System Is Spatiotopic , 2014, The Journal of Neuroscience.

[39]  J. Theeuwes,et al.  Parallel allocation of attention prior to the execution of saccade sequences. , 2003, Journal of experimental psychology. Human perception and performance.

[40]  David C. Burr,et al.  A generalized sense of number , 2014, Proceedings of the Royal Society B: Biological Sciences.

[41]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[42]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[43]  Eric Castet,et al.  Spatiotemporal dynamics of visual attention during saccade preparation: Independence and coupling between attention and movement planning. , 2007, Journal of vision.

[44]  David E. Irwin,et al.  The role of the saccade target object in the perception of a visually stable world , 2000, Perception & psychophysics.

[45]  B. Bridgeman,et al.  Failure to integrate visual information from successive fixations , 1983 .

[46]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[47]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[48]  Brian S. Schnitzer,et al.  Eye movements and attention: The role of pre-saccadic shifts of attention in perception, memory and the control of saccades , 2012, Vision Research.

[49]  David Burr,et al.  Spatiotopic perceptual maps in humans: evidence from motion adaptation , 2012, Proceedings of the Royal Society B: Biological Sciences.

[50]  Julie D. Golomb,et al.  The Native Coordinate System of Spatial Attention Is Retinotopic , 2008, The Journal of Neuroscience.

[51]  Patrick Cavanagh,et al.  Object Recognition: Visual Crowding from a Distance , 2013, Current Biology.

[52]  M. Carrasco,et al.  Perceptual enhancement of contrast by attention , 2004 .

[53]  W. Schneider,et al.  Predicting object features across saccades: evidence from object recognition and visual search. , 2014, Journal of experimental psychology. General.

[54]  Richard J Krauzlis,et al.  Inactivation of primate superior colliculus impairs covert selection of signals for perceptual judgments , 2010, Nature Neuroscience.

[55]  Jason B. Mattingley,et al.  Visual Crowding at a Distance during Predictive Remapping , 2013, Current Biology.

[56]  Patrick Cavanagh,et al.  The reference frame of the tilt aftereffect. , 2011, Journal of vision.

[57]  P. Cz. Handbuch der physiologischen Optik , 1896 .

[58]  R. McPeek,et al.  The eye dominates in guiding attention during simultaneous eye and hand movements. , 2011, Journal of vision.

[59]  Etienne Olivier,et al.  Contribution of the Monkey Frontal Eye Field to Covert Visual Attention , 2006, The Journal of Neuroscience.

[60]  Jan Theeuwes,et al.  Evidence for the predictive remapping of visual attention , 2009, Experimental Brain Research.

[61]  P. Cavanagh,et al.  Looking ahead: the perceived direction of gaze shifts before the eyes move. , 2009, Journal of vision.

[62]  Patrick Cavanagh,et al.  Phase-encoded fmri investigation of retinotopic remapping responses , 2010 .

[63]  H. Deubel,et al.  Delayed Saccades, but Not Delayed Manual Aiming Movements, Require Visual Attention Shifts , 2003, Annals of the New York Academy of Sciences.

[64]  F. Hamker The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. , 2005, Cerebral cortex.

[65]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[66]  Denis Schluppeck,et al.  Decoding Working Memory of Stimulus Contrast in Early Visual Cortex , 2013, The Journal of Neuroscience.

[67]  M. Carrasco,et al.  Rapid Simultaneous Enhancement of Visual Sensitivity and Perceived Contrast during Saccade Preparation , 2012, The Journal of Neuroscience.

[68]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[69]  H. Deubel,et al.  Selective Dorsal and Ventral Processing: Evidence for a Common Attentional Mechanism in Reaching and Perception , 1998 .

[70]  Robert H. Wurtz,et al.  Subcortical Modulation of Attention Counters Change Blindness , 2004, The Journal of Neuroscience.

[71]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[72]  William Curran,et al.  Direction-contingent duration compression is primarily retinotopic , 2014, Vision Research.

[73]  Brian S. Schnitzer,et al.  Attentional enhancement along the path of a sequence of saccades , 2010 .

[74]  Patrick Cavanagh,et al.  Remapped visual masking. , 2011, Journal of vision.

[75]  M. Goldberg,et al.  Spatial processing in the monkey frontal eye field. I. Predictive visual responses. , 1997, Journal of neurophysiology.

[76]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[77]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[78]  Joo-Hyun Song,et al.  Deficits in reach target selection during inactivation of the midbrain superior colliculus , 2011, Proceedings of the National Academy of Sciences.

[79]  Eckart Zimmermann,et al.  Buildup of spatial information over time and across eye-movements , 2014, Behavioural Brain Research.

[80]  Martin Rolfs,et al.  Adaptive deployment of spatial and feature-based attention before saccades , 2013, Vision Research.

[81]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[82]  Tirin Moore,et al.  Rapid enhancement of visual cortical response discriminability by microstimulation of the frontal eye field , 2007, Proceedings of the National Academy of Sciences.

[83]  O'Regan Jk,et al.  Integrating visual information from successive fixations: does trans-saccadic fusion exist? , 1983 .

[84]  Maria Concetta Morrone,et al.  Constructing Stable Spatial Maps of the Word , 2012, Perception.

[85]  J. Grimes On the failure to detect changes in scenes across saccades. , 1996 .

[86]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[87]  J. Bisley The neural basis of visual attention , 2011, The Journal of physiology.

[88]  Arash Afraz,et al.  Topography of the motion aftereffect with and without eye movements. , 2008, Journal of vision.

[89]  D. E. Irwin Integrating Information Across Saccadic Eye Movements , 1996 .

[90]  Patrick Cavanagh,et al.  Allocation of attention across saccades. , 2013, Journal of neurophysiology.

[91]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[92]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[93]  Jacqueline Gottlieb,et al.  Functional Significance of Nonspatial Information in Monkey Lateral Intraparietal Area , 2009, The Journal of Neuroscience.

[94]  I. Rock,et al.  Perception without attention: Results of a new method , 1992, Cognitive Psychology.

[95]  P H Schiller,et al.  Visual representations during saccadic eye movements. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[96]  T Moore,et al.  Control of eye movements and spatial attention. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[97]  Heiner Deubel,et al.  Properties of attentional selection during the preparation of sequential saccades , 2007, Experimental Brain Research.

[98]  K. Rayner,et al.  Is visual information integrated across saccades? , 1983, Perception & psychophysics.

[99]  Y. Sugita,et al.  Surround-contingent tilt aftereffect. , 2014, Journal of vision.

[100]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[101]  Samuel U Nummela,et al.  Attention points to the future , 2011, Nature Neuroscience.

[102]  R. Wurtz,et al.  Brain circuits for the internal monitoring of movements. , 2008, Annual review of neuroscience.

[103]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[104]  G. Sperling,et al.  Information transfer in iconic memory experiments. , 1993, Journal of experimental psychology. Human perception and performance.

[105]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[106]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.