Pre-saccadic remapping relies on dynamics of spatial attention

Each saccade shifts the projections of the visual scene on the retina. It has been proposed that the receptive fields of neurons in oculomotor areas are predictively remapped to account for these shifts. While remapping of the whole visual scene seems prohibitively complex, selection by attention may limit these processes to a subset of attended locations. Because attentional selection consumes time, remapping of attended locations should evolve in time, too. In our study, we cued a spatial location by presenting an attention-capturing cue at different times before a saccade and constructed maps of attentional allocation across the visual field. We observed no remapping of attention when the cue appeared shortly before saccade. In contrast, when the cue appeared sufficiently early before saccade, attentional resources were reallocated precisely to the remapped location. Our results show that pre-saccadic remapping takes time to develop suggesting that it relies on the spatial and temporal dynamics of spatial attention.

[1]  Fred H. Hamker,et al.  Two Types of Receptive Field Dynamics in Area V4 at the Time of Eye Movements? , 2017, Front. Syst. Neurosci..

[2]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[3]  Daniel Guitton,et al.  Two distinct types of remapping in primate cortical area V4 , 2016, Nature Communications.

[4]  P. Rabbitt,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption , 1989 .

[5]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[7]  Kendrick N. Kay,et al.  Attention Reduces Spatial Uncertainty in Human Ventral Temporal Cortex , 2015, Current Biology.

[8]  R. Sperry.  Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[9]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[10]  Heiner Deubel,et al.  Presaccadic motion integration between current and future retinotopic locations of attended objects. , 2016, Journal of neurophysiology.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  Stefan Treue,et al.  Visual attention is available at a task-relevant location rapidly after a saccade , 2016, eLife.

[13]  Tirin Moore,et al.  Dissonant Representations of Visual Space in Prefrontal Cortex during Eye Movements , 2018, Cell reports.

[14]  J. Theeuwes.  Exogenous and endogenous control of attention: The effect of visual onsets and offsets , 1991, Perception & psychophysics.

[15]  H. J. Muller,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. , 1989, Journal of experimental psychology. Human perception and performance.

[16]  Thom Carney,et al.  Orientation discrimination as a function of stimulus eccentricity and size: Nasal/temporal retinal asymmetry , 1988, Vision Research.

[17]  T. Womelsdorf,et al.  Dynamic shifts of visual receptive fields in cortical area MT by spatial attention , 2006, Nature Neuroscience.

[18]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[19]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.

[20]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[21]  Patrick Cavanagh,et al.  Allocation of attention across saccades. , 2013, Journal of neurophysiology.

[22]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[23]  M. Goldberg,et al.  The time course of perisaccadic receptive field shifts in the lateral intraparietal area of the monkey. , 2003, Journal of neurophysiology.

[24]  Heiner Deubel,et al.  Properties of attentional selection during the preparation of sequential saccades , 2007, Experimental Brain Research.

[25]  E. J. Tehovnik,et al.  Eye Movements Modulate Visual Receptive Fields of V4 Neurons , 2001, Neuron.

[26]  Daniel Guitton,et al.  Dissociation of forward and convergent remapping in primate visual cortex , 2016, Current Biology.

[27]  Stefan Treue,et al.  An Attention-Sensitive Memory Trace in Macaque MT Following Saccadic Eye Movements , 2016, PLoS biology.

[28]  Jan Theeuwes,et al.  Dissociating oculomotor contributions to spatial and feature-based selection. , 2013, Journal of neurophysiology.

[29]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[30]  M. Rolfs,et al.  Remapping Attention Pointers: Linking Physiology and Behavior , 2016, Trends in Cognitive Sciences.

[31]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[32]  Christian Quaia,et al.  The maintenance of spatial accuracy by the perisaccadic remapping of visual receptive fields , 1998, Neural Networks.

[33]  Marisa Carrasco,et al.  When sustained attention impairs perception , 2006, Nature Neuroscience.

[34]  Stefan Treue,et al.  Expansion of MT Neurons Excitatory Receptive Fields during Covert Attentive Tracking , 2011, The Journal of Neuroscience.

[35]  F. Campbell,et al.  Saccadic omission: Why we do not see a grey-out during a saccadic eye movement , 1978, Vision Research.

[36]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[37]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[38]  Nicholas A. Steinmetz,et al.  Visual Space is Compressed in Prefrontal Cortex Before Eye Movements , 2014, Nature.

[39]  Marc A Sommer,et al.  Frontal Eye Field Neurons Assess Visual Stability Across Saccades , 2012, The Journal of Neuroscience.

[40]  Alexandria C. Marino,et al.  Saccades Trigger Predictive Updating of Attentional Topography in Area V4 , 2018, Neuron.

[41]  Daniel Guitton,et al.  Coherent alpha oscillations link current and future receptive fields during saccades , 2017, Proceedings of the National Academy of Sciences.

[42]  Si Wu,et al.  Perisaccadic Receptive Field Expansion in the Lateral Intraparietal Area , 2016, Neuron.

[43]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[44]  T. Moore,et al.  Saccades and shifting receptive fields: anticipating consequences or selecting targets? , 2014, Trends in Cognitive Sciences.

[45]  Patrick Cavanagh,et al.  Oculomotor Remapping of Visual Information to Foveal Retinotopic Cortex , 2016, Front. Syst. Neurosci..

[46]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[47]  Patrick Cavanagh,et al.  Attentional trade-offs maintain the tracking of moving objects across saccades. , 2015, Journal of neurophysiology.

[48]  M. Carrasco,et al.  Rapid Simultaneous Enhancement of Visual Sensitivity and Perceived Contrast during Saccade Preparation , 2012, The Journal of Neuroscience.

[49]  Heiner Deubel,et al.  Spatial attention during saccade decisions. , 2017, Journal of neurophysiology.