The spatial distribution of receptive field changes in a model of peri-saccadic perception: Predictive remapping and shifts towards the saccade target

At the time of an impending saccade receptive fields (RFs) undergo dynamic changes, that is, their spatial profile is altered. This phenomenon has been observed in several monkey visual areas. Although their link to eye movements is obvious, neither the exact pattern nor their function is fully clear. Several RF shifts have been interpreted in terms of predictive remapping mediating visual stability. In particular, even prior to saccade onset some cells become responsive to stimuli presented in their future, post-saccadic RF. In visual area V4, however, the overall effect of RF dynamics consists of a shrinkage and shift of RFs towards the saccade target. These observations have been linked to a pre-saccadically enhanced processing of the future fixation. In order to better understand these seemingly different outcomes, we analyzed the RF shifts predicted by a recently proposed computational model of peri-saccadic perception (Hamker, Zirnsak, Calow, & Lappe, 2008). This model unifies peri-saccadic compression, pre-saccadic attention shifts, and peri-saccadic receptive field dynamics in a common framework of oculomotor reentry signals in extrastriate visual cortical maps. According to the simulations that we present in the current paper, a spatially selective oculomotor feedback signal leads to RF dynamics which are both consistent with the observations made in studies aiming to investigate predictive remapping and saccade target shifts. Thus, the seemingly distinct experimental observations could be grounded in the same neural mechanism leading to different RF dynamics dependent on the location of the RF in visual space.

[1]  Marcus Kaiser,et al.  Perisaccadic Mislocalization Orthogonal to Saccade Direction , 2004, Neuron.

[2]  D. L. Adams,et al.  A Precise Retinotopic Map of Primate Striate Cortex Generated from the Representation of Angioscotomas , 2003, The Journal of Neuroscience.

[3]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[4]  B. Bridgeman,et al.  Immediate post-saccadic information mediates space constancy , 1998, Vision Research.

[5]  T. Womelsdorf,et al.  Receptive Field Shift and Shrinkage in Macaque Middle Temporal Area through Attentional Gain Modulation , 2008, The Journal of Neuroscience.

[6]  P H Schiller,et al.  Visual representations during saccadic eye movements. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Tirin Moore,et al.  Changes in Visual Receptive Fields with Microstimulation of Frontal Cortex , 2006, Neuron.

[8]  J. Schall,et al.  Visual and Motor Connectivity and the Distribution of Calcium-Binding Proteins in Macaque Frontal Eye Field: Implications for Saccade Target Selection , 2009, Front. Neuroanat..

[9]  Vision Research , 1961, Nature.

[10]  James R Müller,et al.  Microstimulation of the superior colliculus focuses attention without moving the eyes. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[11]  B. Bridgeman,et al.  Postsaccadic target blanking prevents saccadic suppression of image displacement , 1996, Vision Research.

[12]  D. Melcher Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[13]  P. Cavanagh,et al.  Focused attention distorts visual space: an attentional repulsion effect. , 1997, Journal of experimental psychology. Human perception and performance.

[14]  Tirin Moore,et al.  Rapid enhancement of visual cortical response discriminability by microstimulation of the frontal eye field , 2007, Proceedings of the National Academy of Sciences.

[15]  Xiao-Jing Wang,et al.  Tuning curve shift by attention modulation in cortical neurons: a computational study of its mechanisms. , 2006, Cerebral cortex.

[16]  Robert Desimone,et al.  Cortical Connections of Area V4 in the Macaque , 2008 .

[17]  Robert H. Wurtz,et al.  Subcortical Modulation of Attention Counters Change Blindness , 2004, The Journal of Neuroscience.

[18]  Y. Cohen,et al.  Eye-centered, head-centered, and complex coding of visual and auditory targets in the intraparietal sulcus. , 2005, Journal of neurophysiology.

[19]  J. Bullier,et al.  Topography of visual cortex connections with frontal eye field in macaque: convergence and segregation of processing streams , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[21]  Alex R. Wade,et al.  Two-dimensional mapping of the central and parafoveal visual field to human visual cortex. , 2007, Journal of neurophysiology.

[22]  David C. Burr,et al.  Compression of visual space before saccades , 1997, Nature.

[23]  C. Colby,et al.  Trans-saccadic perception , 2008, Trends in Cognitive Sciences.

[24]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[25]  D. E. Irwin,et al.  A localist evaluation solution for visual stability across saccades , 1994, Behavioral and Brain Sciences.

[26]  Fred Henrik Hamker,et al.  V4 receptive field dynamics as predicted by a systems-level model of visual attention using feedback from the frontal eye field , 2006, Neural Networks.

[27]  Junying Yuan,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2022 .

[28]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[29]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[30]  John H. R. Maunsell,et al.  The visual field representation in striate cortex of the macaque monkey: Asymmetries, anisotropies, and individual variability , 1984, Vision Research.

[31]  J. Henderson,et al.  Eye movements and visual memory: Detecting changes to saccade targets in scenes , 2003, Perception & psychophysics.

[32]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[33]  B. Fischer,et al.  Enhanced activation of neurons in prelunate cortex before visually guided saccades of trained rhesus monkeys , 2004, Experimental Brain Research.

[34]  David E. Irwin,et al.  The role of the saccade target object in the perception of a visually stable world , 2000, Perception & psychophysics.

[35]  J. Findlay,et al.  The Relationship between Eye Movements and Spatial Attention , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[36]  R. Wurtz,et al.  What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamus. , 2004, Journal of neurophysiology.

[37]  F. Hamker The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. , 2005, Cerebral cortex.

[38]  B. Fischer,et al.  Selection of visual targets activates prelunate cortical cells in trained rhesus monkey , 2004, Experimental Brain Research.

[39]  J. Henderson,et al.  The Role of Fixation Position in Detecting Scene Changes Across Saccades , 1999 .

[40]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[41]  M. Concetta Morrone,et al.  Apparent Position of Visual Targets during Real and Simulated Saccadic Eye Movements , 1997, The Journal of Neuroscience.

[42]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[43]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[44]  D. E. Irwin Memory for position and identity across eye movements. , 1992 .

[45]  D. E. Irwin,et al.  Covert shifts of attention precede involuntary eye movements , 2004 .

[46]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[47]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[48]  Markus Lappe,et al.  The Peri-Saccadic Perception of Objects and Space , 2008, PLoS Comput. Biol..

[49]  David E. Irwin Robert D. Gordon Eye Movements, Attention and Trans-saccadic Memory , 1998 .

[50]  Fred H. Hamker,et al.  A computational model of visual stability and change detection during eye movements in real-world scenes , 2005 .

[51]  F. Hamker The reentry hypothesis: linking eye movements to visual perception. , 2003, Journal of vision.

[52]  M. Goldberg,et al.  Spatial processing in the monkey frontal eye field. I. Predictive visual responses. , 1997, Journal of neurophysiology.

[53]  Jay Pratt,et al.  Endogenous saccades are preceded by shifts of visual attention: evidence from cross-saccadic priming effects. , 2002, Acta psychologica.

[54]  Christian Quaia,et al.  The maintenance of spatial accuracy by the perisaccadic remapping of visual receptive fields , 1998, Neural Networks.

[55]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[56]  E. J. Tehovnik,et al.  Eye Movements Modulate Visual Receptive Fields of V4 Neurons , 2001, Neuron.