Object discrepancy modulates feature prediction across eye movements

Object perception across saccadic eye movements is assumed to result from integrating two information sources: incoming peripheral object information and information from a foveal prediction (Herwig and Schneider, J Exp Psychol Gen 143(5):1903–1922, 2014 , Herwig, J Vis 15(16), 7, 2015 ). Predictions are supposed to be based on transsaccadic associations of peripheral and foveal object information. The main function of these predictions may be to conceal discrepancies in resolution and locations across saccades. Here we ask how predictions are affected by discrepancies between peripheral and foveal objects. Participants learned unfamiliar transsaccadic associations by making saccades to objects whose shape systematically changed during the saccade. Importantly, we manipulated the size of this change between participants to induce different magnitudes of object discrepancy. In a subsequent test, we found that judgment shifts of peripheral shape perception toward the predicted foveal input depended on change size during acquisition. Specifically, the contribution of prediction decreased for large changes but did not reach zero, showing that even for large changes (i.e., square to circle or vice versa) the prediction was not ignored completely. These findings indicate that object discrepancy during learning determines how much the resulting foveal prediction contributes to perception in the periphery.

[1]  Arvid Herwig,et al.  Action–effect associations revealed by eye movements , 2011, Psychonomic bulletin & review.

[2]  David D. Cox,et al.  'Breaking' position-invariant object recognition , 2005, Nature Neuroscience.

[3]  Alexander C. Schütz,et al.  Eye movements and perception: a selective review. , 2011, Journal of vision.

[4]  Wilsaan M. Joiner,et al.  Neuronal mechanisms for visual stability: progress and problems , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  Arvid Herwig,et al.  Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition , 2015, Front. Syst. Neurosci..

[6]  Gernot Horstmann,et al.  Assessing the monitor warm-up time required before a psychological experiment can begin , 2017 .

[7]  Alexander C. Schütz,et al.  Trans-saccadic integration of peripheral and foveal feature information is close to optimal. , 2015, Journal of vision.

[8]  Werner X Schneider,et al.  Breaking object correspondence across saccades impairs object recognition: The role of color and luminance. , 2016, Journal of vision.

[9]  Lynn Huestegge,et al.  Action effects in saccade control , 2012, Psychonomic bulletin & review.

[10]  S. Gepshtein,et al.  The combination of vision and touch depends on spatial proximity. , 2005, Journal of vision.

[11]  Arvid Herwig,et al.  Spatio-temporal dynamics of action-effect associations in oculomotor control. , 2017, Acta psychologica.

[12]  Johan Wagemans,et al.  Object form discontinuity facilitates displacement discrimination across saccades. , 2010, Journal of vision.

[13]  I. Rentschler,et al.  Peripheral vision and pattern recognition: a review. , 2011, Journal of vision.

[14]  M. Ernst,et al.  Feeling what you hear: auditory signals can modulate tactile tap perception , 2005, Experimental Brain Research.

[15]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[16]  Markus Lappe,et al.  Adaptation of Saccades and Perceived Size after Trans-Saccadic Changes of Object Size , 2015, The Journal of Neuroscience.

[17]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[18]  Matteo Valsecchi,et al.  Dynamic Re-calibration of Perceived Size in Fovea and Periphery through Predictable Size Changes , 2016, Current Biology.

[19]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[20]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[21]  Arvid Herwig,et al.  Transsaccadic integration and perceptual continuity. , 2015, Journal of vision.

[22]  D. Melcher A shared sensorimotor map for visual memory, counting and trans-saccadic perception , 2010 .

[23]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[24]  Katharina Weiss,et al.  When circles become triangular: how transsaccadic predictions shape the perception of shape , 2015, Annals of the New York Academy of Sciences.

[25]  Daniel Dennett Caveat Emptor (reply to essays on Consciousness Explained - reply to Mangan, Toribio, Baars and McGovern) in , 1993 .

[26]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[27]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[28]  Preeti Verghese,et al.  Attention to locations and features: different top-down modulation of detector weights. , 2005, Journal of vision.

[29]  Arvid Herwig,et al.  Associating peripheral and foveal visual input across saccades: a default mode of the human visual system? , 2014, Journal of vision.

[30]  D. Melcher Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[31]  S. Gerber,et al.  Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex , 2008 .

[32]  Eero P. Simoncelli,et al.  Near-optimal integration of orientation information across saccades. , 2015, Journal of vision.

[33]  Martin Rolfs,et al.  Attention in Active Vision: A Perspective on Perceptual Continuity Across Saccades , 2015, Perception.

[34]  P. Cavanagh,et al.  Predictive remapping of attention across eye movements , 2011, Nature Neuroscience.

[35]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[36]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[37]  Christian H. Poth Episodic visual cognition: Implications for object and short-term recognition , 2017 .

[38]  Marisa Carrasco,et al.  Saccade Preparation Reshapes Sensory Tuning , 2016, Current Biology.

[39]  A. Nuthmann How do the regions of the visual field contribute to object search in real-world scenes? Evidence from eye movements. , 2014, Journal of experimental psychology. Human perception and performance.

[40]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[41]  Martin Rolfs,et al.  Selective enhancement of orientation tuning before saccades. , 2017, Journal of vision.

[42]  Arvid Herwig,et al.  Predicting object features across saccades , 2014 .

[43]  Samuel U Nummela,et al.  Attention points to the future , 2011, Nature Neuroscience.

[44]  Patrick Cavanagh,et al.  Calibration of peripheral perception of shape with and without saccadic eye movements , 2018, Attention, perception & psychophysics.