Spatial priming in ecologically relevant reference frames

In recent years, researchers have observed many phenomena demonstrating how the visual system exploits spatial regularities in the environment in order to benefit behavior. In this paper, we question whether spatial priming can be considered one such phenomenon. Spatial priming is defined as a response time facilitation to a visual search target when its spatial position has been repeated in recent trials (Maljkovic & Nakayama, 1996, Perception & Psychophysics, 58, 977–991). Does this priming serve a behaviorally adaptive role or is it merely a byproduct of ongoing visual processing? Critically, an adaptive priming mechanism must actively transform visual inputs from native retinotopic (eye-centered) coordinates into ecologically relevant coordinates, e.g., spatiotopic (world-centered) and/or object-centered. In Experiment 1, we tested this hypothesis by having participants move their eyes between trials, which dissociated retinotopic and spatiotopic frames of reference. Results showed only weak retinotopic priming, but robust spatiotopic priming. The second experiment again had participants move their eyes between trials but also manipulated the placement of a grouped array of display objects from trial to trial. This allowed us to measure not just retinotopic and spatiotopic priming, but object-centered priming as well. Results from this experiment did not yield retinotopic priming but showed robust spatiotopic and object-centered priming. These findings demonstrate that spatial priming operates within ecologically relevant coordinate systems, and the findings support the notion that spatial priming serves an adaptive role in human behavior.

[1]  David C. Burr,et al.  Spatiotopic Coding of BOLD Signal in Human Visual Cortex Depends on Spatial Attention , 2011, PloS one.

[2]  Sheng He,et al.  Automatic frame-centered object representation and integration revealed by iconic memory, visual priming, and backward masking. , 2012, Journal of vision.

[3]  E. Zohary,et al.  Rapid Formation of Spatiotopic Representations As Revealed by Inhibition of Return , 2010, The Journal of Neuroscience.

[4]  S. Tipper,et al.  Scene-based and object-centered inhibition of return: Evidence for dual orienting mechanisms , 1999, Perception & psychophysics.

[5]  Yuhong V. Jiang,et al.  Rapid acquisition but slow extinction of an attentional bias in space , 2012 .

[6]  K. Nakayama,et al.  Priming of popout: III. A short-term implicit memory system beneficial for rapid target selection , 2000 .

[7]  Patrick Cavanagh,et al.  The reference frame of the motion aftereffect is retinotopic. , 2009, Journal of vision.

[8]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  L. Chelazzi,et al.  Reward Changes Salience in Human Vision via the Anterior Cingulate , 2010, The Journal of Neuroscience.

[10]  Zhicheng Lin.  Object-centered representations support flexible exogenous visual attention across translation and reflection , 2013, Cognition.

[11]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[12]  Patrick Cavanagh,et al.  The reference frame of the tilt aftereffect. , 2011, Journal of vision.

[13]  Sarah Shomstein,et al.  Shaping Attention With Reward , 2013, Psychological science.

[14]  Zhe Chen.  Object-based attention: A tutorial review , 2012, Attention, Perception, & Psychophysics.

[15]  Yuhong V. Jiang,et al.  Spatial reference frame of incidentally learned attention , 2013, Cognition.

[16]  Nancy Kanwisher,et al.  Cerebral Cortex doi:10.1093/cercor/bhr357 Higher Level Visual Cortex Represents Retinotopic, Not Spatiotopic, Object Location , 2011 .

[17]  Takatsune Kumada,et al.  Cross-dimensional interference and cross-trial inhibition , 2002, Perception & psychophysics.

[18]  R. M. Siegel,et al.  Maps of Visual Space in Human Occipital Cortex Are Retinotopic, Not Spatiotopic , 2008, The Journal of Neuroscience.

[19]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[20]  Thomas Geyer,et al.  Positional priming of visual pop-out search is supported by multiple spatial reference frames , 2015, Front. Psychol..

[21]  J Miller,et al.  Components of the location probability effect in visual search tasks. , 1988, Journal of experimental psychology. Human perception and performance.

[22]  Stefanie I. Becker,et al.  The stage of priming: Are intertrial repetition effects attentional or decisional? , 2008, Vision Research.

[23]  K Nakayama,et al.  Rapid, Object-Based Learning in the Deployment of Transient Attention , 2001, Perception.

[24]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[25]  Yuhong V Jiang,et al.  Body and head tilt reveals multiple frames of reference for spatial attention. , 2013, Journal of vision.

[26]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[27]  S. Shomstein,et al.  The Differential Effects of Reward on Space- and Object-Based Attentional Allocation , 2013, The Journal of Neuroscience.

[28]  Iain D. Gilchrist,et al.  Visual search and foraging compared in a large-scale search task , 2008, Cognitive Processing.

[29]  T. Schenk,et al.  Both egocentric and allocentric cues support spatial priming in visual search , 2009, Neuropsychologia.

[30]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[31]  B. Anderson.  Value-driven attentional capture is modulated by spatial context , 2015, Visual cognition.

[32]  Yuhong V. Jiang,et al.  What is learned in spatial contextual cuing— configuration or individual locations? , 2004, Perception & psychophysics.

[33]  H. Pashler,et al.  Repetition priming in visual search: Episodic retrieval, not feature priming , 2004, Memory & cognition.

[34]  B. Butler,et al.  Spatiotopic and retinotopic components of iconic memory , 1987, Psychological research.

[35]  Dominique Lamy,et al.  A dual-stage account of inter-trial priming effects , 2010, Vision Research.

[36]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[37]  Thomas Geyer,et al.  Positional priming of pop-out: a relational-encoding account. , 2010, Journal of vision.

[38]  Nancy Kanwisher,et al.  Retinotopic memory is more precise than spatiotopic memory , 2012, Proceedings of the National Academy of Sciences.

[39]  Morris Moscovitch,et al.  Object-Centered Neglect in Patients with Unilateral Neglect: Effects of Left-Right Coordinates of Objects , 1994, Journal of Cognitive Neuroscience.

[40]  J. Schall.  Neural Basis of Saccade Target Selection , 1995, Reviews in the neurosciences.

[41]  M. Behrmann,et al.  Spatial probability as an attentional cue in visual search , 2005, Perception & psychophysics.

[42]  Joseph Krummenacher,et al.  Cross-trial priming of element positions in visual pop-out search is dependent on stimulus arrangement. , 2007, Journal of experimental psychology. Human perception and performance.

[43]  Ken Nakayama,et al.  A primitive memory system for the deployment of transient attention , 2003, Perception & psychophysics.

[44]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[45]  Arash Afraz,et al.  Topography of the motion aftereffect with and without eye movements. , 2008, Journal of vision.

[46]  Maria Concetta Morrone,et al.  Spatiotopic coding and remapping in humans , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[47]  J. Theeuwes,et al.  Gradual Remapping Results in Early Retinotopic and Late Spatiotopic Inhibition of Return , 2010, Psychological science.

[48]  M. Hayhoe,et al.  Integration of Form across Saccadic Eye Movements , 1991, Perception.

[49]  Matthew D. Hilchey,et al.  Examining the dissociation of retinotopic and spatiotopic inhibition of return with event-related potentials , 2012, Neuroscience Letters.

[50]  Marlene Behrmann,et al.  Probability Cuing of Target Location Facilitates Visual Search Implicitly in Normal Participants and Patients with Hemispatial Neglect , 2002, Psychological science.

[51]  G. Campana,et al.  Where perception meets memory: A review of repetition priming in visual search tasks , 2010, Attention, perception & psychophysics.

[52]  Andrew B. Leber,et al.  What do fast response times tell us about attentional control? , 2013, Journal of vision.

[53]  H. Müller,et al.  Positional priming of pop-out is nested in visuospatial context. , 2013, Journal of vision.

[54]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[55]  S. Tipper,et al.  Object-centered not scene-based visual neglect. , 1996, Journal of experimental psychology. Human perception and performance.

[56]  Britt Anderson,et al.  Spatial Probability Aids Visual Stimulus Discrimination , 2010, Front. Hum. Neurosci..

[57]  Yuhong V Jiang,et al.  Spatial reference frame of attention in a large outdoor environment. , 2014, Journal of experimental psychology. Human perception and performance.

[58]  Wu Li,et al.  Spatiotopic perceptual learning mediated by retinotopic processing and attentional remapping , 2013, The European journal of neuroscience.

[59]  Iain D Gilchrist,et al.  Probabilistic cuing in large-scale environmental search. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[60]  A. Gorea,et al.  Location and identity memory of saccade targets , 2011, Vision Research.

[61]  Wilfried Kunde,et al.  Location-specific target expectancies in visual search , 1999 .

[62]  Jillian H. Fecteau,et al.  Exploring the consequences of the previous trial , 2003, Nature Reviews Neuroscience.

[63]  M. Goldberg,et al.  Attention, intention, and priority in the parietal lobe. , 2010, Annual review of neuroscience.

[64]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[65]  S. Tipper,et al.  Object-based and environment-based inhibition of return of visual attention. , 1994, Journal of experimental psychology. Human perception and performance.

[66]  Frans A. J. Verstraten,et al.  The motion aftereffect , 1998, Trends in Cognitive Sciences.

[67]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[68]  M. Hayhoe,et al.  Reference frames in saccadic targeting , 1997, Experimental Brain Research.

[69]  R. Baumeister,et al.  Self-regulation and depletion of limited resources: does self-control resemble a muscle? , 2000, Psychological bulletin.

[70]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[71]  Yuhong V Jiang,et al.  Visual search and location probability learning from variable perspectives. , 2013, Journal of vision.

[72]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[73]  Past rewards capture spatial attention and action choices , 2013, Experimental Brain Research.

[74]  H. Egeth,et al.  Inhibition of return to object-based and environment-based locations , 1994, Perception & psychophysics.

[75]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[76]  Julie D. Golomb,et al.  Attentional Facilitation throughout Human Visual Cortex Lingers in Retinotopic Coordinates after Eye Movements , 2010, The Journal of Neuroscience.

[77]  Matthew D. Hilchey,et al.  Oculomotor inhibition of return: How soon is it “recoded” into spatiotopic coordinates? , 2012, Attention, Perception, & Psychophysics.

[78]  K. Nakayama,et al.  On the Functional Role of Implicit Visual Memory for the Adaptive Deployment of Attention Across Scenes , 2000 .

[79]  Julie D. Golomb,et al.  The Native Coordinate System of Spatial Attention Is Retinotopic , 2008, The Journal of Neuroscience.

[80]  Patrick Cavanagh,et al.  Spatiotopic priming in visual search , 2010 .

[81]  Wu Li,et al.  Perceptual learning beyond retinotopic reference frame , 2010, Proceedings of the National Academy of Sciences.

[82]  K. Nakayama,et al.  The influence of object-relative visuomotor set on express saccades. , 2007, Journal of vision.

[83]  Iain D Gilchrist,et al.  Target location probability effects in visual search: an effect of sequential dependencies. , 2006, Journal of experimental psychology. Human perception and performance.

[84]  Julie D. Golomb,et al.  Robustness of the retinotopic attentional trace after eye movements. , 2010, Journal of vision.

[85]  L. Chelazzi,et al.  Altering Spatial Priority Maps via Reward-Based Learning , 2014, The Journal of Neuroscience.

[86]  Alison R. Lane,et al.  Spatial priming in visual search: memory for body-centred information , 2011, Experimental Brain Research.

[87]  A. Hillstrom.  Repetition effects in visual search , 2000, Perception & psychophysics.

[88]  Yale E. Cohen,et al.  A common reference frame for movement plans in the posterior parietal cortex , 2002, Nature Reviews Neuroscience.

[89]  David E. Irwin.  Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[90]  Amanda Ellison,et al.  A body-centred frame of reference drives spatial priming in visual search , 2010, Experimental Brain Research.

[91]  Umberto Castiello,et al.  Object-centred orienting of attention , 1995 .

[92]  Liwei Sun,et al.  Egocentric coding of space for incidentally learned attention: effects of scene context and task instructions. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[93]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.

[94]  G. Logan.  Toward an instance theory of automatization. , 1988 .

[95]  H. Müller,et al.  Distinct, but top-down modulable color and positional priming mechanisms in visual pop-out search , 2009, Psychological research.

[96]  T. Knapen,et al.  The spatial scale of perceptual memory in ambiguous figure perception. , 2009, Journal of vision.

[97]  D. Burr,et al.  Spatiotopic selectivity of BOLD responses to visual motion in human area MT , 2007, Nature Neuroscience.

[98]  Jillian H. Fecteau,et al.  Priming of pop-out depends upon the current goals of observers. , 2007, Journal of vision.

[99]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[100]  N. P. Bichot,et al.  Priming in Macaque Frontal Cortex during Popout Visual Search: Feature-Based Facilitation and Location-Based Inhibition of Return , 2002, The Journal of Neuroscience.

[101]  C. Colby,et al.  Trans-saccadic perception , 2008, Trends in Cognitive Sciences.

[102]  Julie D. Golomb,et al.  Attention doesn’t slide: spatiotopic updating after eye movements instantiates a new, discrete attentional locus , 2011, Attention, perception & psychophysics.

[103]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[104]  Dominique Lamy,et al.  Intertrial repetition affects perception: the role of focused attention. , 2010, Journal of vision.

[105]  Nancy Kanwisher,et al.  Feature-Binding Errors After Eye Movements and Shifts of Attention , 2014, Psychological science.

[106]  Colin W. G. Clifford,et al.  Corrections to: gaze categorization under uncertainty: psychophysics and modeling , 2013 .

[107]  S. Tipper,et al.  Object-based attentional mechanisms: Evidence from patients with unilateral neglect. , 1994 .