Automatic frame-centered object representation and integration revealed by iconic memory, visual priming, and backward masking.

Object identities ("what") and their spatial locations ("where") are processed in distinct pathways in the visual system, raising the question of how the what and where information is integrated. Because of object motions and eye movements, the retina-based representations are unstable, necessitating nonretinotopic representation and integration. A potential mechanism is to code and update objects according to their reference frames (i.e., frame-centered representation and integration). To isolate frame-centered processes, in a frame-to-frame apparent motion configuration, we (a) presented two preceding or trailing objects on the same frame, equidistant from the target on the other frame, to control for object-based (frame-based) effect and space-based effect, and (b) manipulated the target's relative location within its frame to probe frame-centered effect. We show that iconic memory, visual priming, and backward masking depend on objects' relative frame locations, orthogonal of the retinotopic coordinate. These findings not only reveal that iconic memory, visual priming, and backward masking can be nonretinotopic but also demonstrate that these processes are automatically constrained by contextual frames through a frame-centered mechanism. Thus, object representation is robustly and automatically coupled to its reference frame and continuously being updated through a frame-centered, location-specific mechanism. These findings lead to an object cabinet framework, in which objects ("files") within the reference frame ("cabinet") are orderly coded relative to the frame.

[1]  M. Grabowecky,et al.  Rapid eye-fixation training without eyetracking , 2009, Psychonomic bulletin & review.

[2]  J Miller,et al.  Components of the location probability effect in visual search tasks. , 1988, Journal of experimental psychology. Human perception and performance.

[3]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[4]  Patrick Cavanagh,et al.  Mobile computation: spatiotemporal integration of the properties of objects in motion. , 2008, Journal of vision.

[5]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[6]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Carl R Olson,et al.  Brain representation of object-centered space in monkeys and humans. , 2003, Annual review of neuroscience.

[8]  B Hommel,et al.  A Simon effect induced by induced motion and location: Evidence for a direct linkage of cognitive and motor maps , 2001, Perception & psychophysics.

[9]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[10]  Michael H. Herzog,et al.  Nonretinotopic Exogenous Attention , 2011, Current Biology.

[11]  R. Knight,et al.  Prefrontal Cortex Lesions Impair Object-Spatial Integration , 2012, PloS one.

[12]  M. Bradshaw,et al.  Endogenous Shifts of Covert Attention Operate within Multiple Coordinate Frames: Evidence from a Feature-Priming Task , 2003, Perception.

[13]  Weimin Mou,et al.  Allocentric and egocentric updating of spatial memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[14]  V. S. Ramachandran,et al.  Visual attention modulates metacontrast masking , 1995, Nature.

[15]  R. Rafal,et al.  Axis-based neglect of visual shapes , 1994, Neuropsychologia.

[16]  Mingsha Zhang,et al.  Asymmetric Influence of Egocentric Representation onto Allocentric Perception , 2012, The Journal of Neuroscience.

[17]  D. E. Irwin Integrating Information Across Saccadic Eye Movements , 1996 .

[18]  Bruce Bridgeman,et al.  The induced Roelofs effect: two visual systems or the shift of a single reference frame? , 2004, Vision Research.

[19]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[20]  S. Thompson-Schill,et al.  Conceptual Penetration of Visual Processing , 2010, Psychological science.

[21]  J. Enns,et al.  Object Substitution: A New Form of Masking in Unattended Visual Locations , 1997 .

[22]  Paul Dassonville,et al.  Perception, Action, and Roelofs Effect: A Mere Illusion of Dissociation , 2004, PLoS biology.

[23]  S. Tipper,et al.  Object-centered not scene-based visual neglect. , 1996, Journal of experimental psychology. Human perception and performance.

[24]  M. Hayhoe,et al.  Integration of Form across Saccadic Eye Movements , 1991, Perception.

[25]  J. Kruschke,et al.  The perception of causality: Feature binding in interacting objects , 1996 .

[26]  Joseph Krummenacher,et al.  A (fascinating) litmus test for human retino- vs. non-retinotopic processing. , 2009, Journal of vision.

[27]  S. Nishida,et al.  Human Visual System Integrates Color Signals along a Motion Trajectory , 2007, Current Biology.

[28]  Maria Concetta Morrone,et al.  "Non-retinotopic processing" in Ternus motion displays modeled by spatiotemporal filters. , 2012, Journal of vision.

[29]  J. Enns,et al.  What’s new in visual masking? , 2000, Trends in Cognitive Sciences.

[30]  N. Burgess,et al.  Spatial memory: how egocentric and allocentric combine , 2006, Trends in Cognitive Sciences.

[31]  John D. Mollon,et al.  Enhanced discrimination at a perceptual category boundary: Subjective and performance measures are concomitantly shifted by chromatic adaptation. , 2012 .

[32]  H. A. Witkin,et al.  Studies in space orientation; further experiments on perception of the upright with displaced visual fields. , 1948, Journal of experimental psychology.

[33]  Ingrid R Olson,et al.  Remembering “what” brings along “where” in visual working memory , 2005, Perception & psychophysics.

[34]  Andrew Hollingworth,et al.  Binding objects to locations: the relationship between object files and visual working memory. , 2010, Journal of experimental psychology. Human perception and performance.

[35]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[36]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[37]  C R Olson,et al.  Object-centered direction selectivity in the macaque supplementary eye field , 1995, Science.

[38]  E. Spelke,et al.  Human Spatial Representation: Insights from Animals , 2002 .

[39]  K Nakayama,et al.  Rapid, Object-Based Learning in the Deployment of Transient Attention , 2001, Perception.

[40]  Marco Boi,et al.  Motion and tilt aftereffects occur largely in retinal, not in object, coordinates in the Ternus-Pikler display. , 2011, Journal of vision.

[41]  A. Mack Inattentional Blindness , 2003 .

[42]  C. Moore,et al.  When the target becomes the mask: using apparent motion to isolate the object-level component of object substitution masking. , 2003, Journal of experimental psychology. Human perception and performance.

[43]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[44]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[45]  Arnulf Remole,et al.  VISUAL MASKING: AN INTEGRATIVE APPROACH , 1985 .

[46]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[47]  A. Hollingworth Object-position binding in visual memory for natural scenes and object arrays. , 2007, Journal of experimental psychology. Human perception and performance.

[48]  Howard S. Hock,et al.  Real-world schemata and scene recognition in adults and children , 1978 .

[49]  Maria Concetta Morrone,et al.  Spatiotopic coding and remapping in humans , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  C. Colby,et al.  Trans-saccadic perception , 2008, Trends in Cognitive Sciences.

[51]  B. Bridgeman,et al.  Interaction of cognitive and sensorimotor maps of visual space , 1997, Perception & psychophysics.

[52]  A. Treisman Perceiving and re-perceiving objects. , 1992, The American psychologist.

[53]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[54]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[55]  Haluk Öğmen,et al.  Perceptual grouping induces non-retinotopic feature attribution in human vision , 2006, Vision Research.

[56]  Nancy Kanwisher,et al.  The distribution of category and location information across object-selective regions in human visual cortex , 2008, Proceedings of the National Academy of Sciences.

[57]  Yi Chen,et al.  Encoding the identity and location of objects in human LOC , 2011, NeuroImage.

[58]  M. Chun,et al.  Asymmetric object substitution masking. , 2001, Journal of experimental psychology. Human perception and performance.

[59]  Roger C. Schank,et al.  Conceptual Information Processing , 2014 .

[60]  Junji Watanabe,et al.  Veridical perception of moving colors by trajectory integration of input signals. , 2007, Journal of vision.

[61]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[62]  G. F. Tremblay,et al.  The Prefrontal Cortex , 1989, Neurology.

[63]  J M Mandler,et al.  Some of the thousand words a picture is worth. , 1976, Journal of experimental psychology. Human learning and memory.

[64]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[65]  S. Ullman The Interpretation of Visual Motion , 1979 .

[66]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[67]  N Weisstein,et al.  Visual Detection of Line Segments: An Object-Superiority Effect , 1974, Science.

[68]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[69]  Umberto Castiello,et al.  Object-centred orienting of attention , 1995 .

[70]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[71]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .