To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes

What is the nature of the representation formed during the viewing of natural scenes? We tested two competing hypotheses regarding the accumulation of visual information during scene viewing. The first holds that coherent visual representations disintegrate as soon as attention is withdrawn from an object and thus that the visual representation of a scene is exceedingly impoverished. The second holds that visual representations do not necessarily decay upon the withdrawal of attention, but instead can be accumulated in memory from previously attended regions. Target objects in line drawings of natural scenes were changed during a saccadic eye movement away from those objects. Three findings support the second hypothesis. First, changes to the visual form of target objects (token substitution) were successfully detected, as indicated by both explicit and implicit measures, even though the target object was not attended when the change occurred. Second, these detections were often delayed until well after the change. Third, changes to semantically inconsistent target objects were detected better than changes to semantically consistent objects.

[1]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[2]  R. Nickerson,et al.  SHORT-TERM MEMORY FOR COMPLEX MEANINGFUL VISUAL CONFIGURATIONS: A DEMONSTRATION OF CAPACITY. , 1965, Canadian journal of psychology.

[3]  R. Shepard Recognition memory for words, sentences, and pictures , 1967 .

[4]  R. Haber,et al.  Perception and memory for pictures: Single-trial learning of 2500 visual stimuli , 1970 .

[5]  L. Standing Learning 10000 pictures , 1973 .

[6]  L. Standing Learning 10,000 pictures. , 1973, The Quarterly journal of experimental psychology.

[7]  A. O. Dick,et al.  Effect of eye movements on backward masking and perceived location , 1973 .

[8]  J. Antes The time course of picture viewing. , 1974, Journal of experimental psychology.

[9]  S. Palmer Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[10]  G. McConkie,et al.  Eye movements and integrating information across fixations. , 1978, Journal of experimental psychology. Human perception and performance.

[11]  R. E. Parker Picture processing during recognition. , 1978, Journal of experimental psychology. Human perception and performance.

[12]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[13]  A. Friedman Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[14]  G R Loftus,et al.  The functional visual field during picture viewing. , 1980, Journal of experimental psychology. Human learning and memory.

[15]  O'Regan Jk,et al.  Integrating visual information from successive fixations: does trans-saccadic fusion exist? , 1983 .

[16]  J. O'Regan,et al.  Integrating visual information from successive fixations:Does trans-saccadic fusion exist? , 1983, Vision Research.

[17]  K. Rayner,et al.  Is visual information integrated across saccades? , 1983, Perception & psychophysics.

[18]  David E. Irwin,et al.  Evidence against visual integration across saccadic eye movements , 1983, Perception & psychophysics.

[19]  W. E. Collins,et al.  Integrating pictorial information across eye movements. , 1984, Journal of experimental psychology. General.

[20]  J. Feldman Four frames suffice: A provisional model of vision and space , 1985, Behavioral and Brain Sciences.

[21]  J. Findlay,et al.  The Relationship between Eye Movements and Spatial Attention , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[22]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[23]  K. Rayner,et al.  Covert visual attention and extrafoveal information use during object identification , 1989, Perception & psychophysics.

[24]  Kathy Pezdek,et al.  Memory for Real-World Scenes: The Role of Consistency With Schema Expectation , 1989 .

[25]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[26]  Alexander Pollatsek,et al.  What Is Integrated Across Fixations , 1992 .

[27]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[28]  K. Rayner Eye movements and visual cognition : scene perception and reading , 1992 .

[29]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[30]  D. E. Irwin,et al.  Visual Memory Within and Across Fixations , 1992 .

[31]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[32]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[33]  David E. Irwin,et al.  MEMORY FOR STRUCTURAL INFORMATION ACROSS EYE MOVEMENTS , 1995 .

[34]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[35]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[36]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[37]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[38]  J. Grimes On the failure to detect changes in scenes across saccades. , 1996 .

[39]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[40]  D. Simons,et al.  CHAPTER 13 – Change Blindness , 2005 .

[41]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[42]  John M. Henderson,et al.  Transsaccadic Memory and Integration During Real-World Object Perception , 1997 .

[43]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[44]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[45]  J. Henderson,et al.  The Role of Fixation Position in Detecting Scene Changes Across Saccades , 1999 .

[46]  Laura A. Carlson-Radvansky Memory for relational information across eye movements , 1999, Perception & psychophysics.

[47]  John M. Henderson,et al.  The Influence of Enantiomorphic Transformation on Transsaccadic Object Integration , 1999 .

[48]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[49]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[50]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[51]  Ronald A. Rensink Seeing, sensing, and scrutinizing , 2000, Vision Research.

[52]  D. Simons,et al.  Detecting Changes in Novel, Complex Three-dimensional Objects , 2000 .

[53]  J. Henderson,et al.  Semantic Informativeness Mediates the Detection of Changes in Natural Scenes , 2000 .

[54]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[55]  J. Wolfe Inattentional Amnesia , 2000 .

[56]  Daniel J. Simons,et al.  Current Approaches to Change Blindness , 2000 .

[57]  Andrew Hollingworth,et al.  Eye Movements, Visual Memory, and Scene Representation , 2000 .

[58]  I. Thornton,et al.  Change Detection Without Awareness: Do Explicit Reports Underestimate the Representation of Change in the Visual System? , 2000 .

[59]  J. Henderson,et al.  Types and tokens in transsaccadic object identification: Effects of spatial position and left-right orientation , 2001, Psychonomic bulletin & review.

[60]  J. Henderson,et al.  Change detection in the flicker paradigm: The role of fixation position within the scene , 2001, Memory & cognition.

[61]  Refractor Vision , 2000, The Lancet.

[62]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[63]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .