Eye movements and visual memory: Detecting changes to saccade targets in scenes

Saccade-contingent change detection provides a powerful tool for investigating scene representation and scene memory. In the present study, critical objects presented within color images of naturalistic scenes were changed during a saccade toward or away from the target. During the saccade, the critical object was changed to another object type, to a visually different token of the same object type, or was deleted from the scene. There were three main results. First, the deletion of a saccade target was special: Detection performance for saccade target deletions was very good, and this level of performance did not decline with the amplitude of the saccade. In contrast, detection of type and token changes at the saccade target, and of all changes including deletions at a location that had just been fixated but was not the saccade target, decreased as the amplitude of the saccade increased. Second, detection performance for type and token changes, both when the changing object was the target of the saccade and when the object had just been fixated but was not the saccade target, was well above chance. Third, mean gaze durations were reliably elevated for those trials in which the change was not overtly detected.

[1]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[2]  M. Tinker How People Look at Pictures. , 1936 .

[3]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[4]  R. Shepard Recognition memory for words, sentences, and pictures , 1967 .

[5]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[6]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[7]  R. Haber,et al.  Perception and memory for pictures: Single-trial learning of 2500 visual stimuli , 1970 .

[8]  S. Palmer Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[9]  G. McConkie,et al.  Eye movements and integrating information across fixations. , 1978, Journal of experimental psychology. Human perception and performance.

[10]  A. Friedman Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[11]  G R Loftus,et al.  The functional visual field during picture viewing. , 1980, Journal of experimental psychology. Human learning and memory.

[12]  B. Julesz,et al.  The existence and role of retinotopic and spatiotopic forms of visual persistence. , 1982, Acta psychologica.

[13]  H D Crane,et al.  Generation-V dual-Purkinje-image eyetracker. , 1985, Applied optics.

[14]  J. Findlay,et al.  The Relationship between Eye Movements and Spatial Attention , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[15]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[16]  Z. Pylyshyn The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[17]  K. Rayner,et al.  Covert visual attention and extrafoveal information use during object identification , 1989, Perception & psychophysics.

[18]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[19]  Alexander Pollatsek,et al.  What Is Integrated Across Fixations , 1992 .

[20]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[21]  K. Rayner Eye movements and visual cognition : scene perception and reading , 1992 .

[22]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[23]  D. E. Irwin,et al.  Visual Memory Within and Across Fixations , 1992 .

[24]  P. Dixon,et al.  On the nature of the span of apprehension , 1993 .

[25]  D. E. Irwin,et al.  A localist evaluation solution for visual stability across saccades , 1994, Behavioral and Brain Sciences.

[26]  M D Anes,et al.  Roles of object-file review and type priming in visual identification within and across eye fixations. , 1994, Journal of experimental psychology. Human perception and performance.

[27]  J. Henderson,et al.  Two representational systems in dynamic visual identification. , 1994, Journal of experimental psychology. General.

[28]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[29]  David E. Irwin,et al.  MEMORY FOR STRUCTURAL INFORMATION ACROSS EYE MOVEMENTS , 1995 .

[30]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[31]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[32]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[33]  James L. McClelland,et al.  Information integration in perception and communication , 1996 .

[34]  J. Grimes On the failure to detect changes in scenes across saccades. , 1996 .

[35]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[36]  J. Henderson,et al.  Object identification without foveal vision: Evidence from an artificial scotoma paradigm , 1997, Perception & psychophysics.

[37]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[38]  John M. Henderson,et al.  Transsaccadic Memory and Integration During Real-World Object Perception , 1997 .

[39]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[40]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[41]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[42]  G. Underwood Eye guidance in reading and scene perception , 1998 .

[43]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[44]  J. Henderson,et al.  The Role of Fixation Position in Detecting Scene Changes Across Saccades , 1999 .

[45]  Laura A. Carlson-Radvansky Memory for relational information across eye movements , 1999, Perception & psychophysics.

[46]  John M. Henderson,et al.  The Influence of Enantiomorphic Transformation on Transsaccadic Object Integration , 1999 .

[47]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[48]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[49]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[50]  Ronald A. Rensink Seeing, sensing, and scrutinizing , 2000, Vision Research.

[51]  D. Simons,et al.  Detecting Changes in Novel, Complex Three-dimensional Objects , 2000 .

[52]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[53]  K Verfaillie,et al.  Transsaccadic memory for position and orientation of saccade source and target. , 2000, Journal of experimental psychology. Human perception and performance.

[54]  J. Wolfe Inattentional Amnesia , 2000 .

[55]  David E. Irwin,et al.  The role of the saccade target object in the perception of a visually stable world , 2000, Perception & psychophysics.

[56]  Andrew Hollingworth,et al.  Eye Movements, Visual Memory, and Scene Representation , 2000 .

[57]  Zenon W. Pylyshyn,et al.  Situating vision in the world , 2000, Trends in Cognitive Sciences.

[58]  I. Thornton,et al.  Change Detection Without Awareness: Do Explicit Reports Underestimate the Representation of Change in the Visual System? , 2000 .

[59]  J. Henderson,et al.  Types and tokens in transsaccadic object identification: Effects of spatial position and left-right orientation , 2001, Psychonomic bulletin & review.

[60]  J. Henderson,et al.  Change detection in the flicker paradigm: The role of fixation position within the scene , 2001, Memory & cognition.

[61]  Carrick C. Williams,et al.  To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes , 2001, Psychonomic bulletin & review.

[62]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[63]  Laura A. Carlson,et al.  Transsaccadic Coding of Multiple Objects and Features , 2001 .

[64]  Refractor Vision , 2000, The Lancet.

[65]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[66]  Michael L. Peterson,et al.  Perception of Faces, Objects, and Scenes: Analytic and Holistic Processes (335-355) , 2006 .

[67]  Michael S. Ambinder,et al.  Change blindness , 1997, Trends in Cognitive Sciences.