Eye Movements and Visual Memory for Scenes

Abstract : In this chapter we discuss three types of memory that are relevant for understanding how scene representations are generated over the course of scene viewing. We focus particularly on scene memory generated dynamically across eye movements, and we highlight studies that record eye movements. We argue that the results of studies focusing on transsaccadic memory, active on-line scene memory, and long-term scene memory converge on the conclusion that relatively detailed visual scene representations are retained both over the short and long term, and that these representations are generated incidentally as a consequence of scene viewing.

[1]  G. Ritchey,et al.  Long-Term Memory for Pictures , 2005 .

[2]  G. Goodman.  Picture memory: How the action schema affects retention , 1980, Cognitive Psychology.

[3]  David E. Irwin,et al.  Failure to integrate information from successive fixations. , 1983, Science.

[4]  L. Stark,et al.  Omnidirectional increase in threshold for image shifts during saccadic eye movements , 1979, Perception & psychophysics.

[5]  J. Rensbergen,et al.  Perception and cognition : advances in eye movement research , 1995 .

[6]  A. Hollingworth.  Failures of retrieval and comparison constrain change detection in natural scenes. , 2003, Journal of experimental psychology. Human perception and performance.

[7]  David E. Irwin,et al.  Evidence against visual integration across saccadic eye movements , 1983, Perception & psychophysics.

[8]  J. Henderson,et al.  The Role of Fixation Position in Detecting Scene Changes Across Saccades , 1999 .

[9]  R. E. Parker.  Picture processing during recognition. , 1978, Journal of experimental psychology. Human perception and performance.

[10]  D. E. Irwin.  Memory for position and identity across eye movements. , 1992 .

[11]  K. Rayner,et al.  Effects of foveal priming and extrafoveal preview on object identification. , 1987, Journal of experimental psychology. Human perception and performance.

[12]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[13]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[14]  K. Rayner,et al.  Is visual information integrated across saccades? , 1983, Perception & psychophysics.

[15]  Refractor.  Vision , 2000, The Lancet.

[16]  J. Henderson.  Visual Attention and Eye Movement Control During Reading and Picture Viewing , 1992 .

[17]  David E. Irwin,et al.  Visual memory and the perception of a stable visual environment , 1990, Perception & psychophysics.

[18]  E. Boring.  A History of Experimental Psychology. , 1930 .

[19]  G. McConkie,et al.  Is visual information integrated across successive fixations in reading? , 1979, Perception & psychophysics.

[20]  Karl Verfaillie,et al.  The effect of stimulus blanking on the detection of intrasaccadic displacements of translating objects , 2002, Vision Research.

[21]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[22]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[23]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[24]  G. McConkie,et al.  Identifying the Span of the Effective Stimulus in Reading. Final Report. , 1974 .

[25]  David E. Irwin,et al.  Integrating visual information from successive fixations. , 1982, Science.

[26]  J. Henderson,et al.  Types and tokens in transsaccadic object identification: Effects of spatial position and left-right orientation , 2001, Psychonomic bulletin & review.

[27]  J. Henderson,et al.  Change detection in the flicker paradigm: The role of fixation position within the scene , 2001, Memory & cognition.

[28]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[29]  R. Shepard.  Recognition memory for words, sentences, and pictures , 1967 .

[30]  Howard S. Hock,et al.  Real-world schemata and scene recognition in adults and children , 1978 .

[31]  J. Feldman.  Four frames suffice: A provisional model of vision and space , 1985, Behavioral and Brain Sciences.

[32]  David E. Irwin,et al.  Visual masking and visual integration across saccadic eye movements. , 1988, Journal of experimental psychology. General.

[33]  A. Friedman.  Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[34]  Vincent Di Lollo,et al.  Temporal integration in visual memory. , 1980, Journal of experimental psychology. General.

[35]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[36]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[37]  J. Henderson,et al.  Two representational systems in dynamic visual identification. , 1994, Journal of experimental psychology. General.

[38]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[39]  Andrew Hollingworth,et al.  Global Transsaccadic Change Blindness During Scene Perception , 2003, Psychological science.

[40]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[41]  John M. Henderson,et al.  Transsaccadic Memory and Integration During Real-World Object Perception , 1997 .

[42]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[43]  J. Henderson,et al.  Semantic Informativeness Mediates the Detection of Changes in Natural Scenes , 2000 .

[44]  V. Lollo.  Temporal integration in visual memory. , 1980 .

[45]  J. Henderson,et al.  Incidental visual memory for objects in scenes , 2005 .

[46]  J. Grimes.  On the failure to detect changes in scenes across saccades. , 1996 .

[47]  John M. Henderson,et al.  The Influence of Enantiomorphic Transformation on Transsaccadic Object Integration , 1999 .

[48]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[49]  A Pollatsek,et al.  Role of spatial location in integration of pictorial information across saccades. , 1990, Journal of experimental psychology. Human perception and performance.

[50]  B. Julesz,et al.  The existence and role of retinotopic and spatiotopic forms of visual persistence. , 1982, Acta psychologica.

[51]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[52]  G. McConkie,et al.  Eye movements and integrating information across fixations. , 1978, Journal of experimental psychology. Human perception and performance.

[53]  Ronald A. Rensink.  Seeing, sensing, and scrutinizing , 2000, Vision Research.

[54]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[55]  J. Wolfe.  Inattentional Amnesia , 2000 .

[56]  T. Sejnowski,et al.  Egocentric Spaw Representation in Early Vision , 1993, Journal of Cognitive Neuroscience.

[57]  I. Thornton,et al.  Change Detection Without Awareness: Do Explicit Reports Underestimate the Representation of Change in the Visual System? , 2000 .

[58]  Laura A. Carlson-Radvansky.  Memory for relational information across eye movements , 1999, Perception & psychophysics.

[59]  David E. Irwin,et al.  The role of the saccade target object in the perception of a visually stable world , 2000, Perception & psychophysics.

[60]  B. Bridgeman,et al.  Failure to integrate visual information from successive fixations , 1983 .

[61]  James L. McClelland,et al.  Information integration in perception and communication , 1996 .

[62]  Terrence J. Sejnowski,et al.  Egocentric Spatial Representation in Early Vision , 1993 .

[63]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[64]  David E. Irwin,et al.  MEMORY FOR STRUCTURAL INFORMATION ACROSS EYE MOVEMENTS , 1995 .

[65]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[66]  Bruce Bridgeman,et al.  A theory of visual stability across saccadic eye movements , 1994, Behavioral and Brain Sciences.

[67]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[68]  R. Nickerson,et al.  SHORT-TERM MEMORY FOR COMPLEX MEANINGFUL VISUAL CONFIGURATIONS: A DEMONSTRATION OF CAPACITY. , 1965, Canadian journal of psychology.

[69]  Andrew Hollingworth,et al.  Eye Movements, Visual Memory, and Scene Representation , 2000 .

[70]  A. Trehub,et al.  Neuronal models for cognitive processes: networks for learning, perception and imagination. , 1977, Journal of theoretical biology.

[71]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[72]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[73]  Carrick C. Williams,et al.  To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes , 2001, Psychonomic bulletin & review.

[74]  D. Simons,et al.  Detecting Changes in Novel, Complex Three-dimensional Objects , 2000 .

[75]  Carrick C. Williams,et al.  Eye movements and picture processing during recognition , 2003, Perception & psychophysics.

[76]  K. Rayner,et al.  Covert visual attention and extrafoveal information use during object identification , 1989, Perception & psychophysics.

[77]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[78]  J. Henderson,et al.  Eye movements and visual memory: Detecting changes to saccade targets in scenes , 2003, Perception & psychophysics.

[79]  M D Anes,et al.  Roles of object-file review and type priming in visual identification within and across eye fixations. , 1994, Journal of experimental psychology. Human perception and performance.

[80]  Ronald A. Rensink.  The Dynamic Representation of Scenes , 2000 .

[81]  K. Rayner,et al.  Effects of Foveal Priming and Extrafoveal Preview on Object Identification , 1987 .

[82]  W. E. Collins,et al.  Integrating pictorial information across eye movements. , 1984, Journal of experimental psychology. General.

[83]  D. E. Irwin,et al.  Visual Memory Within and Across Fixations , 1992 .

[84]  J Stoeckert,et al.  Picture memory: recognizing added and deleted details. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[85]  R. E. Parker,et al.  Memory for descriptive and spatial information in complex pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[86]  W. Brewer,et al.  Role of schemata in memory for places , 1981, Cognitive Psychology.

[87]  A. O. Dick,et al.  Effect of eye movements on backward masking and perceived location , 1973 .

[88]  John M. Henderson,et al.  Two representational systems in dynamic visual identification. , 1994, Journal of experimental psychology. General.

[89]  David E. Irwin Robert D. Gordon.  Eye Movements, Attention and Trans-saccadic Memory , 1998 .

[90]  Alexander Pollatsek,et al.  What Is Integrated Across Fixations , 1992 .

[91]  H. P. Bahrick,et al.  Retention of visual and verbal codes of the same stimuli. , 1968, Journal of experimental psychology.

[92]  B. Bridgeman,et al.  Postsaccadic target blanking prevents saccadic suppression of image displacement , 1996, Vision Research.