Spatial memory and saccadic targeting in a natural task.

Previous work on transsaccadic memory and change blindness suggests that only a small part of the information in the visual scene is retained following a change in eye position. However, some visual representation across different fixation positions seems necessary to guide body movements. To understand what information is retained across gaze positions, it seems necessary to consider the functional demands of vision in ordinary behavior. We therefore examined eye and hand movements in a naturalistic task, where subjects copied a toy model in a virtual environment. Saccadic targeting performance was examined to see if subjects took advantage of regularities in the environment. During the first trials the spatial arrangement of the pieces used to copy the model was kept stable. In subsequent trials this arrangement was changed randomly every time the subject looked away. Results showed that about 20% of saccades went either directly to the location of the next component to be copied or to its old location before the change. There was also a significant increase in the total number of fixations required to locate a piece after a change, which could be accounted for by the corrective movements required after fixating the (incorrect) old location. These results support the idea that a detailed representation of the spatial structure of the environment is typically retained across fixations and used to guide eye movements.

[1]  H. Collewijn,et al.  The function of visual search and memory in sequential looking tasks , 1995, Vision Research.

[2]  David Melcher,et al.  Persistence of visual memory for scenes , 2001, Nature.

[3]  M. Hayhoe,et al.  Memory representations guide targeting eye movements in a natural task , 2000 .

[4]  K. Nakayama,et al.  Priming of popout: III. A short-term implicit memory system beneficial for rapid target selection , 2000 .

[5]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[6]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[7]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[8]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[9]  J. Henderson,et al.  Eye movements and visual memory: Detecting changes to saccade targets in scenes , 2003, Perception & psychophysics.

[10]  Ken Nakayama,et al.  A primitive memory system for the deployment of transient attention , 2003, Perception & psychophysics.

[11]  Daniel J. Simons,et al.  Current Approaches to Change Blindness , 2000 .

[12]  K. Nakayama,et al.  On the Functional Role of Implicit Visual Memory for the Adaptive Deployment of Attention Across Scenes , 2000 .

[13]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[14]  Mary Hayhoe,et al.  Spatial Memory and Integration Across Saccadic Eye Movements , 1992 .

[15]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[16]  D. Simons.  In Sight, Out of Mind: When Object Representations Fail , 1996 .

[17]  Michael S. Ambinder,et al.  Change blindness , 1997, Trends in Cognitive Sciences.

[18]  D. Simons,et al.  Failure to detect changes to attended objects in motion pictures , 1997 .

[19]  J. Wolfe.  Inattentional Amnesia , 2000 .

[20]  M. Goldberg,et al.  Oculocentric spatial representation in parietal cortex. , 1995, Cerebral cortex.

[21]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[22]  K. Verfaillie,et al.  Transsaccadic Coding of Object Position: Effects of Saccadic Status and Allocentric Reference Frame , 2001 .

[23]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[24]  Iain D Gilchrist,et al.  The Time Course of Abstract Visual Representation , 2003, Perception.

[25]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[26]  Alexander Pollatsek,et al.  What Is Integrated Across Fixations , 1992 .

[27]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[28]  O'Regan Jk,et al.  Integrating visual information from successive fixations: does trans-saccadic fusion exist? , 1983 .

[29]  Andrew Hollingworth,et al.  Global Transsaccadic Change Blindness During Scene Perception , 2003, Psychological science.

[30]  Joel M. Miller,et al.  Information used by the perceptual and oculomotor systems regarding the amplitude of saccadic and pursuit eye movements , 1980, Vision Research.

[31]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[32]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[33]  David E. Irwin.  Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[34]  J. O'Regan,et al.  Integrating visual information from successive fixations:Does trans-saccadic fusion exist? , 1983, Vision Research.

[35]  M. Hayhoe.  Vision Using Routines: A Functional Account of Vision , 2000 .

[36]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[37]  K. Verfaillie,et al.  Selective transsaccadic coding of object and event-diagnostic information , 2001 .

[38]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[39]  D. E. Irwin,et al.  Eye movements and scene perception: Memory for things observed , 2002, Perception & psychophysics.

[40]  David E. Irwin,et al.  Visual memory and the perception of a stable visual environment , 1990, Perception & psychophysics.

[41]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[42]  Eileen Kowler,et al.  Visual scene memory and the guidance of saccadic eye movements , 2001, Vision Research.

[43]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[44]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[45]  Robert M. McPeek,et al.  Saccades require focal attention and are facilitated by a short-term memory system , 1999, Vision Research.

[46]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[47]  J. Henderson,et al.  Change detection in the flicker paradigm: The role of fixation position within the scene , 2001, Memory & cognition.

[48]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[49]  K. Nakayama,et al.  Priming of popout: II. Role of position , 1996 .