Transsaccadic memory: Building a stable world from glance to glance

Publisher Summary During natural viewing, the eye samples the visual environment using a series of jerking, saccadic eye movements, separated by periods of fixation. This raises the fundamental question of how information from separate fixations is integrated into a single, coherent percept. The chapter discusses two mechanisms that may be involved in generating the stable and continuous perception of the world. First, information about attended objects may be integrated across separate glances. To evaluate this possibility, it presents and discusses data showing the transsaccadic temporal integration of motion and form. The chapter also focuses on the potential role of the re-mapping of receptive fields around the time of saccades in transsaccadic integration and in the phenomenon of saccadic mislocalization. Second, information about multiple objects in a natural scene is built up across separate glances into a coherent representation of the environment. Experiments with naturalistic stimuli show that scene memory builds up across separate glances in working memory. The combination of saccadic re-mapping, occurring on a timescale of milliseconds, and a medium-term scene memory, operating over a span of several minutes, may underlie the subjective impression of a stable visual world.

[1]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[2]  Marco Piccolino,et al.  Flagging Early Examples of Ambiguity I , 2006, Perception.

[3]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[4]  S. Nishida Motion-Based Analysis of Spatial Patterns by the Human Visual System , 2004, Current Biology.

[5]  K. Clark Looking at Pictures , 1960 .

[6]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[7]  Edward E. Smith,et al.  Working Memory: A View from Neuroimaging , 1997, Cognitive Psychology.

[8]  David Melcher,et al.  Accumulation and persistence of memory for natural scenes. , 2006, Journal of vision.

[9]  Frans A. J. Verstraten,et al.  Visual transients without feature changes are sufficient for the percept of a change , 2004, Vision Research.

[10]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[11]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[12]  G. Loftus Eye fixations and recognition memory for pictures , 1972 .

[13]  Mark W. Becker,et al.  The Role of Iconic Memory in Change-Detection Tasks , 2000, Perception.

[14]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[15]  J M Findlay,et al.  Aperture Viewing*: A Review and a Synthesis , 1982, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[16]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[17]  Bertrand Gaymard,et al.  Cortical control of spatial memory in humans: The visuooculomotor model , 2002, Annals of neurology.

[18]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[19]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[20]  Shimon Ullman,et al.  Computational Studies in the Interpretation of Structure and Motion: Summary and Extension , 1983 .

[21]  I. Biederman Perceiving Real-World Scenes , 1972, Science.

[22]  J. Grimes On the failure to detect changes in scenes across saccades. , 1996 .

[23]  J. Henderson,et al.  Eye movements and visual memory: Detecting changes to saccade targets in scenes , 2003, Perception & psychophysics.

[24]  Kae Nakamura,et al.  Updating of the visual representation in monkey striate and extrastriate cortex during saccades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Iain D Gilchrist,et al.  Visual Memory for Objects in Natural Scenes: From Fixations to Object Files , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[26]  G R Loftus,et al.  Tachistoscopic simulations of eye fixations on pictures. , 1981, Journal of experimental psychology. Human learning and memory.

[27]  A. Hollingworth Constructing visual representations of natural scenes: the roles of short- and long-term visual memory. , 2004, Journal of experimental psychology. Human perception and performance.

[28]  B. Tatler Characterising the Visual Buffer: Real-World Evidence for Overwriting Early in Each Fixation , 2001, Perception.

[29]  Eileen Kowler,et al.  Visual scene memory and the guidance of saccadic eye movements , 2001, Vision Research.

[30]  D. Burr,et al.  Changes in visual perception at the time of saccades , 2001, Trends in Neurosciences.

[31]  D. Melcher,et al.  Implicit Attentional Selection of Bound Visual Features , 2005, Neuron.

[32]  I. Charo,et al.  Decreased lesion formation in CCR2−/− mice reveals a role for chemokines in the initiation of atherosclerosis , 1998, Nature.

[33]  D. Burr,et al.  Visual perception during saccades , 2004 .

[34]  Soon Chun Siong,et al.  Cortical Areas Involved in Object, Background, and Object-Background Processing Revealed with Functional Magnetic Resonance Adaptation , 2004, The Journal of Neuroscience.

[35]  S. Anstis,et al.  Distortions in moving figures viewed through a stationary slit. , 1967, The American journal of psychology.

[36]  Iain D Gilchrist,et al.  The Time Course of Abstract Visual Representation , 2003, Perception.

[37]  Ronald A. Rensink Seeing, sensing, and scrutinizing , 2000, Vision Research.

[38]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[39]  David E. Irwin,et al.  Evidence against visual integration across saccadic eye movements , 1983, Perception & psychophysics.

[40]  B. Bridgeman,et al.  Immediate post-saccadic information mediates space constancy , 1998, Vision Research.

[41]  D. Dennett,et al.  The Nature of Consciousness , 2006 .

[42]  Daniel C. Dennett,et al.  Time and the Observer , 1992 .

[43]  E. Rolls,et al.  Object, space, and object-space representations in the primate hippocampus. , 2005, Journal of neurophysiology.

[44]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[45]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[46]  Filip Germeys,et al.  Transsaccadic perception of saccade target and flanker objects. , 2002, Journal of experimental psychology. Human perception and performance.

[47]  Andy C. H. Lee,et al.  Specialization in the medial temporal lobe for processing of objects and scenes , 2005, Hippocampus.

[48]  W. E. Collins,et al.  Integrating pictorial information across eye movements. , 1984, Journal of experimental psychology. General.

[49]  E. J. Tehovnik,et al.  Eye Movements Modulate Visual Receptive Fields of V4 Neurons , 2001, Neuron.

[50]  Erik Blaser,et al.  Tracking an object through feature space , 2000, Nature.

[51]  David Melcher,et al.  Persistence of visual memory for scenes , 2001, Nature.

[52]  Fulvio Domini,et al.  Temporal integration in structure from motion. , 2002, Journal of experimental psychology. Human perception and performance.

[53]  D. Melcher Spatiotopic Transfer of Visual-Form Adaptation across Saccadic Eye Movements , 2005, Current Biology.

[54]  David E. Irwin,et al.  Integrating visual information from successive fixations. , 1982, Science.

[55]  D. Burr,et al.  Temporal integration of optic flow, measured by contrast and coherence thresholds , 2001, Vision Research.

[56]  R. Turner,et al.  Form and motion coherence activate independent, but not dorsal/ventral segregated, networks in the human brain , 2000, Current Biology.

[57]  G. McConkie,et al.  Is visual information integrated across successive fixations in reading? , 1979, Perception & psychophysics.

[58]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[59]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[60]  M. Goldberg,et al.  The time course of perisaccadic receptive field shifts in the lateral intraparietal area of the monkey. , 2003, Journal of neurophysiology.

[61]  G. Brelstaff,et al.  Is the Richness of Our Visual World an Illusion? Transsaccadic Memory for Complex Scenes , 1995, Perception.

[62]  Anna Ma-Wyatt,et al.  Saccades actively maintain perceptual continuity , 2004, Nature Neuroscience.

[63]  David Melcher,et al.  Spatiotopic temporal integration of visual motion across saccadic eye movements , 2003, Nature Neuroscience.

[64]  David C. Burr,et al.  Seeing biological motion , 1998, Nature.

[65]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[66]  J. Duncan Selective attention and the organization of visual information , 1984 .

[67]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[68]  Shinsuke Shimojo,et al.  Dynamic Shape Integration in Extrastriate Cortex , 2002, Current Biology.