Eye scanpaths during visual imagery reenact those of perception of the same visual scene

Eye movements during mental imagery are not epiphenomenal but assist the process of image generation. Commands to the eyes for each fixation are stored along with the visual representation and are used as spatial index in a motor-based coordinate system for the proper arrangement of parts of an image. In two experiments, subjects viewed an irregular checkerboard or color pictures of fish and were subsequently asked to form mental images of these stimuli while keeping their eyes open. During the perceptual phase, a group of subjects was requested to maintain fixation onto the screen’s center, whereas another group was free to inspect the stimuli. During the imagery phase, all of these subjects were free to move their eyes. A third group of subjects (in Experiment 2) was free to explore the pattern but was requested to maintain central fixation during imagery. For subjects free to explore the pattern, the percentage of time spent fixating a specific location during perception was highly correlated with the time spent on the same (empty) locations during imagery. The order of scanning of these locations during imagery was correlated to the original order during perception. The strength of relatedness of these scanpaths and the vividness of each image predicted performance accuracy. Subjects who fixed their gaze centrally during perception did the same spontaneously during imagery. Subjects free to explore during perception, but maintaining central fixation during imagery, showed decreased ability to recall the pattern. We conclude that the eye scanpaths during visual imagery reenact those of perception of the same visual scene and that they play a functional role. © 2002 Cognitive Science Society, Inc. All rights reserved. * Corresponding author. Tel.: 1-47-77646372; fax: 1-47-77645291. E-mail address: bruno@psyk.uit.no (B. Laeng). http://www.elsevier.com/locate/cogsci Cognitive Science 26 (2002) 207—231 0364-0213/02/$ – see front matter © 2002 Cognitive Science Society, Inc. All rights reserved. PII: S0364-0213(01)00065-9

[1]  D. E. Irwin.  Integrating Information Across Saccadic Eye Movements , 1996 .

[2]  Nigel J. T. Thomas.  Are theories of imagery theories of imagination?: An active perception approach to conscious mental content , 1999 .

[3]  Janellen Huttenlocher,et al.  Constructing spatial images: A strategy in reasoning. , 1968 .

[4]  M. Posner.  Chronometric explorations of mind : the third Paul M. Fitts lectures, delivered at the University of Michigan, September 1976 , 1978 .

[5]  R. W. Kentridge,et al.  Independent contributions of the orienting of attention, fixation offset and bilateral stimulation on human saccadic latencies , 2004, Experimental Brain Research.

[6]  R. Haber,et al.  Contemporary theory and research in visual perception , 1970 .

[7]  David E. Irwin Robert D. Gordon.  Eye Movements, Attention and Trans-saccadic Memory , 1998 .

[8]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[9]  L. Stark,et al.  Ocular proprioception and efference copy in registering visual direction , 1991, Vision Research.

[10]  S. Kosslyn.  Image and mind , 1982 .

[11]  Susan L. Weiner,et al.  Ocular motility and cognitive process , 1976, Cognition.

[12]  K. Rayner,et al.  Covert visual attention and extrafoveal information use during object identification , 1989, Perception & psychophysics.

[13]  J. G. Quinn,et al.  Movement and Attention in Visual Working Memory , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[14]  Stephen M Kosslyn,et al.  Sequential processes in image generation , 1988, Cognitive Psychology.

[15]  G. Loftus.  Eye fixations and recognition memory for pictures , 1972 .

[16]  A. Glenberg,et al.  Averting the gaze disengages the environment and facilitates remembering , 1998, Memory & cognition.

[17]  S M Kosslyn,et al.  Is time to scan visual images due to demand characteristics? , 1985, Memory & cognition.

[18]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[19]  J. Antrobus,et al.  Looking with the mind's eye: experimental studies of ocular motility during daydreaming and mental arithmetic. , 1971, Transactions of the New York Academy of Sciences.

[20]  S. Kosslyn,et al.  Identifying objects in conventional and contorted poses: contributions of hemisphere-specific mechanisms , 1999, Cognition.

[21]  G R Loftus,et al.  Tachistoscopic simulations of eye fixations on pictures. , 1981, Journal of experimental psychology. Human learning and memory.

[22]  M. J. Intons-Peterson,et al.  Sensory-perceptual qualities of images. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[23]  J. Roll,et al.  Eye and neck proprioceptive messages contribute to the spatial coding of retinal input in visually oriented activities , 2004, Experimental Brain Research.

[24]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[25]  Z. Pylyshyn.  The imagery debate: Analogue media versus tacit knowledge. , 1981 .

[26]  M. J. Intons-Peterson,et al.  Imagery paradigms: how vulnerable are they to experimenters' expectations? , 1983, Journal of experimental psychology. Human perception and performance.

[27]  S. Kosslyn.  Seeing and imagining in the cerebral hemispheres: a computational approach. , 1987, Psychological review.

[28]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[29]  D. Hebb.  Concerning imagery. , 1968, Psychological review.

[30]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[31]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[32]  G. McConkie,et al.  Eye movements and integrating information across fixations. , 1978, Journal of experimental psychology. Human perception and performance.

[33]  S Edelman,et al.  A model of visual recognition and categorization. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[34]  R. Shepard,et al.  Functional representations common to visual perception and imagination. , 1978, Journal of experimental psychology. Human perception and performance.

[35]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.

[36]  D. F. Marks,et al.  Visual imagery differences in the recall of pictures. , 1973, British journal of psychology.

[37]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[38]  Ulric Neisser,et al.  SOME VARIABLES AFFECTING THE VIVIDNESS OF IMAGERY IN RECALL , 1969 .

[39]  William C. Ogden,et al.  Attended and unattended processing modes: The role of set for spatial location , 2014 .

[40]  E. Rolls.  High-level vision: Object recognition and visual cognition, Shimon Ullman. MIT Press, Bradford (1996), ISBN 0 262 21013 4 , 1997 .

[41]  Carlo Umiltà,et al.  Differential effects of central and peripheral cues on the reorienting of spatial attention. , 1991 .

[42]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[43]  S Pinker,et al.  Spontaneous imagery scanning in mental extrapolation. , 1982, Journal of experimental psychology. Learning, memory, and cognition.