Look-ahead fixations: anticipatory eye movements in natural tasks

During performance of natural tasks subjects sometimes fixate objects that are manipulated several seconds later. Such early looks are known as “look-ahead fixations” (Pelz and Canosa in Vision Res 41(25–26):3587–3596, 2001). To date, little is known about their function. To investigate the possible role of these fixations, we measured fixation patterns in a model-building task. Subjects assembled models in two sequences where reaching and grasping were interrupted in one sequence by an additional action. Results show look-ahead fixations prior to 20% of the reaching and grasping movements, occurring on average 3 s before the reach. Their frequency was influenced by task sequence, suggesting that they are purposeful and have a role in task planning. To see if look-aheads influenced the subsequent eye movement during the reach, we measured eye-hand latencies and found they increased by 122 ms following a look-ahead to the target. The initial saccades to the target that accompanied a reach were also more accurate following a look-ahead. These results demonstrate that look-aheads influence subsequent visuo-motor coordination, and imply that visual information on the temporal and spatial structure of the scene was retained across intervening fixations and influenced subsequent movement programming. Additionally, head movements that accompanied look-aheads were significantly smaller in amplitude (by 10°) than those that accompanied reaches to the same locations, supporting previous evidence that head movements play a role in the control of hand movements. This study provides evidence of the anticipatory use of gaze in acquiring information about objects for future manipulation.

[1]  O'Regan Jk,et al.  Integrating visual information from successive fixations: does trans-saccadic fusion exist? , 1983 .

[2]  Integrating visual information from successive fixations:Does trans-saccadic fusion exist? , 1983, Vision Research.

[3]  M. Jeannerod The neural and behavioural organization of goal-directed movements , 1990, Psychological Medicine.

[4]  David E. Irwin,et al.  Visual memory and the perception of a stable visual environment , 1990, Perception & psychophysics.

[5]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[6]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[7]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  K. Rayner Eye movements and visual cognition : scene perception and reading , 1992 .

[9]  Mary Hayhoe,et al.  Spatial Memory and Integration Across Saccadic Eye Movements , 1992 .

[10]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[11]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[12]  H. Collewijn,et al.  The function of visual search and memory in sequential looking tasks , 1995, Vision Research.

[13]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[14]  Michael W. Montgomery,et al.  Analysis of a disorder of everyday action , 1995 .

[15]  D. Sparks,et al.  Combined eye-head gaze shifts produced by electrical stimulation of the superior colliculus in rhesus monkeys. , 1996, Journal of neurophysiology.

[16]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[17]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  A E Patla,et al.  Where and when do we look as we approach and step over an obstacle in the travel path? , 1997, Neuroreport.

[19]  G. Humphreys,et al.  Disordered action schema and action disorganisation syndrome , 1998 .

[20]  F Bremmer,et al.  Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. , 1998, Journal of neurophysiology.

[21]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[22]  A. Berthoz,et al.  Reaching beyond reach , 1999, Experimental Brain Research.

[23]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[24]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[25]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[26]  D. Coppola,et al.  Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments , 1999, Vision Research.

[27]  M. Hayhoe Vision Using Routines: A Functional Account of Vision , 2000 .

[28]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[29]  K. Nakayama,et al.  On the Functional Role of Implicit Visual Memory for the Adaptive Deployment of Attention Across Scenes , 2000 .

[30]  C. Kennard,et al.  The Strategic Control of Gaze Direction in the Tower of London Task , 2000, Journal of Cognitive Neuroscience.

[31]  D P Carey,et al.  Eye–hand coordination: Eye to hand or hand to eye? , 2000, Current Biology.

[32]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[33]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[34]  K. Verfaillie,et al.  Transsaccadic Coding of Object Position: Effects of Saccadic Status and Allocentric Reference Frame , 2001 .

[35]  Eileen Kowler,et al.  Visual scene memory and the guidance of saccadic eye movements , 2001, Vision Research.

[36]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[37]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[38]  R. Johansson,et al.  Engagement of gaze in capturing targets for future sequential manual actions. , 2002, Journal of neurophysiology.

[39]  J. Kohno,et al.  Visualization of the tidal flow in Sasebo and Oomura Bays , 2002 .

[40]  Anthony R. Dickinson,et al.  Non-spatial, motor-specific activation in posterior parietal cortex , 2002, Nature Neuroscience.

[41]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[42]  Glyn W Humphreys,et al.  Dissociations in Routine Behaviour across Patients and Everyday Tasks , 2002, Neurocase.

[43]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[44]  Jun Tanji,et al.  Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and Pre-SMA of monkeys. , 2002, Journal of neurophysiology.

[45]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[46]  Iain D Gilchrist,et al.  The Time Course of Abstract Visual Representation , 2003, Perception.

[47]  Jeff B. Pelz,et al.  Head movement estimation for wearable eye tracker , 2004, ETRA.

[48]  D. Ballard,et al.  Goal-directed arm movements change eye-head coordination , 1996, Experimental Brain Research.

[49]  G. Humphreys,et al.  Disordered Knowledge of Action Order in Action Disorganisation Syndrome , 2004, Neurocase.

[50]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[51]  Dana H. Ballard,et al.  Modeling the Brain's Operating System , 2005, BVAI.

[52]  Mary M Hayhoe,et al.  Spatial memory and saccadic targeting in a natural task. , 2005, Journal of vision.