Updating visual memory across eye movements for ocular and arm motor control.

Remembered object locations are stored in an eye-fixed reference frame, so that every time the eyes move, spatial representations must be updated for the arm-motor system to reflect the target's new relative position. To date, studies have not investigated how the brain updates these spatial representations during other types of eye movements, such as smooth-pursuit. Further, it is unclear what information is used in spatial updating. To address these questions we investigated whether remembered locations of pointing targets are updated following smooth-pursuit eye movements, as they are following saccades, and also investigated the role of visual information in estimating eye-movement amplitude for updating spatial memory. Misestimates of eye-movement amplitude were induced when participants visually tracked stimuli presented with a background that moved in either the same or opposite direction of the eye before pointing or looking back to the remembered target location. We found that gaze-dependent pointing errors were similar following saccades and smooth-pursuit and that incongruent background motion did result in a misestimate of eye-movement amplitude. However, the background motion had no effect on spatial updating for pointing, but did when subjects made a return saccade, suggesting that the oculomotor and arm-motor systems may rely on different sources of information for spatial updating.

[1]  Daniela Zambarbieri,et al.  Saccade latency toward auditory targets depends on the relative position of the sound source with respect to the eyes , 1995, Vision Research.

[2]  G. S. Russo,et al.  Frontal eye field activity preceding aurally guided saccades. , 1994, Journal of neurophysiology.

[3]  L E Mays,et al.  Neurons in monkey parietal area LIP are tuned for eye-movement parameters in three-dimensional space. , 1995, Journal of neurophysiology.

[4]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[5]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[6]  W Pieter Medendorp,et al.  Motion Parallax Is Computed in the Updating of Human Spatial Memory , 2003, The Journal of Neuroscience.

[7]  M. Schlag-Rey,et al.  Saccades can be aimed at the spatial location of targets flashed during pursuit. , 1990, Journal of neurophysiology.

[8]  R. Krauzlis The Control of Voluntary Eye Movements: New Perspectives , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[9]  W Pieter Medendorp,et al.  Rotational Remapping in Human Spatial Memory during Eye and Head Motion , 2002, The Journal of Neuroscience.

[10]  V. Mountcastle,et al.  Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. , 1975, Journal of neurophysiology.

[11]  P. E. Hallett,et al.  Saccadic eye movements towards stimuli triggered by prior saccades , 1976, Vision Research.

[12]  Lawrence H Snyder,et al.  Spatial memory following shifts of gaze. I. Saccades to memorized world-fixed and gaze-fixed targets. , 2003, Journal of neurophysiology.

[13]  Nuo Li,et al.  Updating Visual Space during Motion in Depth , 2005, Neuron.

[14]  Aldo Genovesio,et al.  Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates. , 2004, Journal of neurophysiology.

[15]  Francesco Lacquaniti,et al.  Cognitive allocentric representations of visual space shape pointing errors , 2002, Experimental Brain Research.

[16]  O. Bock,et al.  Contribution of retinal versus extraretinal signals towards visual localization in goal-directed movements , 2004, Experimental Brain Research.

[17]  J. Hyvärinen Posterior parietal lobe of the primate brain. , 1982, Physiological reviews.

[18]  Lawrence H Snyder,et al.  A neural network model of flexible spatial updating. , 2004, Journal of neurophysiology.

[19]  R. Krauzlis,et al.  Shared motion signals for human perceptual decisions and oculomotor actions. , 2003, Journal of vision.

[20]  P. Brunet,et al.  Infarcts of both inferior parietal lobules with impairment of visually guided eye movements, peripheral visual inattention and optic ataxia. , 1986, Brain : a journal of neurology.

[21]  M. Goldberg,et al.  Activity of neurons in the lateral intraparietal area of the monkey during an antisaccade task , 1999, Nature Neuroscience.

[22]  D Guitton,et al.  Human head-free gaze saccades to targets flashed before gaze-pursuit are spatially accurate. , 1998, Journal of neurophysiology.

[23]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[24]  Dora E Angelaki,et al.  Roles of gravitational cues and efference copy signals in the rotational updating of memory saccades. , 2005, Journal of neurophysiology.

[25]  M. Wexler,et al.  Anticipating the three-dimensional consequences of eye movements. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[26]  A. Berthoz,et al.  Goal-directed linear locomotion in normal and labyrinthine-defective subjects , 2004, Experimental Brain Research.

[27]  S. Bentin,et al.  Domain specificity versus expertise: factors influencing distinct processing of faces , 2002, Cognition.

[28]  Khan,et al.  PII: S0042-6989(01)00079-7 , 2001 .

[29]  R. Wurtz Neuronal mechanisms of visual stability , 2008, Vision Research.

[30]  Francesco Lacquaniti,et al.  Multiple levels of representation of reaching in the parieto-frontal network. , 2003, Cerebral cortex.

[31]  R. Andersen,et al.  Effect of reversible inactivation of macaque lateral intraparietal area on visual and memory saccades. , 1999, Journal of neurophysiology.

[32]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[34]  Jean-Louis Vercher,et al.  Updating visual space during passive and voluntary head-in-space movements , 1998, Experimental Brain Research.

[35]  Shin'ya Nishida,et al.  Spatiotemporal Tuning of Rapid Interactions between Visual-Motion Analysis and Reaching Movement , 2006, The Journal of Neuroscience.

[36]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[37]  R. John Leigh,et al.  Tracking of illusory target motion: Differences between gaze and head responses , 1995, Vision Research.

[38]  P. Medendorp,et al.  Visuospatial updating of reaching targets in near and far space , 2002, Neuroreport.

[39]  David Whitney,et al.  The influence of visual motion on fast reaching movements to a stationary object , 2003, Nature.

[40]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[41]  J. Crawford,et al.  Gaze-Centered Remapping of Remembered Visual Space in an Open-Loop Pointing Task , 1998, The Journal of Neuroscience.

[42]  Ari Z. Zivotofsky,et al.  A dissociation between perception and action in open-loop smooth-pursuit ocular tracking of the Duncker Illusion , 2005, Neuroscience Letters.

[43]  W. P. Medendorp,et al.  Pointing to remembered visual targets after active one-step self-displacements within reaching space , 1999, Experimental Brain Research.

[44]  W Pieter Medendorp,et al.  Gaze-centered updating of remembered visual space during active whole-body translations. , 2007, Journal of neurophysiology.

[45]  Marc A Sommer,et al.  Identifying corollary discharges for movement in the primate brain. , 2004, Progress in brain research.

[46]  Dora E Angelaki,et al.  Primate memory saccade amplitude after intervened motion depends on target distance. , 2005, Journal of neurophysiology.

[47]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[48]  J. Philbeck,et al.  Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions , 1997 .

[49]  A. Opstal,et al.  Human eye-head coordination in two dimensions under different sensorimotor conditions , 1997, Experimental Brain Research.

[50]  A. Berthoz,et al.  Contribution of the otoliths to the calculation of linear displacement. , 1989, Journal of neurophysiology.

[51]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. II. Behavioral modulation. , 1999, Journal of neurophysiology.

[52]  A. Pouget,et al.  Multisensory spatial representations in eye-centered coordinates for reaching , 2002, Cognition.

[53]  Richard A. Andersen,et al.  Separate body- and world-referenced representations of visual space in parietal cortex , 1998, Nature.

[54]  L F Dell'Osso,et al.  Saccades to remembered targets: the effects of smooth pursuit and illusory stimulus motion. , 1996, Journal of neurophysiology.

[55]  A. V. van den Berg,et al.  Representation of heading direction in far and near head space , 2003, Experimental Brain Research.

[56]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[57]  I Israël,et al.  Vestibular information contributes to update retinotopic maps. , 1999, Neuroreport.

[58]  R. Andersen,et al.  Spatially tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets. , 1996, Journal of neurophysiology.

[59]  K. Duncker,et al.  Über induzierte Bewegung , 1929 .

[60]  Zahn,et al.  The audioocular response: intersensory delay. , 1979, Sensory processes.

[61]  A. Berthoz,et al.  Estimation of passive horizontal linear whole-body displacement in humans. , 1993, Journal of neurophysiology.

[62]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[63]  Shin'ya Nishida,et al.  Large-Field Visual Motion Directly Induces an Involuntary Rapid Manual Following Response , 2005, The Journal of Neuroscience.

[64]  B. Bridgeman,et al.  Interaction of cognitive and sensorimotor maps of visual space , 1997, Perception & psychophysics.

[65]  T. Vilis,et al.  Gaze-Centered Updating of Visual Space in Human Parietal Cortex , 2003, The Journal of Neuroscience.

[66]  Harry J. Wyatt,et al.  The role of perceived motion in smooth pursuit eye movements , 1979, Vision Research.

[67]  R. Wurtz,et al.  A Pathway in Primate Brain for Internal Monitoring of Movements , 2002, Science.

[68]  M. Goldberg,et al.  Rhesus Monkeys Behave As If They Perceive the Duncker Illusion , 2005, Journal of Cognitive Neuroscience.

[69]  N. Kudoh Dissociation between Visual Perception of Allocentric Distance and Visually Directed Walking of its Extent , 2005, Perception.

[70]  W Pieter Medendorp,et al.  Behavioral reference frames for planning human reaching movements. , 2006, Journal of neurophysiology.

[71]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[72]  C. Gielen,et al.  Geometric computations underlying eye-hand coordination: orientations of the two eyes and the head , 2003, Experimental Brain Research.

[73]  L F Dell'Osso,et al.  Saccades to sounds: effects of tracking illusory visual stimuli. , 2000, Journal of neurophysiology.

[74]  D L Sparks,et al.  Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. , 1987, Journal of neurophysiology.

[75]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[76]  W P Medendorp,et al.  Visuospatial memory computations during whole-body rotations in roll. , 2005, Journal of neurophysiology.

[77]  PAUL van DONKELAAR,et al.  The Role of Ocular Muscle Proprioception During Modifications in Smooth Pursuit Output , 1997, Vision Research.

[78]  Aidan A. Thompson,et al.  The hand knows something that the eye does not: Reaching movements resist the Müller–Lyer illusion whether or not the target is foveated , 2007, Neuroscience Letters.

[79]  J. Gibson,et al.  Parallax and perspective during aircraft landings. , 1955, The American journal of psychology.

[80]  Uwe J. Ilg,et al.  Cancellation of self-induced retinal image motion during smooth pursuit eye movements , 2001, Vision Research.

[81]  J D Crawford,et al.  Role of eye, head, and shoulder geometry in the planning of accurate arm movements. , 2002, Journal of neurophysiology.

[82]  J. F. Soechting,et al.  The Duncker illusion and eye-hand coordination. , 2001, Journal of neurophysiology.

[83]  J. Duhamel,et al.  Saccadic Target Selection Deficits after Lateral Intraparietal Area Inactivation in Monkeys , 2002, The Journal of Neuroscience.

[84]  L. Snyder Coordinate transformations for eye and arm movements in the brain , 2000, Current Opinion in Neurobiology.

[85]  R. Shadmehr,et al.  Why Does the Brain Predict Sensory Consequences of Oculomotor Commands? Optimal Integration of the Predicted and the Actual Sensory Feedback , 2006, The Journal of Neuroscience.

[86]  T. Mergner,et al.  Object motion perception is shaped by the motor control mechanism of ocular pursuit , 2003, Experimental Brain Research.

[87]  C. Genovese,et al.  Spatial Updating in Human Parietal Cortex , 2003, Neuron.

[88]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. I. Effects of training. , 1999, Journal of neurophysiology.

[89]  Denise Y P Henriques,et al.  Reference frame conversions for repeated arm movements. , 2008, Journal of neurophysiology.

[90]  N. Shimizu [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[91]  H H Goossens,et al.  Influence of head position on the spatial representation of acoustic targets. , 1999, Journal of neurophysiology.

[92]  J. J. Koenderink,et al.  Visual perception of collinearity , 2002, Perception & psychophysics.