Gaze-centered updating of remembered visual space during active whole-body translations.

Various cortical and sub-cortical brain structures update the gaze-centered coordinates of remembered stimuli to maintain an accurate representation of visual space across eyes rotations and to produce suitable motor plans. A major challenge for the computations by these structures is updating across eye translations. When the eyes translate, objects in front of and behind the eyes' fixation point shift in opposite directions on the retina due to motion parallax. It is not known if the brain uses gaze coordinates to compute parallax in the translational updating of remembered space or if it uses gaze-independent coordinates to maintain spatial constancy across translational motion. We tested this by having subjects view targets, flashed in darkness in front of or behind fixation, then translate their body sideways, and subsequently reach to the memorized target. Reach responses showed parallax-sensitive updating errors: errors increased with depth from fixation and reversed in lateral direction for targets presented at opposite depths from fixation. In a series of control experiments, we ruled out possible biasing factors such as the presence of a fixation light during the translation, the eyes accompanying the hand to the target, and the presence of visual feedback about hand position. Quantitative geometrical analysis confirmed that updating errors were better described by using gaze-centered than gaze-independent coordinates. We conclude that spatial updating for translational motion operates in gaze-centered coordinates. Neural network simulations are presented suggesting that the brain relies on ego-velocity signals and stereoscopic depth and direction information in spatial updating during self-motion.

[1]  L. Snyder.  Coordinate transformations for eye and arm movements in the brain , 2000, Current Opinion in Neurobiology.

[2]  C. Gielen,et al.  Geometric computations underlying eye-hand coordination: orientations of the two eyes and the head , 2003, Experimental Brain Research.

[3]  W Pieter Medendorp,et al.  Behavioral reference frames for planning human reaching movements. , 2006, Journal of neurophysiology.

[4]  P. Medendorp,et al.  Visuospatial updating of reaching targets in near and far space , 2002, Neuroreport.

[5]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[6]  A. Berthoz,et al.  Goal-directed linear locomotion in normal and labyrinthine-defective subjects , 2004, Experimental Brain Research.

[7]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[8]  Francesco Lacquaniti,et al.  Multiple levels of representation of reaching in the parieto-frontal network. , 2003, Cerebral cortex.

[9]  P. E. Hallett,et al.  Saccadic eye movements towards stimuli triggered by prior saccades , 1976, Vision Research.

[10]  B. Bridgeman,et al.  Interaction of cognitive and sensorimotor maps of visual space , 1997, Perception & psychophysics.

[11]  Richard A. Andersen,et al.  Separate body- and world-referenced representations of visual space in parietal cortex , 1998, Nature.

[12]  N. Kudoh.  Dissociation between Visual Perception of Allocentric Distance and Visually Directed Walking of its Extent , 2005, Perception.

[13]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[14]  S. Bentin,et al.  Domain specificity versus expertise: factors influencing distinct processing of faces , 2002, Cognition.

[15]  Aldo Genovesio,et al.  Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates. , 2004, Journal of neurophysiology.

[16]  Lawrence H Snyder,et al.  A neural network model of flexible spatial updating. , 2004, Journal of neurophysiology.

[17]  J. J. Koenderink,et al.  Visual perception of collinearity , 2002, Perception & psychophysics.

[18]  W. P. Medendorp,et al.  Pointing to remembered visual targets after active one-step self-displacements within reaching space , 1999, Experimental Brain Research.

[19]  A. Berthoz,et al.  Contribution of the otoliths to the calculation of linear displacement. , 1989, Journal of neurophysiology.

[20]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[21]  W Pieter Medendorp,et al.  Rotational Remapping in Human Spatial Memory during Eye and Head Motion , 2002, The Journal of Neuroscience.

[22]  T. Vilis,et al.  Gaze-Centered Updating of Visual Space in Human Parietal Cortex , 2003, The Journal of Neuroscience.

[23]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[24]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[25]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[26]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[27]  Dora E Angelaki,et al.  Roles of gravitational cues and efference copy signals in the rotational updating of memory saccades. , 2005, Journal of neurophysiology.

[28]  I Israël,et al.  Vestibular information contributes to update retinotopic maps. , 1999, Neuroreport.

[29]  A. Pouget,et al.  Multisensory spatial representations in eye-centered coordinates for reaching , 2002, Cognition.

[30]  M. Schlag-Rey,et al.  Saccades can be aimed at the spatial location of targets flashed during pursuit. , 1990, Journal of neurophysiology.

[31]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[32]  A. Berthoz,et al.  Estimation of passive horizontal linear whole-body displacement in humans. , 1993, Journal of neurophysiology.

[33]  Jean-Louis Vercher,et al.  Updating visual space during passive and voluntary head-in-space movements , 1998, Experimental Brain Research.

[34]  D Guitton,et al.  Human head-free gaze saccades to targets flashed before gaze-pursuit are spatially accurate. , 1998, Journal of neurophysiology.

[35]  Francesco Lacquaniti,et al.  Cognitive allocentric representations of visual space shape pointing errors , 2002, Experimental Brain Research.

[36]  M. Goldberg,et al.  Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. , 1995, Journal of neurophysiology.

[37]  L E Mays,et al.  Neurons in monkey parietal area LIP are tuned for eye-movement parameters in three-dimensional space. , 1995, Journal of neurophysiology.

[38]  Nuo Li,et al.  Updating Visual Space during Motion in Depth , 2005, Neuron.

[39]  R. Wurtz,et al.  A Pathway in Primate Brain for Internal Monitoring of Movements , 2002, Science.

[40]  J. Gibson,et al.  Parallax and perspective during aircraft landings. , 1955, The American journal of psychology.

[41]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[42]  C. Genovese,et al.  Spatial Updating in Human Parietal Cortex , 2003, Neuron.

[43]  J. Philbeck,et al.  Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions. , 1997, Journal of experimental psychology. Human perception and performance.

[44]  William H. Press,et al.  Numerical recipes in C (2nd ed.): the art of scientific computing , 1992 .

[45]  Dora E Angelaki,et al.  Primate memory saccade amplitude after intervened motion depends on target distance. , 2005, Journal of neurophysiology.

[46]  J. Crawford,et al.  Gaze-Centered Remapping of Remembered Visual Space in an Open-Loop Pointing Task , 1998, The Journal of Neuroscience.

[47]  W Pieter Medendorp,et al.  Motion Parallax Is Computed in the Updating of Human Spatial Memory , 2003, The Journal of Neuroscience.

[48]  William H. Press,et al.  Numerical recipes in C , 2002 .

[49]  Lawrence H Snyder,et al.  Spatial memory following shifts of gaze. I. Saccades to memorized world-fixed and gaze-fixed targets. , 2003, Journal of neurophysiology.

[50]  W P Medendorp,et al.  Visuospatial memory computations during whole-body rotations in roll. , 2005, Journal of neurophysiology.

[51]  M. Wexler,et al.  Anticipating the three-dimensional consequences of eye movements. , 2005, Proceedings of the National Academy of Sciences of the United States of America.