Eye movements during path integration

Self‐motion induces spontaneous eye movements which serve the purpose of stabilizing the visual image on the retina. Previous studies have mainly focused on their reflexive nature and how the perceptual system disentangles visual flow components caused by eye movements and self‐motion. Here, we investigated the role of eye movements in distance reproduction (path integration). We used bimodal (visual‐auditory)‐simulated self‐motion: visual optic flow was paired with an auditory stimulus whose frequency was scaled with simulated speed. The task of the subjects in each trial was, first, to observe the simulated self‐motion over a certain distance (Encoding phase) and, second, to actively reproduce the observed distance using only visual, only auditory, or bimodal feedback (Reproduction phase). We found that eye positions and eye speeds were strongly correlated between the Encoding and the Reproduction phases. This was the case even when reproduction relied solely on auditory information and thus no visual stimulus was presented. We believe that these correlations are indicative of a contribution of eye movements to path integration.

[1]  M. Wilson,et al.  Eye Movements Drive Steering: Reduced Eye Movement Distribution Impairs Steering and Driving Performance , 2008, Journal of motor behavior.

[2]  Jonathan Winawer,et al.  A motion aftereffect from visual imagery of motion , 2010, Cognition.

[3]  Esch,et al.  Distance estimation by foraging honeybees , 1996, The Journal of experimental biology.

[4]  A. Etienne,et al.  Limitations in the Assessment of Path Dependent Information , 1988 .

[5]  W Pieter Medendorp,et al.  Eye Movements in Darkness Modulate Self-Motion Perception , 2017, eNeuro.

[6]  S. Kosslyn,et al.  The heterogeneity of mental representation: Ending the imagery debate , 2015, Proceedings of the National Academy of Sciences.

[7]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[8]  A. Berthoz,et al.  Goal-directed linear locomotion in normal and labyrinthine-defective subjects , 2004, Experimental Brain Research.

[9]  B B Brown,et al.  Visual recall ability and eye movements. , 1968, Psychophysiology.

[10]  K. Brantberg Human optokinetic after-nystagmus: variability in serial test results. , 1992, Acta oto-laryngologica.

[11]  S. Kosslyn,et al.  Topographical representations of mental images in primary visual cortex , 1995, Nature.

[12]  George J. Andersen,et al.  Eye Movement Patterns and Driving Performance , 2017 .

[13]  K. Hoffmann,et al.  Ocular responses to radial optic flow and single accelerated targets in humans , 1999, Vision Research.

[14]  K. Hoffmann,et al.  Neural Dynamics of Saccadic Suppression , 2009, Journal of Neuroscience.

[15]  A. Berthoz,et al.  Differential effects of labyrinthine dysfunction on distance and direction during blindfolded walking of a triangular path , 2002, Experimental Brain Research.

[16]  Horst Mittelstaedt,et al.  Idiothetic navigation in humans: estimation of path length , 2001, Experimental Brain Research.

[17]  S Glasauer,et al.  Simulation of pathological ocular counter-roll and skew-torsion by a 3-D mathematical model. , 1999, Neuroreport.

[18]  H. Komatsu,et al.  Modulation of pursuit eye movements by stimulation of cortical areas MT and MST. , 1989, Journal of neurophysiology.

[19]  James A. Crowell,et al.  The perception of heading during eye movements , 1992, Nature.

[20]  K. Hoffmann,et al.  Optokinetic eye movements elicited by radial optic flow in the macaque monkey. , 1998, Journal of neurophysiology.

[21]  S. Kosslyn,et al.  Mental imagery , 2013, Front. Psychol..

[22]  Markus Lappe,et al.  Heading detection from optic flow , 1994, Nature.

[23]  Bernhard J. M. Hess,et al.  Self-motion-induced eye movements: effects on visual acuity and navigation , 2005, Nature Reviews Neuroscience.

[24]  Richard Dewhurst,et al.  Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding. , 2012, Journal of experimental psychology. Human perception and performance.

[25]  S. Kosslyn,et al.  Visual memory and visual mental imagery recruit common control and sensory regions of the brain , 2012, Cognitive neuroscience.

[26]  Markus Lappe,et al.  Heading representations in primates are compressed by saccades , 2017, Nature Communications.

[27]  A Berthoz,et al.  Spatial memory of body linear displacement: what is being stored? , 1995, Science.

[28]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[29]  D. Mestre,et al.  Viewpoint oscillation improves the perception of distance travelled based on optic flow. , 2016, Journal of vision.

[30]  Michael E Goldberg,et al.  Corollary Discharge and Oculomotor Proprioception: Cortical Mechanisms for Spatially Accurate Vision. , 2016, Annual review of vision science.

[31]  R A Lutfi,et al.  Correlational analysis of acoustic cues for the discrimination of auditory motion. , 1999, The Journal of the Acoustical Society of America.

[32]  Frank Bremmer,et al.  Self-motion reproduction can be affected by associated auditory cues. , 2011, Seeing and perceiving.

[33]  S. Rushton,et al.  Optic Flow Processing for the Assessment of Object Movement during Ego Movement , 2009, Current Biology.

[34]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[35]  Ariane S Etienne,et al.  Path integration in mammals , 2004, Hippocampus.

[36]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[37]  F. Bremmer,et al.  Visual Neuroscience: The Puzzle of Perceptual Stability , 2016, Current Biology.

[38]  F. Bremmer,et al.  The use of optical velocities for distance discrimination and reproduction during visually simulated self motion , 1999, Experimental Brain Research.

[39]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[40]  S. Kosslyn,et al.  Visual mental imagery induces retinotopically organized activation of early visual areas. , 2005, Cerebral cortex.

[41]  B. Cohen,et al.  Quantitative analysis of the velocity characteristics of optokinetic nystagmus and optokinetic after‐nystagmus , 1977, The Journal of physiology.

[42]  Frank Bremmer,et al.  Multisensory space: from eye‐movements to self‐motion , 2011, The Journal of physiology.

[43]  W. Singer,et al.  The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery , 1998, The European journal of neuroscience.

[44]  Peter Thier,et al.  The neural basis of smooth pursuit eye movements in the rhesus monkey brain , 2008, Brain and Cognition.

[45]  R. Hetherington The Perception of the Visual World , 1952 .

[46]  Frank Bremmer,et al.  Integration of visual and tactile information in reproduction of traveled distance. , 2017, Journal of neurophysiology.

[47]  R Wehner,et al.  Path integration in desert ants, Cataglyphis fortis. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[48]  V. Henn,et al.  Duration and direction of optokinetic after-nystagmus as a function of stimulus exposure time in the monkey , 1976, Archiv für Psychiatrie und Nervenkrankheiten.

[49]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[50]  James A. Crowell,et al.  Estimating heading during eye movements , 1994, Vision Research.

[51]  Laurence R. Harris,et al.  Travel distance estimation from visual motion by leaky path integration , 2007, Experimental Brain Research.

[52]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[53]  M. Srinivasan,et al.  Searching behaviour of desert ants, genusCataglyphis (Formicidae, Hymenoptera) , 2004, Journal of comparative physiology.

[54]  F. Bremmer,et al.  Perception of self-motion from visual flow , 1999, Trends in Cognitive Sciences.

[55]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[56]  Horst Mittelstaedt,et al.  Homing by Path Integration , 1982 .

[57]  Bettina Sorger,et al.  Decoding the direction of imagined visual motion using 7 T ultra-high field fMRI , 2016, NeuroImage.

[58]  David Crundall,et al.  Effects of experience and processing demands on visual information acquisition in drivers , 1998 .

[59]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[60]  K. Hoffmann,et al.  Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach , 1996, The Journal of Neuroscience.