A Bayesian model of the disambiguation of gravitoinertial force by visual cues

The otoliths are stimulated in the same fashion by gravitational and inertial forces, so otolith signals are ambiguous indicators of self-orientation. The ambiguity can be resolved with added visual information indicating orientation and acceleration with respect to the earth. Here we present a Bayesian model of the statistically optimal combination of noisy vestibular and visual signals. Likelihoods associated with sensory measurements are represented in an orientation/acceleration space. The likelihood function associated with the otolith signal illustrates the ambiguity; there is no unique solution for self-orientation or acceleration. Likelihood functions associated with other sensory signals can resolve this ambiguity. In addition, we propose two priors, each acting on a dimension in the orientation/acceleration space: the idiotropic prior and the no-acceleration prior. We conducted experiments using a motion platform and attached visual display to examine the influence of visual signals on the interpretation of the otolith signal. Subjects made pitch and acceleration judgments as the vestibular and visual signals were manipulated independently. Predictions of the model were confirmed: (1) visual signals affected the interpretation of the otolith signal, (2) less variable signals had more influence on perceived orientation and acceleration than more variable ones, and (3) combined estimates were more precise than single-cue estimates. We also show that the model can explain some well-known phenomena including the perception of upright in zero gravity, the Aubert effect, and the somatogravic illusion.

[1]  R. Hetherington The Perception of the Visual World , 1952 .

[2]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[3]  Jacques Droulez,et al.  Self-motion and the perception of stationary objects , 2001, Nature.

[4]  James A. Crowell,et al.  Estimating heading during eye movements , 1994, Vision Research.

[5]  J. Goldberg,et al.  Physiology of peripheral neurons innervating semicircular canals of the squirrel monkey. 3. Variations among units in their discharge properties. , 1971, Journal of neurophysiology.

[6]  C S Lessard,et al.  Effects of rotation on somatogravic illusions. , 2000, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[7]  J. Gibson The perception of the visual world , 1951 .

[8]  F. O. Black,et al.  Vestibular perception and action employ qualitatively different mechanisms. I. Frequency response of VOR and perceptual responses during Translation and Tilt. , 2005, Journal of neurophysiology.

[9]  Jeroen J. A. van Boxtel,et al.  Perception of plane orientation from self-generated and passively observed optic flow. , 2003, Journal of vision.

[10]  D M Merfeld,et al.  Neural processing of gravito-inertial cues in humans. IV. Influence of visual rotational cues during roll optokinetic stimuli. , 2003, Journal of neurophysiology.

[11]  Charles S Lessard,et al.  The effects of visual scenes on roll and pitch thresholds in pilots versus nonpilots. , 2002, Aviation, space, and environmental medicine.

[12]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[13]  A. Yuille,et al.  Bayesian decision theory and psychophysics , 1996 .

[14]  S Glasauer,et al.  Linear acceleration perception: frequency dependence of the hilltop illusion. , 1995, Acta oto-laryngologica. Supplementum.

[15]  L. Harris,et al.  Visual and non-visual cues in the perception of linear self motion , 2000, Experimental Brain Research.

[16]  Malcolm G. Braithwaite,et al.  Proceedings of the First Triservice Conference on Rotary-Wing Spatial Disorientation: Spatial Disorientation in the Operational Rotary-Wing Environment. , 1997 .

[17]  B J Hess,et al.  Computation of Inertial Motion: Neural Strategies to Resolve Ambiguous Otolith Information , 1999, The Journal of Neuroscience.

[18]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[19]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[20]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  S. Gepshtein,et al.  Viewing Geometry Determines How Vision and Haptics Combine in Size Perception , 2003, Current Biology.

[22]  Daniel M Merfeld,et al.  Human ocular torsion and perceived roll responses to linear acceleration. , 2005, Journal of vestibular research : equilibrium & orientation.

[23]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[24]  Michael I. Jordan,et al.  Computational models of sensorimotor integration , 1997 .

[25]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[26]  Horst Mittelstaedt,et al.  Idiothetic navigation in humans: estimation of path length , 2001, Experimental Brain Research.

[27]  Dora E. Angelaki,et al.  Neurons compute internal models of the physical laws of motion , 2004, Nature.

[28]  W Bateman,et al.  Spatial disorientation-implicated accidents in Canadian forces, 1982-92. , 1995, Aviation, space, and environmental medicine.

[29]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[30]  H. Ashida,et al.  Visual influence on the magnitude of somatogravic illusion evoked on advanced spatial disorientation demonstrator. , 1998, Aviation, space, and environmental medicine.

[31]  M S Landy,et al.  Ideal cue combination for localizing texture-defined edges. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[33]  H. Mittelstaedt A new solution to the problem of the subjective vertical , 1983, Naturwissenschaften.

[34]  G. Jones,et al.  A quantitative study of vestibular adaptation in humans. , 1970, Acta oto-laryngologica.

[35]  S. H. Seidman,et al.  Tilt perception during dynamic linear acceleration , 1998, Experimental Brain Research.

[36]  Neil W. Roach,et al.  Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration , 2006, Proceedings of the Royal Society B: Biological Sciences.

[37]  R. Held,et al.  Moving Visual Scenes Influence the Apparent Direction of Gravity , 1972, Science.

[38]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[39]  Ruud Hosman,et al.  Evaluation of Perceived Motion During a Simulated Takeoff Run , 2001 .

[40]  M. Landy,et al.  Weighted linear cue combination with possibly correlated error , 2003, Vision Research.

[41]  Stefan Glasauer,et al.  Perception of spatial orientation in microgravity , 1998, Brain Research Reviews.

[42]  Ian P Howard,et al.  The Contribution of Motion, the Visual Frame, and Visual Polarity to Sensations of Body Tilt , 1994, Perception.

[43]  F H Previc,et al.  Visual scene effects on the somatogravic illusion. , 1992, Aviation, space, and environmental medicine.

[44]  D M Merfeld,et al.  Humans use internal models to estimate gravity and linear acceleration , 1999, Nature.

[45]  P. Thompson,et al.  Human speed perception is contrast dependent , 1992, Vision Research.

[46]  J. Goldberg,et al.  Physiology of peripheral neurons innervating semicircular canals of the squirrel monkey. I. Resting discharge and response to constant angular accelerations. , 1971, Journal of neurophysiology.

[47]  Andras Kemeny,et al.  Motion Cueing in the Renault Driving Simulator , 2000 .

[48]  Christian Darlot,et al.  Using sensory weighting to model the influence of canal, otolith and visual cues on spatial orientation and eye movements , 2002, Biological Cybernetics.

[49]  L. Zupan,et al.  Neural processing of gravito-inertial cues in humans. II. Influence of the semicircular canals during eccentric rotation. , 2001, Journal of neurophysiology.

[50]  Jacques Droulez,et al.  Visuovestibular perception of self-motion modeled as a dynamic optimization process , 2002, Biological Cybernetics.

[51]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[52]  Pietro G. Morasso,et al.  Self-Organization, Computational Maps, and Motor Control , 1997 .

[53]  A. J. Benson,et al.  Thresholds for the perception of whole body angular movement about a vertical axis. , 1989, Aviation, space, and environmental medicine.

[54]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[55]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[56]  Ian P. Howard,et al.  Human visual orientation , 1982 .

[57]  Karl von Meyenn Über das Relativitätsprinzip und die aus demselben gezogenen Folgerungen , 1990 .

[58]  L R Harris,et al.  Vestibular capture of the perceived distance of passive linear self motion. , 2000, Archives italiennes de biologie.

[59]  Daniel R. Berger Spectral texturing for real-time applications , 2003, SIGGRAPH '03.

[60]  Fred H. Previc,et al.  Spatial Orientation in Flight , 1993 .

[61]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.