Multisensory Processing in Spatial Orientation: An Inverse Probabilistic Approach

Most evidence that the brain uses Bayesian inference to integrate noisy sensory signals optimally has been obtained by showing that the noise levels in each modality separately can predict performance in combined conditions. Such a forward approach is difficult to implement when the various signals cannot be measured in isolation, as in spatial orientation, which involves the processing of visual, somatosensory, and vestibular cues. Instead, we applied an inverse probabilistic approach, based on optimal observer theory. Our goal was to investigate whether the perceptual differences found when probing two different states—body-in-space and head-in-space orientation—can be reconciled by a shared scheme using all available sensory signals. Using a psychometric approach, seven human subjects were tested on two orientation estimates at tilts <120°: perception of body tilt [subjective body tilt (SBT)] and perception of visual vertical [subjective visual vertical (SVV)]. In all subjects, the SBT was more accurate than the SVV, which showed substantial systematic errors for tilt angles beyond 60°. Variability increased with tilt angle in both tasks, but was consistently lower in the SVV. The sensory integration model fitted both datasets very nicely. A further experiment, in which supine subjects judged their head orientation relative to the body, independently confirmed the predicted head-on-body noise by the model. Model predictions based on the derived noise properties from the various modalities were also consistent with previously published deficits in vestibular and somatosensory patients. We conclude that Bayesian computations can account for the typical differences in spatial orientation judgments associated with different task requirements.

[1]  Hermann Aubert,et al.  Eine scheinbare bedeutende Drehung von Objecten bei Neigung des Kopfes nach rechts oder links , 1861, Archiv für pathologische Anatomie und Physiologie und für klinische Medicin.

[2]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[3]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[4]  T. Haslwanter,et al.  The distribution of otolith polarization vectors in mammals: Comparison between model predictions and single cell recordings , 2008, Hearing Research.

[5]  David S. Zee,et al.  Neck Muscle Vibration Alters Visually Perceived Roll in Normals , 2004, Journal of the Association for Research in Otolaryngology.

[6]  Heinrich H. Bülthoff,et al.  A Bayesian model of the disambiguation of gravitoinertial force by visual cues , 2007, Experimental Brain Research.

[7]  M. De Vrijer,et al.  Accuracy-precision trade-off in visual orientation constancy. , 2009, Journal of vision.

[8]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[9]  A. J. Benson,et al.  Thresholds for the perception of whole body angular movement about a vertical axis. , 1989, Aviation, space, and environmental medicine.

[10]  W P Medendorp,et al.  Body-tilt and visual verticality perception during multiple cycles of roll rotation. , 2008, Journal of neurophysiology.

[11]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[12]  Will G. Hopkins,et al.  A new view of statistics , 2002 .

[13]  Dieter Vaitl,et al.  Shifts in blood volume alter the perception of posture: further evidence for somatic graviception. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  J Dichgans,et al.  Optokinetic-graviceptive interaction in different head positions. , 1974, Acta oto-laryngologica.

[15]  A M Bronstein,et al.  The perception of body verticality (subjective postural vertical) in peripheral and central vestibular disorders. , 1996, Brain : a journal of neurology.

[16]  J. V. Van Gisbergen,et al.  Properties of the internal representation of gravity inferred from spatial-direction and body-tilt estimates. , 2000, Journal of neurophysiology.

[17]  Henrik Madsen,et al.  Introduction to Generalized Linear Models , 2012 .

[18]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[19]  D. Angelaki,et al.  Vestibular system: the many facets of a multimodal sense. , 2008, Annual review of neuroscience.

[20]  Marion Trousselard,et al.  Contribution of tactile and interoceptive cues to the perception of the direction of gravity. , 2004, Brain research. Cognitive brain research.

[21]  D Straumann,et al.  Roll-dependent modulation of the subjective visual vertical: contributions of head- and trunk-based signals. , 2010, Journal of neurophysiology.

[22]  A. D. V. Beuzekom,et al.  PII: S0042-6989(01)00144-4 , 2001 .

[23]  W P Medendorp,et al.  Shared computational mechanism for tilt compensation accounts for biased verticality percepts in motion and pattern vision. , 2008, Journal of neurophysiology.

[24]  Ulf Rosenhall The vestibular sensory regions in man : a morphological study , 1974 .

[25]  F. Mast,et al.  The effect of water immersion on postural and visual orientation. , 1999, Aviation, space, and environmental medicine.

[26]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[27]  R Vogels,et al.  Human orientation discrimination: changes with eccentricity in normal and amblyopic vision. , 1986, Investigative ophthalmology & visual science.

[28]  A GRAYBIEL,et al.  PERCEPTION OF THE POSTURAL VERTICAL FOLLOWING PROLONGED BODILY TILT IN NORMALS AND SUBJECTS WITH LABYRINTHINE DEFECTS. , 1964, Acta oto-laryngologica.

[29]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[30]  Jan A M Van Gisbergen,et al.  Interpretation of a discontinuity in the sense of verticality at large body tilt. , 2004, Journal of neurophysiology.

[31]  A. Bronstein,et al.  Visually and posturally mediated tilt illusion in Parkinson's disease and in labyrinthine defective subjects , 1996, Neurology.

[32]  Bernhard J M Hess,et al.  Dynamic effects on the subjective visual vertical after roll rotation. , 2008, Journal of neurophysiology.

[33]  H. Mittelstaedt,et al.  Shifts in blood volume alter the perception of posture. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  H Mittelstaedt,et al.  Origin and processing of postural information , 1998, Neuroscience & Biobehavioral Reviews.

[35]  H Mittelstaedt,et al.  Interaction of eye-, head-, and trunk-bound information in spatial perception and control. , 1997, Journal of vestibular research : equilibrium & orientation.

[36]  N. Wade Visual orientation during and after lateral head, body, and trunk tilt , 1968 .

[37]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[38]  H. Mittelstaedt A new solution to the problem of the subjective vertical , 1983, Naturwissenschaften.

[39]  J. Goldberg,et al.  Physiology of peripheral neurons innervating otolith organs of the squirrel monkey. III. Response dynamics. , 1976, Journal of neurophysiology.

[40]  Philip N. Sabes,et al.  Sensory transformations and the use of multiple reference frames for reach planning , 2009, Nature Neuroscience.

[41]  U Rosenhall,et al.  Vestibular Macular Mapping in Man , 1972, The Annals of otology, rhinology, and laryngology.

[42]  J. Goldberg,et al.  Physiology of peripheral neurons innervating otolith organs of the squirrel monkey. I. Response to static tilts and to long-duration centrifugal force. , 1976, Journal of neurophysiology.

[43]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[44]  L R Young,et al.  Influence of head orientation on visually induced pitch and roll sensation. , 1975, Aviation, space, and environmental medicine.

[45]  D Straumann,et al.  Gravity dependence of subjective visual vertical variability. , 2009, Journal of neurophysiology.

[46]  Eric R. Ziegel,et al.  An Introduction to Generalized Linear Models , 2002, Technometrics.

[47]  H. A. U. D. Haes Stability of apparent vertical and ocular countertorsion as a function of lateral tilt , 1970 .

[48]  Fred Mast,et al.  Perceived body position and the visual horizontal , 1996, Brain Research Bulletin.

[49]  H SCHOENE,et al.  ON THE ROLE OF GRAVITY IN HUMAN SPATIAL ORIENTATION. , 1964, Aerospace medicine.

[50]  Simone B. Bortolami,et al.  Localization of the subjective vertical during roll, pitch, and recumbent yaw body tilt , 2006, Experimental Brain Research.

[51]  A GRAYBIEL,et al.  Perception of the postural vertical in normals and subjects with labyrinthine defects. , 1963, Journal of experimental psychology.

[52]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[53]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[54]  H. Haes,et al.  Perception of gravity-vertical as a function of head and trunk position , 1968, Zeitschrift für Vergleichende Physiologie.

[55]  J. G. Nelson Effect of water immersion and body position upon perception of the gravitational vertical. , 1968, Aerospace medicine.

[56]  Ari Koskelainen,et al.  Origin of the fast negative ERG component from isolated aspartate-treated mouse retina. , 2009, Journal of vision.