Frequency-dependent integration of auditory and vestibular cues for self-motion perception.

Recent evidence has shown that auditory information may be used to improve postural stability, spatial orientation, navigation, and gait, suggesting an auditory component of self-motion perception. To determine how auditory and other sensory cues integrate for self-motion perception, we measured motion perception during yaw rotations of the body and the auditory environment. Psychophysical thresholds in humans were measured over a range of frequencies (0.1-1.0 Hz) during self-rotation without spatial auditory stimuli, rotation of a sound source around a stationary listener, and self-rotation in the presence of an earth-fixed sound source. Unisensory perceptual thresholds and the combined multisensory thresholds were found to be frequency-dependent. Auditory thresholds were better at lower frequencies and vestibular thresholds were better at higher frequencies. Expressed in terms of peak angular velocity, multisensory vestibular + auditory thresholds ranged from 0.39°/s at 0.1 Hz to 0.95°/s at 1.0 Hz, and were significantly better over low frequencies than either the auditory-only (0.54°/s to 2.42°/s at 0.1 and 1.0 Hz, respectively) or vestibular-only (2.00°/s to 0.75°/s at 0.1 and 1.0 Hz, respectively) unisensory conditions. Monaurally presented auditory cues were less effective than binaural cues in lowering multisensory thresholds. Frequency independent thresholds were derived assuming that vestibular thresholds depended on a weighted combination of velocity and acceleration cues, while auditory thresholds depended on displacement and velocity cues. These results elucidate fundamental mechanisms for the contribution of audition to balance and help explain previous findings indicating its significance in tasks requiring self-orientation.

[1]  Andrew D Brown,et al.  Temporal weighting of interaural time and level differences in high-rate click trains. , 2010, The Journal of the Acoustical Society of America.

[2]  Jacques A Grange,et al.  Turn an Ear to Hear: How Hearing-Impaired Listeners Can Exploit Head Orientation to Enhance Their Speech Intelligibility in Noisy Social Settings , 2018, Trends in hearing.

[3]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[4]  Anahita H. Mehta,et al.  Superoptimal Perceptual Integration Suggests a Place-Based Representation of Pitch at High Frequencies , 2017, The Journal of Neuroscience.

[5]  Israel Nelken,et al.  Early multisensory integration of self and source motion in the auditory system , 2016, Proceedings of the National Academy of Sciences.

[6]  S. Abel,et al.  Impact of unilateral hearing loss on sound localization , 2008 .

[7]  Rachel N. Denison,et al.  Supra-optimality may emanate from suboptimality, and hence optimality is no benchmark in multisensory integration , 2018, Behavioral and Brain Sciences.

[8]  M. Chacron,et al.  Statistics of the Vestibular Input Experienced during Natural Self-Motion: Implications for Neural Processing , 2014, The Journal of Neuroscience.

[9]  R. J. Leigh,et al.  Frequency and velocity of rotational head perturbations during locomotion , 2004, Experimental Brain Research.

[10]  Jennifer L. Campos,et al.  Hearing, self-motion perception, mobility, and aging , 2018, Hearing Research.

[11]  C S Watson,et al.  Auditory psychophysics and perception. , 1996, Annual review of psychology.

[12]  B. Chisnall,et al.  Environmental factors that affect the Fukuda stepping test in normal participants , 2015, The Journal of Laryngology & Otology.

[13]  Daniel M. Merfeld,et al.  Signal detection theory and vestibular thresholds: I. Basic theory and practical considerations , 2011, Experimental Brain Research.

[14]  W Owen Brimijoin,et al.  Egocentric and allocentric representations in auditory cortex , 2017, bioRxiv.

[15]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[16]  D. Perrott,et al.  Minimum audible movement angle: marking the end points of the path traveled by a moving sound source. , 1989, The Journal of the Acoustical Society of America.

[17]  R. Dodge,et al.  Thresholds of Rotation. , 1923 .

[18]  Lutz Wiegrebe,et al.  Psychophysical evidence for auditory motion parallax , 2018, Proceedings of the National Academy of Sciences.

[19]  Daniel M Merfeld,et al.  Visual and vestibular perceptual thresholds each demonstrate better precision at specific frequencies and also exhibit optimal integration. , 2014, Journal of neurophysiology.

[20]  J. Harris,et al.  Monaural-binaural minimum audible angles for a moving sound source. , 1971, Journal of speech and hearing research.

[21]  Yongwoo Yi,et al.  Determining thresholds using adaptive procedures and psychometric fits: evaluating efficiency using theory, simulations, and human experiments , 2015, Experimental Brain Research.

[22]  P. van de Heyning,et al.  Playing Music May Improve the Gait Pattern in Patients with Bilateral Caloric Areflexia Wearing a Cochlear Implant: Results from a Pilot Study , 2017, Front. Neurol..

[23]  Fred W. Mast,et al.  Vestibular thresholds for yaw rotation about an earth-vertical axis as a function of frequency , 2008, Experimental Brain Research.

[24]  Dennis L Barbour,et al.  Auditory contributions to maintaining balance. , 2017, Journal of vestibular research : equilibrium & orientation.

[25]  Benjamin T. Crane,et al.  Directional Asymmetries and Age Effects in Human Self-Motion Perception , 2012, Journal of the Association for Research in Otolaryngology.

[26]  M. Mancini,et al.  The contribution of cochlear implants to postural stability , 2018, The Laryngoscope.

[27]  Lloyd B. Minor,et al.  Orientation of Human Semicircular Canals Measured by Three-Dimensional Multiplanar CT Reconstruction , 2005, Journal of the Association for Research in Otolaryngology.

[28]  Lorenzo Chiari,et al.  ISway: a sensitive, valid and reliable measure of postural control , 2012, Journal of NeuroEngineering and Rehabilitation.

[29]  A. John Van Opstal,et al.  Eye position determines audiovestibular integration during whole-body rotation , 2010 .

[30]  Luigi Ferrucci,et al.  Hearing loss and falls among older adults in the United States. , 2012, Archives of internal medicine.

[31]  S. Motts,et al.  Effects of Bilateral Hearing Aid Use on Balance in Experienced Adult Hearing Aid Users. , 2018, American journal of audiology.

[32]  Simon Carlile,et al.  The Perception of Auditory Motion , 2016, Trends in hearing.

[33]  Filip Asp,et al.  The effect of simulated unilateral hearing loss on horizontal sound localization accuracy and recognition of speech in spatially separate competing speech , 2018, Hearing Research.

[34]  W. Yost,et al.  Relationship between postural stability and spatial hearing. , 2013, Journal of the American Academy of Audiology.

[35]  O. Blanke,et al.  Learning to integrate contradictory multisensory self-motion cue pairings. , 2015, Journal of vision.

[36]  D. Angelaki,et al.  Spatial tuning and dynamics of vestibular semicircular canal afferents in rhesus monkeys , 2004, Experimental Brain Research.

[37]  M. Ahissar,et al.  Encoding of sound-source location and movement: activity of single neurons and interactions between adjacent neurons in the monkey auditory cortex. , 1992, Journal of neurophysiology.

[38]  Laurie A King,et al.  The effect of spatial auditory landmarks on ambulation. , 2018, Gait & posture.

[39]  Christopher R Fetsch,et al.  Visual–vestibular cue integration for heading perception: applications of optimal cue integration theory , 2010, The European journal of neuroscience.

[40]  R H Schor,et al.  Response dynamics of horizontal canal afferents in barbiturate-anesthetized cats. , 1981, Journal of neurophysiology.

[41]  G. Earhart,et al.  Improvements in Gait With Hearing Aids and Cochlear Implants. , 2017, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[42]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[43]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[44]  T. Stanford,et al.  Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness , 2009, Experimental Brain Research.

[45]  A. J. Benson,et al.  Thresholds for the perception of whole body angular movement about a vertical axis. , 1989, Aviation, space, and environmental medicine.

[46]  Dora E Angelaki,et al.  Spatial Reference Frames of Visual, Vestibular, and Multimodal Heading Signals in the Dorsal Subdivision of the Medial Superior Temporal Area , 2007, The Journal of Neuroscience.

[47]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[48]  Harriet A Allen,et al.  Visual mechanisms of motion analysis and motion perception. , 2004, Annual review of psychology.

[49]  Anbar Najam,et al.  Judging sound rotation when listeners and sounds rotate: Sound source localization is a multisystem process. , 2015, The Journal of the Acoustical Society of America.

[50]  Uwe Firzlaff,et al.  Dependence of auditory spatial updating on vestibular, proprioceptive, and efference copy signals. , 2016, Journal of neurophysiology.

[51]  M. Agmon,et al.  The Association between Hearing Loss, Postural Control, and Mobility in Older Adults: A Systematic Review , 2017, Journal of the American Academy of Audiology.

[52]  O. Blanke,et al.  Optimal visuo-vestibular integration for self-motion perception in patients with unilateral vestibular loss , 2018, Neuropsychologia.

[53]  G D Paige,et al.  Vestibuloocular reflex and its interactions with visual following mechanisms in the squirrel monkey. I. Response characteristics in normal animals. , 1983, Journal of neurophysiology.

[54]  Daniel M Merfeld,et al.  Perceptual precision of passive body tilt is consistent with statistically optimal cue integration. , 2017, Journal of neurophysiology.

[55]  Richard F. Lewis,et al.  Relationship between vestibular sensitivity and multisensory temporal integration. , 2018, Journal of neurophysiology.

[56]  T. Mergner,et al.  Human perception of horizontal trunk and head rotation in space during vestibular and neck stimulation , 2004, Experimental Brain Research.

[57]  María Carolina Bermúdez Rey,et al.  Vestibular Perceptual Thresholds Increase above the Age of 40 , 2016, Front. Neurol..

[58]  R. Kronland-Martinet,et al.  Spatial Cues Provided by Sound Improve Postural Stabilization: Evidence of a Spatial Auditory Map? , 2017, Front. Neurosci..

[59]  A. Rees,et al.  Auditory motion-specific mechanisms in the primate brain , 2017, PLoS biology.