Localization Performance in a Binaural Real-Time Auralization System Extended to Research Hearing Aids

Auralization systems for auditory research should ideally be validated by perceptual experiments, as well as objective measures. This study employed perceptual tests to evaluate a recently proposed binaural real-time auralization system for hearing aid (HA) users. The dynamic localization of real sound sources was compared with that of virtualized ones, reproduced binaurally over headphones, loudspeakers with crosstalk cancellation (CTC) filters, research HAs, or combined via loudspeakers with CTC filters and research HAs under free-field conditions. System-inherent properties affecting localization cues were identified and their effects on overall horizontal localization, reversal rates, and angular error metrics were assessed. The general localization performance in combined reproduction was found to fall between what was measured for loudspeakers with CTC filters and research HAs alone. Reproduction via research HAs alone resulted in the highest reversal rates and angular errors. While combined reproduction helped decrease the reversal rates, no significant effect was observed on the angular error metrics. However, combined reproduction resulted in the same overall horizontal source localization performance as measured for real sound sources, while improving localization compared with reproduction over research HAs alone. Collectively, the results with respect to combined reproduction can be considered a performance indicator for future experiments involving HA users.

[1]  Chris Oreinos,et al.  Evaluation of Loudspeaker-Based Virtual Sound Environments for Testing Directional Hearing Aids. , 2016, Journal of the American Academy of Audiology.

[2]  Robert Baumgartner,et al.  Modeling sound-source localization in sagittal planes for human listeners. , 2014, The Journal of the Acoustical Society of America.

[3]  Robert J. Teather,et al.  Effects of tracking technology, latency, and spatial jitter on object movement , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[4]  J. Hebrank,et al.  Spectral cues used in the localization of sound sources on the median plane. , 1974, The Journal of the Acoustical Society of America.

[5]  Edgar A. G. Shaw,et al.  Acoustical Characteristics of the Outer Ear , 2007 .

[6]  J. C. Middlebrooks,et al.  Two-dimensional sound localization by human listeners. , 1990, The Journal of the Acoustical Society of America.

[7]  Michael Vorlnder,et al.  Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality , 2020 .

[8]  T. Anderson,et al.  Binaural and spatial hearing in real and virtual environments , 1997 .

[9]  H. Schielzeth,et al.  The coefficient of determination R2 and intra-class correlation coefficient from generalized linear mixed-effects models revisited and expanded , 2016, bioRxiv.

[10]  Yoshitaka Nakajima,et al.  Auditory Scene Analysis: The Perceptual Organization of Sound Albert S. Bregman , 1992 .

[11]  Piotr Majdak,et al.  Sound localization in individualized and non-individualized crosstalk cancellation systems. , 2013, The Journal of the Acoustical Society of America.

[12]  Janina Fels,et al.  Evaluation of Localization Accuracy of Static Sources Using HRTFs from a Fast Measurement System , 2016 .

[13]  Mark D. Plumbley,et al.  Computational Analysis of Sound Scenes and Events , 2017 .

[14]  Frank Wefers,et al.  Partitioned convolution algorithms for real-time auralization , 2015 .

[15]  M. Kenward,et al.  Small sample inference for fixed effects from restricted maximum likelihood. , 1997, Biometrics.

[16]  M B Gardner,et al.  Historical background of the Haas and-or precedence effect. , 1968, The Journal of the Acoustical Society of America.

[17]  Per Rubak,et al.  Objective evaluation of the sweet spot size in spatial sound reproduction using elevated loudspeakers. , 2010, The Journal of the Acoustical Society of America.

[18]  A. Mills.  On the minimum audible angle , 1958 .

[19]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[20]  E. S. Pearson.  THE ANALYSIS OF VARIANCE IN CASES OF NON-NORMAL VARIATION , 1931 .

[21]  Anthony Steed,et al.  Measuring Latency in Virtual Environments , 2014, IEEE Transactions on Visualization and Computer Graphics.

[22]  Emanuel Schmider,et al.  Is It Really Robust , 2010 .

[23]  Michael Vorländer,et al.  An Extended Binaural Real-Time Auralization System With an Interface to Research Hearing Aids for Experiments on Subjects With Hearing Loss , 2018, Trends in hearing.

[24]  Asbjrn Sb,et al.  Influence of Reflections on Crosstalk Cancelled Playback of Binaural Sound , 2001 .

[25]  Pauli Minnaar.  Simulating an acoustical environment with binaural technology: investigations of binaural recording and synthesis , 2002 .

[26]  Michael Vorländer,et al.  Individualized Binaural Technology: Measurement, Equalization and Perceptual Evaluation , 2012 .

[27]  A D Musicant,et al.  Influence of monaural spectral cues on binaural localization. , 1985, The Journal of the Acoustical Society of America.

[28]  Rozenn Nicol,et al.  A Roadmap for Assessing the Quality of Experience of 3D Audio Binaural Rendering , 2014 .

[29]  Bernhard U. Seeber,et al.  A system to simulate and reproduce audio–visual environments for spatial hearing research , 2010, Hearing Research.

[30]  Giso Grimm,et al.  Spatial Acoustic Scenarios in Multichannel Loudspeaker Systems for Hearing Aid Evaluation. , 2016, Journal of the American Academy of Audiology.

[31]  Janina Fels,et al.  The Influence of Symmetrical Human Ears on the Front-Back Confusion , 2017 .

[32]  Fang Chen.  Localization of 3-D Sound Presented through Headphone - Duration of Sound Presentation and Localization Accuracy , 2003 .

[33]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[34]  Søren Højsgaard,et al.  A Kenward-Roger approximation and parametric bootstrap methods for tests in linear mixed models: The R Package pbkrtest , 2014 .

[35]  Aleksander Sek,et al.  Speech intelligibility for different spatial configurations of target speech and competing noise source in a horizontal and median plane , 2013, Speech Commun..

[36]  Brian D. Simpson,et al.  The detectability of headtracker latency in virtual audio displays , 2005 .

[37]  Steven van de Par,et al.  A multiple model high-resolution head-related impulse response database for aided and unaided ears , 2019, EURASIP J. Adv. Signal Process..

[38]  Harvey Dillon,et al.  The listening in spatialized noise-sentences test (LISN-S): comparison to the prototype LISN and results from children with either a suspected (central) auditory processing disorder or a confirmed language disorder. , 2008, Journal of the American Academy of Audiology.

[39]  Birger Kollmeier,et al.  Adapting Hearing Devices to the Individual Ear Acoustics: Database and Target Response Correction Functions for Various Device Styles , 2018, Trends in hearing.

[40]  John C. Nash,et al.  On Best Practice Optimization Methods in R , 2014 .

[41]  Dirk Schröder,et al.  Physically based real-time auralization of interactive virtual environments , 2011 .

[42]  Mark R. Anderson,et al.  Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source. , 2001, Journal of the Audio Engineering Society. Audio Engineering Society.

[43]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[44]  W Noble,et al.  Effects of Earmold Type on Ability to Locate Sounds When Wearing Hearing Aids , 1996, Ear and hearing.

[45]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[46]  Henrik Møller.  Fundamentals of binaural technology , 1991 .

[47]  Torsten Dau,et al.  Validation of a Virtual Sound Environment System for Testing Hearing Aids , 2017 .

[48]  John C. Nash,et al.  Unifying Optimization Algorithms to Aid Software System Users: optimx for R , 2011 .

[49]  Per Rubak,et al.  A subjective evaluation of the minimum channel separation for reproducing binaural signals over loudspeakers , 2011 .

[50]  Norbert Dillier,et al.  Localization of virtual sound sources with bilateral hearing aids in realistic acoustical scenes. , 2012, The Journal of the Acoustical Society of America.

[51]  Johannes Nowak,et al.  Perception and prediction of apparent source width and listener envelopment in binaural spherical microphone array auralizations. , 2017, The Journal of the Acoustical Society of America.

[52]  Frank Melchior,et al.  Spatial Sound With Loudspeakers and Its Perception: A Review of the Current State , 2013, Proceedings of the IEEE.

[53]  Michael Vorländer,et al.  Performance Evaluation of a Dynamic Crosstalk-Cancellation System with Compensation of Early Reflections , 2016 .

[54]  Steffen Lepa,et al.  A spatial audio quality inventory for virtual acoustic environments (SAQI) , 2014 .

[55]  H. Gaskell.  The precedence effect , 1983, Hearing Research.

[56]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[57]  Nick Zacharov,et al.  Perceptual attributes for the comparison of head-related transfer functions. , 2016, The Journal of the Acoustical Society of America.

[58]  E. Wenzel.  The relative contribution of interaural time and magnitude cues to dynamic sound localization , 1995, Proceedings of 1995 Workshop on Applications of Signal Processing to Audio and Accoustics.

[59]  A. Lindau,et al.  The perception of system latency in dynamic binaural synthesis , 2009 .

[60]  Russell L. Martin,et al.  Sound localization with head movement: implications for 3-d audio displays , 2014, Front. Neurosci..

[61]  Alexander Raake,et al.  A case for TWO ! EARS in audio quality assessment , 2014 .

[62]  Edgar. Y. Choueiri,et al.  Optimal Crosstalk Cancellation for Binaural Audio with Two Loudspeakers , 2010 .

[63]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[64]  Jörg M. Buchholz,et al.  Measurement of a full 3D set of HRTFs for in-ear and hearing aid microphones on a head and torso simulator (HATS) , 2013 .

[65]  Norbert Dillier,et al.  A fast and accurate “shoebox” room acoustics simulator , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[66]  Takashi Takeuchi,et al.  Optimal source distribution for binaural synthesis over loudspeakers. , 2002, The Journal of the Acoustical Society of America.

[67]  D. Lüdecke.  Sjplot - Data Visualization For Statistics In Social Science. , 2018 .

[68]  J. Galster,et al.  The Master Hearing Aid , 2013, Trends in amplification.

[69]  Gitte Keidser,et al.  The effect of multi-channel wide dynamic range compression, noise reduction, and the directional microphone on horizontal localization performance in hearing aid wearers , 2006, International journal of audiology.

[70]  D R Perrott,et al.  Minimum audible angle thresholds for broadband noise as a function of the delay between the onset of the lead and lag signals. , 1989, The Journal of the Acoustical Society of America.

[71]  A. Bronkhorst.  Localization of real and virtual sound sources , 1995 .

[72]  Giso Grimm,et al.  The master hearing Aid : A PC-based platform for algorithm development and evaluation , 2006 .

[73]  J. C. Middlebrooks.  Sound localization. , 2015, Handbook of clinical neurology.

[74]  Kazuhiro Iida,et al.  Median plane localization using a parametric model of the head-related transfer function based on spectral cues , 2007 .

[75]  H. Dillon,et al.  Development and evaluation of the LiSN & learn auditory training software for deficit-specific remediation of binaural processing deficits in children: preliminary findings. , 2011, Journal of the American Academy of Audiology.

[76]  F L Wightman,et al.  Monaural sound localization revisited. , 1997, The Journal of the Acoustical Society of America.

[77]  L. Rayleigh,et al.  XII. On our perception of sound direction , 1907 .

[78]  Yôiti Suzuki,et al.  INVESTIGATION OF SYSTEM LATENCY DETECTION THRESHOLD OF VIRTUAL AUDITORY DISPLAY , 2006 .

[79]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[80]  H. Kayser,et al.  Open signal processing software platform for hearing aid research ( openMHA ) , 2017 .

[81]  Josefa Oberem,et al.  Experiments on localization accuracy with non-individual and individual HRTFs comparing static and dynamic reproduction methods , 2020, bioRxiv.

[82]  Tobias Lentz.  Dynamic crosstalk cancellation for binaural synthesis in virtual reality environments , 2006 .

[83]  Michael Friis Sørensen,et al.  Head-Related Transfer Functions of Human Subjects , 1995 .

[84]  Brian C. J. Moore,et al.  Tolerable Hearing Aid Delays. V. Estimation of Limits for Open Canal Fittings , 2008, Ear and hearing.

[85]  W R Thurlow,et al.  Effect of induced head movements on localization of direction of sounds. , 1967, The Journal of the Acoustical Society of America.

[86]  Janina Fels,et al.  Perceptually Robust Headphone Equalization for Binaural Reproduction , 2011 .

[87]  W R Thurlow,et al.  Effect of stimulus duration on localization of direction noise stimuli. , 1970, Journal of speech and hearing research.

[88]  Volker Hohmann,et al.  Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses , 2009, EURASIP J. Adv. Signal Process..