Personalized signal-independent beamforming for binaural hearing aids.

The effect of personalized microphone array calibration on the performance of hearing aid beamformers under noisy reverberant conditions is studied. The study makes use of a new, publicly available, database containing acoustic transfer function measurements from 29 loudspeakers arranged on a sphere to a pair of behind-the-ear hearing aids in a listening room when worn by 27 males, 14 females, and 4 mannequins. Bilateral and binaural beamformers are designed using each participant's hearing aid head-related impulse responses (HAHRIRs). The performance of these personalized beamformers is compared to that of mismatched beamformers, where the HAHRIR used for the design does not belong to the individual for whom performance is measured. The case where the mismatched HAHRIR is that of a mannequin is of particular interest since it represents current practice in commercially available hearing aids. The benefit of personalized beamforming is assessed using an intrusive binaural speech intelligibility metric and in a matrix speech intelligibility test. For binaural beamforming, both measures demonstrate a statistically signficant (p < 0.05) benefit of personalization. The benefit varies substantially between individuals with some predicted to benefit by as much as 1.5 dB.

[1]  W. E. Kock.  Binaural Localization and Masking , 1950 .

[2]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[3]  Walter Kellermann,et al.  HRTF-based robust least-squares frequency-invariant beamforming , 2015, 2015 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).

[4]  Virginia Best,et al.  Acoustic analysis of the directional information captured by five different hearing aid styles. , 2014, The Journal of the Acoustical Society of America.

[5]  Craig T. Jin,et al.  Design, Optimization and Evaluation of a Dual-Radius Spherical Microphone Array , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[6]  Sharon Gannot,et al.  Evaluation and Comparison of Late Reverberation Power Spectral Density Estimators , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[7]  Craig T. Jin,et al.  Creating the Sydney York Morphological and Acoustic Recordings of Ears Database , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[8]  Walter Kellermann,et al.  Coherent-to-Diffuse Power Ratio Estimation for Dereverberation , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[9]  Israel Cohen,et al.  On Multiplicative Transfer Function Approximation in the Short-Time Fourier Transform Domain , 2007, IEEE Signal Processing Letters.

[10]  Ivan Tashev,et al.  Interaural time delay personalisation using incomplete head scans , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Sylvain Emmanuel Favrot,et al.  Improving hearing aids through listening tests in a virtual sound environment , 2010 .

[12]  J M Kates,et al.  A comparison of hearing-aid array processing techniques. , 1996, The Journal of the Acoustical Society of America.

[13]  Ivan Tashev.  Gain self-calibration procedure for microphone arrays , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[14]  Sven Nordholm,et al.  Multichannel Signal Enhancement Algorithms for Assisted Listening Devices: Exploiting spatial diversity using multiple microphones , 2015, IEEE Signal Processing Magazine.

[15]  K. Wagener,et al.  Design, optimization and evaluation of a Danish sentence test in noise: Diseño, optimización y evaluación de la prueba Danesa de frases en ruido , 2003, International journal of audiology.

[16]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[17]  Jonathan Le Roux,et al.  Explicit consistency constraints for STFT spectrograms and their application to phase reconstruction , 2008, SAPA@INTERSPEECH.

[18]  Hans-Jörg Pfleiderer,et al.  Self-calibrating microphone arrays for speech signal acquisition: A systematic approach , 2006, Signal Process..

[19]  Emmanuel Vincent,et al.  A Consolidated Perspective on Multimicrophone Speech Enhancement and Source Separation , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[20]  Marc Moonen,et al.  THEORETICAL ANALYSIS OF BINAURAL CUE PRESERVATION USING MULTI-CHANNEL WIENER FILTERING AND INTERAURAL TRANSFER FUNCTIONS , 2006 .

[21]  S Harder,et al.  Reliability in Measuring Head Related Transfer Functions of Hearing Aids. , 2015, Acta acustica united with acustica : the journal of the European Acoustics Association.

[22]  Birger Kollmeier,et al.  Adapting Hearing Devices to the Individual Ear Acoustics: Database and Target Response Correction Functions for Various Device Styles , 2018, Trends in hearing.

[23]  Jesper Jensen,et al.  Predicting the Intelligibility of Noisy and Nonlinearly Processed Binaural Speech , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[24]  Peter Vary,et al.  A binaural room impulse response database for the evaluation of dereverberation algorithms , 2009, 2009 16th International Conference on Digital Signal Processing.

[25]  Ivan Tashev,et al.  Optimal 3D Beamforming Using Measured Microphone Directivity Patterns , 2012, IWAENC.

[26]  Jae Lim,et al.  Signal estimation from modified short-time Fourier transform , 1984 .

[27]  Israel Cohen,et al.  System Identification in the Short-Time Fourier Transform Domain With Crossband Filtering , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[28]  Volker Hohmann,et al.  Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses , 2009, EURASIP J. Adv. Signal Process..

[29]  Sergiy A. Vorobyov,et al.  Principles of minimum variance robust adaptive beamforming design , 2013, Signal Process..

[30]  Archontis Politis,et al.  Comparing modeled and measurement-based spherical harmonic encoding filters for spherical microphone arrays , 2017, 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).

[31]  L. J. Griffiths,et al.  An alternative approach to linearly constrained adaptive beamforming , 1982 .

[32]  Angelo Farina,et al.  Simultaneous Measurement of Impulse Response and Distortion with a Swept-Sine Technique , 2000 .

[33]  D. Bates,et al.  fitting linear mixed effects models using lme 4 arxiv , 2014 .

[34]  Jörg M. Buchholz,et al.  Measurement of a full 3D set of HRTFs for in-ear and hearing aid microphones on a head and torso simulator (HATS) , 2013 .

[35]  Marc Moonen,et al.  Speech intelligibility improvements with hearing aids using bilateral and binaural adaptive multichannel Wiener filtering based noise reduction. , 2012, The Journal of the Acoustical Society of America.

[36]  Marc Moonen,et al.  Superdirective Beamforming Robust Against Microphone Mismatch , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[37]  Henry Cox,et al.  Practical supergain , 1986, IEEE Trans. Acoust. Speech Signal Process..

[38]  Jacques A Grange,et al.  The benefit of head orientation to speech intelligibility in noise. , 2016, The Journal of the Acoustical Society of America.

[39]  Asger Heidemann Andersen.  Speech Intelligibility Prediction for Hearing Aid Systems , 2017 .

[40]  V. Ralph Algazi,et al.  Estimation of a Spherical-Head Model from Anthropometry , 2001 .

[41]  P. P. Vaidyanathan,et al.  Quadratically Constrained Beamforming Robust Against Direction-of-Arrival Mismatch , 2007, IEEE Transactions on Signal Processing.

[42]  Jesper Jensen,et al.  Refinement and validation of the binaural short time objective intelligibility measure for spatially diverse conditions , 2018, Speech Commun..

[43]  J. Capon.  High-resolution frequency-wavenumber spectrum analysis , 1969 .