Sound Source Localization for Hearing Aid Applications Using Wireless Microphones

State-of-the-art hearing aids (HAs) can connect to a wireless microphone worn by a talker of interest. This ability allows HAs to have access to almost noise-free sound signals of the target talker. In this paper, we aim to estimate the direction of arrival (DoA) of the target signal, given access to the noise-free target signal. Knowing the DoA of the target signal enables HAs to spatialize the wirelessly received target signals. The proposed estimator is based on a maximum likelihood (ML) approach and a database of DoA-dependent relative transfer functions (RTFs), and it supports both monaural and binaural microphone array configurations. For binaural configurations, we propose an information fusion strategy, which decreases the number of parameters required to be wirelessly transferred between the HAs. Further, we show that the proposed method not only has lower computational complexity, but also performs better than recent DoA estimators, which have access to the noise-free target signal.

[1]  D. Brillinger Time series - data analysis and theory , 1981, Classics in applied mathematics.

[2]  James M. Kates,et al.  Digital hearing aids. , 2008, Harvard health letter.

[3]  Israel Cohen,et al.  Linear System Identification in the Short-Time Fourier Transform Domain , 2010 .

[4]  Volker Hohmann,et al.  Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses , 2009, EURASIP J. Adv. Signal Process..

[5]  Jesper Jensen,et al.  Informed TDoA-based direction of arrival estimation for hearing aid applications , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[6]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[7]  Michael Syskind Pedersen,et al.  Bias-Compensated Informed Sound Source Localization Using Relative Transfer Functions , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[8]  Rainer Martin,et al.  Noise power spectral density estimation based on optimal smoothing and minimum statistics , 2001, IEEE Trans. Speech Audio Process..

[9]  Gilles Courtois,et al.  Spatial hearing rendering in wireless microphone systems for binaural hearing aids , 2016 .

[10]  Jesper Jensen,et al.  Maximum likelihood approach to “informed” Sound Source Localization for Hearing Aid applications , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Jesper Jensen,et al.  Informed Direction of Arrival estimation using a spherical-head model for Hearing Aid applications , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Gregory H. Wakefield,et al.  Introduction to Head-Related Transfer Functions (HRTFs): Representations of HRTFs in Time, Frequency, and Space , 2001 .

[13]  Jesper Jensen,et al.  DFT-Domain Based Single-Microphone Noise Reduction for Speech Enhancement , 2013, DFT-Domain Based Single-Microphone Noise Reduction for Speech Enhancement.

[14]  Peter Vary,et al.  Binaural dereverberation based on a dual-channel Wiener filter with optimized noise field coherence , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  R. Duda,et al.  Range dependence of the response of a spherical head model , 1998 .

[16]  Søren Holdt Jensen,et al.  Maximum Likelihood PSD Estimation for Speech Enhancement in Reverberation and Noise , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[17]  James M Kates,et al.  Externalization of remote microphone signals using a structural binaural model of the head and pinna. , 2018, The Journal of the Acoustical Society of America.

[18]  Jesper Jensen,et al.  Informed Sound Source Localization Using Relative Transfer Functions for Hearing Aid Applications , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[19]  D. Williamson,et al.  The box plot: a simple visual method to interpret data. , 1989, Annals of internal medicine.

[20]  Patrick Marmaroli,et al.  Implementation of a binaural localization algorithm in hearing aids: Specifications and achievable solutions , 2014 .

[21]  M Samantha Lewis,et al.  Speech perception in noise: directional microphones versus frequency modulation (FM) systems. , 2004, Journal of the American Academy of Audiology.

[22]  Mojtaba Farmani Informed Sound Source Localization for Hearing Aid Applications , 2017 .

[23]  Martin Vetterli,et al.  Fast Fourier transforms: a tutorial review and a state of the art , 1990 .

[24]  Sven Nordholm,et al.  Multichannel Signal Enhancement Algorithms for Assisted Listening Devices: Exploiting spatial diversity using multiple microphones , 2015, IEEE Signal Processing Magazine.

[25]  Jesper Jensen,et al.  Maximum Likelihood PSD Estimation for Speech Enhancement in Reverberation and Noise , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.