Speech enhancement for multimicrophone binaural hearing aids aiming to preserve the spatial auditory scene

Modern binaural hearing aids utilize multimicrophone speech enhancement algorithms to enhance signals in terms of signal-to-noise ratio, but they may distort the interaural cues that allow the user to localize sources, in particular, suppressed interfering sources or background noise. In this paper, we present a novel algorithm that enhances the target signal while aiming to maintain the correct spatial rendering of both the target signal as well as the background noise. We use a bimodal approach, where a signal-to-noise ratio (SNR) estimator controls a binary decision mask, switching between the output signals of a binaural minimum variance distortionless response (MVDR) beamformer and scaled reference microphone signals. We show that the proposed selective binaural beamformer (SBB) can enhance the target signal while maintaining the overall spatial rendering of the acoustic scene.

[1]  Marc Moonen,et al.  Theoretical Analysis of Binaural Multimicrophone Noise Reduction Techniques , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Marc Moonen,et al.  Binaural Noise Reduction Algorithms for Hearing Aids That Preserve Interaural Time Delay Cues , 2007, IEEE Transactions on Signal Processing.

[3]  Marc Moonen,et al.  Acoustic Beamforming for Hearing Aid Applications , 2010 .

[4]  Klaus Uwe Simmer,et al.  Superdirective Microphone Arrays , 2001, Microphone Arrays.

[5]  Volker Hohmann,et al.  Robustness Analysis of Binaural Hearing Aid Beamformer Algorithms by Means of Objective Perceptual Quality Measures , 2007, 2007 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[6]  Henning Puder,et al.  Binaural Signal Processing in Hearing Aids: Technologies and Algorithms , 2008 .

[7]  E. C. Cmm,et al.  on the Recognition of Speech, with , 2008 .

[8]  Jesper Jensen,et al.  Maximum likelihood based noise covariance matrix estimation for multi-microphone speech enhancement , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[9]  Jesper Jensen,et al.  Maximum likelihood based multi-channel isotropic reverberation reduction for hearing aids , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[10]  Martin Cooke,et al.  A glimpsing model of speech perception in noise. , 2006, The Journal of the Acoustical Society of America.

[11]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[12]  Giso Grimm,et al.  Binaural noise reduction for hearing AIDS , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  G. Kramer Auditory Scene Analysis: The Perceptual Organization of Sound by Albert Bregman (review) , 2016 .

[14]  David V. Anderson,et al.  Perceptually Inspired Noise-Reduction Method for Binaural Hearing Aids , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Simon Doclo,et al.  Sound Processing for Better Coding of Monaural and Binaural Cues in Auditory Prostheses , 2013, Proceedings of the IEEE.

[16]  DeLiang Wang,et al.  Speech intelligibility of ideal binary masked mixtures , 2010, 2010 18th European Signal Processing Conference.

[17]  B Kollmeier,et al.  Directivity of binaural noise reduction in spatial multiple noise-source arrangements for normal and impaired listeners. , 1997, The Journal of the Acoustical Society of America.

[18]  R. Beutelmann,et al.  Prediction of speech intelligibility in spatial noise and reverberation for normal-hearing and hearing-impaired listeners. , 2006, The Journal of the Acoustical Society of America.

[19]  P. Peterson,et al.  Intelligibility-weighted measures of speech-to-interference ratio and speech system performance. , 1993, The Journal of the Acoustical Society of America.

[20]  Hao Ye,et al.  Maximum likelihood DOA estimation and asymptotic Cramer-Rao bounds for additive unknown colored noise , 1995, IEEE Trans. Signal Process..

[21]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[22]  Marc Moonen,et al.  The effect of multimicrophone noise reduction systems on sound source localization by users of binaural hearing aids. , 2008, The Journal of the Acoustical Society of America.

[23]  Volker Hohmann,et al.  Perceptually motivated coherence preservation in multi-channel wiener filtering based noise reduction for binaural hearing aids , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[25]  Ruth Y Litovsky,et al.  The benefit of binaural hearing in a cocktail party: effect of location and type of interferer. , 2004, The Journal of the Acoustical Society of America.

[26]  Volker Hohmann,et al.  Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses , 2009, EURASIP J. Adv. Signal Process..

[27]  Peter Vary,et al.  Dual-Channel Speech Enhancement by Superdirective Beamforming , 2006, EURASIP J. Adv. Signal Process..

[28]  Volker Hohmann,et al.  Auditory model based direction estimation of concurrent speakers from binaural signals , 2011, Speech Commun..

[29]  Sven Nordholm,et al.  Multichannel Signal Enhancement Algorithms for Assisted Listening Devices: Exploiting spatial diversity using multiple microphones , 2015, IEEE Signal Processing Magazine.

[30]  Joerg Bitzer,et al.  Post-Filtering Techniques , 2001, Microphone Arrays.

[31]  Volker Hohmann,et al.  Interaural Coherence Preservation in Multi-Channel Wiener Filtering-Based Noise Reduction for Binaural Hearing Aids , 2013, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[32]  Ehud Weinstein,et al.  Signal enhancement using beamforming and nonstationarity with applications to speech , 2001, IEEE Trans. Signal Process..

[33]  Marc Moonen,et al.  Speech enhancement with multichannel Wiener filter techniques in multimicrophone binaural hearing aids. , 2009, The Journal of the Acoustical Society of America.

[34]  Steven van de Par,et al.  A binaural hearing aid speech enhancement method maintaining spatial awareness for the user , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[35]  Walter Kellermann,et al.  Analysis of two generic Wiener filtering concepts for binaural speech enhancement in hearing aids , 2010, 2010 18th European Signal Processing Conference.

[36]  DeLiang Wang,et al.  Isolating the energetic component of speech-on-speech masking with ideal time-frequency segregation. , 2006, The Journal of the Acoustical Society of America.