Parameter tuning of time-frequency masking algorithms for reverberant artifact removal within the cochlear implant stimulus

Cochlear implant users struggle to understand speech in reverberant environments. To restore speech perception, artifacts dominated by reverberant reflections can be removed from the cochlear implant stimulus. Artifacts can be identified and removed by applying a matrix of gain values, a technique referred to as time-frequency masking. Gain values are determined by an oracle algorithm that uses knowledge of the undistorted signal to minimize retention of the signal components dominated by reverberant reflections. In practice, gain values are estimated from the distorted signal, with the oracle algorithm providing the estimation objective. Different oracle techniques exist for determining gain values, and each technique must be parameterized to set the amount of signal retention. This work assesses which oracle masking strategies and parameterizations lead to the best improvements in speech intelligibility for cochlear implant users in reverberant conditions using online speech intelligibility testing of normal-hearing individuals with vocoding.

[1]  DeLiang Wang,et al.  A deep learning based segregation algorithm to increase speech intelligibility for hearing-impaired listeners in reverberant-noisy conditions. , 2018, The Journal of the Acoustical Society of America.

[2]  DeLiang Wang,et al.  On Ideal Binary Mask As the Computational Goal of Auditory Scene Analysis , 2005, Speech Separation by Humans and Machines.

[3]  Philipos C Loizou,et al.  Speech processing in vocoder-centric cochlear implants. , 2006, Advances in oto-rhino-laryngology.

[4]  A.V. Oppenheim,et al.  Enhancement and bandwidth compression of noisy speech , 1979, Proceedings of the IEEE.

[5]  Richard L Freyman,et al.  Speech intelligibility in cochlear implant simulations: Effects of carrier type, interfering noise, and subject experience. , 2007, The Journal of the Acoustical Society of America.

[6]  Seyed Omid Sadjadi,et al.  Simultaneous suppression of noise and reverberation in cochlear implants using a ratio masking strategy. , 2013, The Journal of the Acoustical Society of America.

[7]  Oldooz Hazrati,et al.  Blind binary masking for reverberation suppression in cochlear implants. , 2013, The Journal of the Acoustical Society of America.

[8]  Lauren Calandruccio,et al.  Determination of the Potential Benefit of Time-Frequency Gain Manipulation , 2006, Ear and hearing.

[9]  Oldooz Hazrati,et al.  Tackling the combined effects of reverberation and masking noise using ideal channel selection. , 2012, Journal of speech, language, and hearing research : JSLHR.

[10]  DeLiang Wang,et al.  A deep learning algorithm to increase intelligibility for hearing-impaired listeners in the presence of a competing talker and reverberation. , 2019, The Journal of the Acoustical Society of America.

[11]  P. Loizou,et al.  Factors influencing intelligibility of ideal binary-masked speech: implications for noise reduction. , 2008, The Journal of the Acoustical Society of America.

[12]  H J McDermott,et al.  A new portable sound processor for the University of Melbourne/Nucleus Limited multielectrode cochlear implant. , 1992, The Journal of the Acoustical Society of America.

[13]  Nilesh Madhu,et al.  Ideal Time–Frequency Masking Algorithms Lead to Different Speech Intelligibility and Quality in Normal-Hearing and Cochlear Implant Listeners , 2015, IEEE Transactions on Biomedical Engineering.

[14]  Abigail A. Kressner,et al.  The impact of reverberation on speech intelligibility in cochlear implant recipients. , 2018, The Journal of the Acoustical Society of America.

[15]  Philipos C. Loizou,et al.  Speech Enhancement: Theory and Practice , 2007 .

[16]  G. Studebaker.  A "rationalized" arcsine transform. , 1985, Journal of speech and hearing research.

[17]  Peter Vary,et al.  A binaural room impulse response database for the evaluation of dereverberation algorithms , 2009, 2009 16th International Conference on Digital Signal Processing.

[18]  S. Soli,et al.  Development of the Hearing in Noise Test for the measurement of speech reception thresholds in quiet and in noise. , 1994, The Journal of the Acoustical Society of America.

[19]  DeLiang Wang,et al.  Time-Frequency Masking for Speech Separation and Its Potential for Hearing Aid Design , 2008 .

[20]  Kostas Kokkinakis,et al.  A channel-selection criterion for suppressing reverberation in cochlear implants. , 2011, The Journal of the Acoustical Society of America.

[21]  Joshua J. Hajicek,et al.  Combined Effects of Noise and Reverberation on Speech Recognition Performance of Normal-Hearing Children and Adults , 2010, Ear and hearing.

[22]  Nicoleta Roman,et al.  Speech intelligibility in reverberation with ideal binary masking: effects of early reflections and signal-to-noise ratio threshold. , 2013, The Journal of the Acoustical Society of America.