A method to enhance the use of interaural time differences for cochlear implants in reverberant environments

The ability of normal-hearing (NH) listeners to exploit interaural time difference (ITD) cues conveyed in the modulated envelopes of high-frequency sounds is poor compared to ITD cues transmitted in the temporal fine structure at low frequencies. Sensitivity to envelope ITDs is further degraded when envelopes become less steep, when modulation depth is reduced, and when envelopes become less similar between the ears, common factors when listening in reverberant environments. The vulnerability of envelope ITDs is particularly problematic for cochlear implant (CI) users, as they rely on information conveyed by slowly varying amplitude envelopes. Here, an approach to improve access to envelope ITDs for CIs is described in which, rather than attempting to reduce reverberation, the perceptual saliency of cues relating to the source is increased by selectively sharpening peaks in the amplitude envelope judged to contain reliable ITDs. Performance of the algorithm with room reverberation was assessed through simulating listening with bilateral CIs in headphone experiments with NH listeners. Relative to simulated standard CI processing, stimuli processed with the algorithm generated lower ITD discrimination thresholds and increased extents of laterality. Depending on parameterization, intelligibility was unchanged or somewhat reduced. The algorithm has the potential to improve spatial listening with CIs.

[1]  Volker Hohmann,et al.  The influence of different segments of the ongoing envelope on sensitivity to interaural time delays. , 2011, The Journal of the Acoustical Society of America.

[2]  Stuart Rosen,et al.  Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[3]  Jan Wouters,et al.  Modulation Enhancement in the Electrical Signal Improves Perception of Interaural Time Differences with Bimodal Stimulation , 2014, Journal of the Association for Research in Otolaryngology.

[4]  Leslie R Bernstein,et al.  Lateralization produced by interaural temporal and intensitive disparities of high-frequency, raised-sine stimuli: data and modeling. , 2012, The Journal of the Acoustical Society of America.

[5]  Douglas E. H. Hartley,et al.  Envelope Enhancement Increases Cortical Sensitivity to Interaural Envelope Delays with Acoustic and Electric Hearing , 2014, PloS one.

[6]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[7]  John Mourjopoulos,et al.  Speech dereverberation based on a recorded handclap , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[8]  Astrid van Wieringen,et al.  Improved fundamental frequency coding in cochlear implant signal processing. , 2009, The Journal of the Acoustical Society of America.

[9]  Kostas Kokkinakis,et al.  A channel-selection criterion for suppressing reverberation in cochlear implants. , 2011, The Journal of the Acoustical Society of America.

[10]  L Geurts,et al.  Coding of the fundamental frequency in continuous interleaved sampling processors for cochlear implants. , 2001, The Journal of the Acoustical Society of America.

[11]  Bernhard U. Seeber,et al.  A system to simulate and reproduce audio–visual environments for spatial hearing research , 2010, Hearing Research.

[12]  Carl Verschuur,et al.  Evaluation of a non-linear spectral subtraction noise suppression scheme in cochlear implant users. , 2006, Cochlear implants international.

[13]  Bernhard U Seeber,et al.  Failure of the precedence effect with a noise-band vocoder. , 2011, The Journal of the Acoustical Society of America.

[14]  J. Flanagan Analog Measurements of Sound Radiation from the Mouth , 1960 .

[15]  Piotr Majdak,et al.  Effects of envelope shape on interaural envelope delay sensitivity in acoustic and electric hearing. , 2011, The Journal of the Acoustical Society of America.

[16]  Brian C J Moore,et al.  Coding of Sounds in the Auditory System and Its Relevance to Signal Processing and Coding in Cochlear Implants , 2003, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[17]  Leslie R Bernstein,et al.  Enhancing interaural-delay-based extents of laterality at high frequencies by using "transposed stimuli". , 2003, The Journal of the Acoustical Society of America.

[18]  IEEE Recommended Practice for Speech Quality Measurements , 1969, IEEE Transactions on Audio and Electroacoustics.

[19]  Bernhard U. Seeber,et al.  Localization in Reverberation with Cochlear Implants , 2013, Journal of the Association for Research in Otolaryngology.

[20]  Leslie R Bernstein,et al.  Lateralization produced by interaural intensitive disparities appears to be larger for high- vs low-frequency stimuli. , 2011, The Journal of the Acoustical Society of America.

[21]  Jens Blauert,et al.  The AUDIS catalog of human HRTFs , 1998 .

[22]  Piotr Majdak,et al.  Lateralization discrimination of interaural time delays in four-pulse sequences in electric and acoustic hearing. , 2007, The Journal of the Acoustical Society of America.

[23]  William M. Whitmer,et al.  Improved estimation of direction of arrival of sound sources for hearing aids using gyroscopic information , 2013 .

[24]  R. Tyler,et al.  Speech perception, localization, and lateralization with bilateral cochlear implants. , 2003, The Journal of the Acoustical Society of America.

[25]  David McAlpine,et al.  Sensitivity to Envelope Interaural Time Differences at High Modulation Rates , 2015, Trends in hearing.

[26]  Leslie R Bernstein,et al.  Enhancing sensitivity to interaural delays at high frequencies by using "transposed stimuli". , 2002, The Journal of the Acoustical Society of America.

[27]  Kostas Kokkinakis,et al.  Using blind source separation techniques to improve speech recognition in bilateral cochlear implant patients. , 2008, The Journal of the Acoustical Society of America.

[28]  B. Seeber,et al.  Localization cues with bilateral cochlear implants. , 2008, The Journal of the Acoustical Society of America.

[29]  John Mourjopoulos,et al.  Blind single-channel suppression of late reverberation based on perceptual reverberation modeling. , 2011, The Journal of the Acoustical Society of America.

[30]  C. Faller,et al.  Source localization in complex listening situations: selection of binaural cues based on interaural coherence. , 2004, The Journal of the Acoustical Society of America.

[31]  Oldooz Hazrati,et al.  Blind binary masking for reverberation suppression in cochlear implants. , 2013, The Journal of the Acoustical Society of America.

[32]  Richard L Freyman,et al.  Effects of reverberation and masking on speech intelligibility in cochlear implant simulations. , 2006, The Journal of the Acoustical Society of America.

[33]  C Trahiotis,et al.  Lateralization of sinusoidally amplitude-modulated tones: effects of spectral locus and temporal variation. , 1985, The Journal of the Acoustical Society of America.

[34]  Leslie R Bernstein,et al.  Lateralization produced by envelope-based interaural temporal disparities of high-frequency, raised-sine stimuli: empirical data and modeling. , 2011, The Journal of the Acoustical Society of America.

[35]  A. Mills On the minimum audible angle , 1958 .

[36]  Jan Wouters,et al.  The potential of onset enhancement for increased speech intelligibility in auditory prostheses. , 2012, The Journal of the Acoustical Society of America.

[37]  Jessica J. M. Monaghan,et al.  Factors affecting the use of envelope interaural time differences in reverberation. , 2013, The Journal of the Acoustical Society of America.

[38]  Jan Wouters,et al.  Perception of Mandarin Chinese with cochlear implants using enhanced temporal pitch cues , 2012, Hearing Research.

[39]  Peter Vary,et al.  A Semi-Analytical Model for the Binaural Coherence of Noise Fields , 2011, IEEE Signal Processing Letters.

[40]  Constantine Trahiotis,et al.  How sensitivity to ongoing interaural temporal disparities is affected by manipulations of temporal features of the envelopes of high-frequency stimuli. , 2009, The Journal of the Acoustical Society of America.

[41]  DeLiang Wang,et al.  A two-stage algorithm for one-microphone reverberant speech enhancement , 2006, IEEE Transactions on Audio, Speech, and Language Processing.