Using blind source separation techniques to improve speech recognition in bilateral cochlear implant patients.

Bilateral cochlear implants seek to restore the advantages of binaural hearing by improving access to binaural cues. Bilateral implant users are currently fitted with two processors, one in each ear, operating independent of one another. In this work, a different approach to bilateral processing is explored based on blind source separation (BSS) by utilizing two implants driven by a single processor. Sentences corrupted by interfering speech or speech-shaped noise are presented to bilateral cochlear implant users at 0 dB signal-to-noise ratio in order to evaluate the performance of the proposed BSS method. Subjects are tested in both anechoic and reverberant settings, wherein the target and masker signals are spatially separated. Results indicate substantial improvements in performance in both anechoic and reverberant settings over the subjects' daily strategies for both masker conditions and at various locations of the masker. It is speculated that such improvements are due to the fact that the proposed BSS algorithm capitalizes on the variations of interaural level differences and interaural time delays present in the mixtures of the signals received by the two microphones, and exploits that information to spatially separate the target from the masker signals.

[1]  Asoke K. Nandi,et al.  Exponent parameter estimation for generalized Gaussian probability density functions with application to speech modeling , 2005, Signal Process..

[2]  S Hellman,et al.  Effects of noise and noise suppression on speech perception by cochlear implant users. , 1992, Ear and hearing.

[3]  M. Schroeder New Method of Measuring Reverberation Time , 1965 .

[4]  Richard S Tyler,et al.  Update on bilateral cochlear implantation , 2003, Current opinion in otolaryngology & head and neck surgery.

[5]  G M Clark,et al.  Evaluation of a portable two-microphone adaptive beamforming speech processor with cochlear implant patients. , 1995, The Journal of the Acoustical Society of America.

[6]  Reinhold Orglmeister,et al.  Blind source separation of real world signals , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[7]  James V. Stone Independent Component Analysis: A Tutorial Introduction , 2007 .

[8]  Richard L Freyman,et al.  Effects of reverberation and masking on speech intelligibility in cochlear implant simulations. , 2006, The Journal of the Acoustical Society of America.

[9]  Lawrence E. Kinsler,et al.  Fundamentals of acoustics , 1950 .

[10]  Barbara G. Shinn-Cunningham,et al.  Effects of reverberation on spatial auditory performance and spatial auditory cues , 2002 .

[11]  Q. Fu,et al.  Spectral subtraction-based speech enhancement for cochlear implant patients in background noise. , 2005, The Journal of the Acoustical Society of America.

[12]  P M Zurek,et al.  Evaluation of an adaptive beamforming method for hearing aids. , 1992, The Journal of the Acoustical Society of America.

[13]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[14]  J. Müller,et al.  Speech Understanding in Quiet and Noise in Bilateral Users of the MED-EL COMBI 40/40+ Cochlear Implant System , 2002, Ear and hearing.

[15]  Philipos C. Loizou,et al.  Mimicking the human ear , 1998, IEEE Signal Process. Mag..

[16]  R. Lambert Multichannel blind deconvolution: FIR matrix algebra and separation of multipath mixtures , 1996 .

[17]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[18]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[19]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[20]  L. J. Griffiths,et al.  An alternative approach to linearly constrained adaptive beamforming , 1982 .

[21]  Yunxin Zhao,et al.  Adaptive co-channel speech separation and recognition , 1999, IEEE Trans. Speech Audio Process..

[22]  Fan-Gang Zeng,et al.  Cochlear implant speech recognition with speech maskers. , 2004, The Journal of the Acoustical Society of America.

[23]  Lucas C. Parra Realistic application of acoustic blind source separation , 2000 .

[24]  Jean-Francois Cardoso,et al.  Source separation using higher order moments , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[25]  Asoke K. Nandi,et al.  Optimal blind separation of convolutive audio mixtures without temporal constraints , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  D T Lawson,et al.  Bilateral cochlear implants controlled by a single speech processor. , 1998, The American journal of otology.

[27]  J. Shynk Frequency-domain and multirate adaptive filtering , 1992, IEEE Signal Processing Magazine.

[28]  J. S. Bradley,et al.  Reverberation time and maximum background-noise level for classrooms from a comparative study of speech intelligibility metrics. , 2000, Journal of the Acoustical Society of America.

[29]  Philipos C Loizou,et al.  Speech processing in vocoder-centric cochlear implants. , 2006, Advances in oto-rhino-laryngology.

[30]  H Rudert,et al.  Effects of noise on speech discrimination in cochlear implant patients. , 1995, The Annals of otology, rhinology & laryngology. Supplement.

[31]  Russell H. Lambert,et al.  Blind separation of multiple speakers in a multipath environment , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[32]  Josh H. McDermott The cocktail party problem , 2009, Current Biology.

[33]  A. Nabelek,et al.  Reverberant overlap- and self-masking in consonant identification. , 1989, The Journal of the Acoustical Society of America.

[34]  Blake S Wilson,et al.  Three-Month Results with Bilateral Cochlear Implants , 2002, Ear and hearing.

[35]  V Hamacher,et al.  Evaluation of noise reduction systems for cochlear implant users in different acoustic environment. , 1997, The American journal of otology.

[36]  G M Clark,et al.  Psychophysical studies with two binaural cochlear implant subjects. , 1997, The Journal of the Acoustical Society of America.

[37]  P. W. Smith,et al.  Comments on “New Method of Measuring Reverberation Time” [M. R. Schroeder, J. Acoust. Soc. Am. 37, 409–412 (1965)] , 1965 .

[38]  R. Freyman,et al.  Effects of reverberation on spatial release from masking , 2002 .

[39]  Barbara G Shinn-Cunningham,et al.  Localizing nearby sound sources in a classroom: binaural room impulse responses. , 2005, The Journal of the Acoustical Society of America.

[40]  E. Oja,et al.  Independent Component Analysis , 2013 .

[41]  J. Pickett,et al.  Monaural and binaural speech perception through hearing aids under noise and reverberation with normal and hearing-impaired listeners. , 1974, Journal of speech and hearing research.

[42]  Pavel Zahorik,et al.  Direct-to-reverberant energy ratio sensitivity. , 2002, The Journal of the Acoustical Society of America.

[43]  K. Plant,et al.  Speech Perception as a Function of Electrical Stimulation Rate: Using the Nucleus 24 Cochlear Implant System , 2000, Ear and hearing.

[44]  Michael K. Qin,et al.  Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers. , 2003, The Journal of the Acoustical Society of America.

[45]  Jens Blauert,et al.  The AUDIS catalog of human HRTFs , 1998 .

[46]  Philipos C. Loizou,et al.  Subband-Based Blind Signal Processing for Source Separation in Convolutive Mixtures of Speech , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[47]  Yi Hu,et al.  Subspace algorithms for noise reduction in cochlear implants. , 2005, The Journal of the Acoustical Society of America.

[48]  R. Tyler,et al.  Speech perception, localization, and lateralization with bilateral cochlear implants. , 2003, The Journal of the Acoustical Society of America.

[49]  IEEE Recommended Practice for Speech Quality Measurements , 1969, IEEE Transactions on Audio and Electroacoustics.

[50]  S. Haykin Blind source separation , 2000 .

[51]  Yunxin Zhao,et al.  On application of adaptive decorrelation filtering to assistive listening. , 2002, The Journal of the Acoustical Society of America.

[52]  M R Weiss Effects of noise and noise reduction processing on the operation of the Nucleus-22 cochlear implant processor. , 1993, Journal of rehabilitation research and development.

[53]  Asoke K. Nandi,et al.  Multichannel blind deconvolution for source separation in convolutive mixtures of speech , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[54]  E. Shaw Transformation of sound pressure level from the free field to the eardrum in the horizontal plane. , 1974, The Journal of the Acoustical Society of America.

[55]  Chaz Yee Toh,et al.  Effects of reverberation on perceptual segregation of competing voices. , 2003, The Journal of the Acoustical Society of America.

[56]  Lawrence E. Kinsler,et al.  Fundamentals of Acoustics, 4th Edition , 1999 .