How cochlear implants encode speech

Purpose of reviewThis review summarizes the history of cochlear implant signal processing and provides the rationale underlying current approaches. Present strategies are explained and recent research findings are summarized. It is suggested how these results may drive future advancements in signal processing. Recent findingsSubstantial advances have been made in our understanding of the spectral and temporal cues necessary for cochlear implant recipients to perceive music, speech in noise, and interaural timing. It is clear that higher levels of both spectral and temporal resolution, as well as better loudness and pitch coding are necessary for higher levels of performance. These factors are highly interrelated, however, and are beneficial for differing aspects of hearing. Signal processing algorithms incorporating these findings are under active development and some are currently undergoing clinical investigation. SummaryCurrent implant devices, and those soon to be available, have substantial untapped potential to improve the auditory experience of their recipients. It is likely that in the near future, recent findings on pitch and loudness perception, as well as techniques to better emulate the normal functions of the cochlea will result in much higher levels of prosthetic hearing fidelity than are possible today. As the performance of these remarkable devices continues to improve, the population of hearing-impaired individuals who can benefit from implantation is likely to increase significantly.

[1]  Zachary M. Smith,et al.  Chimaeric sounds reveal dichotomies in auditory perception , 2002, Nature.

[2]  Deniz Baskent,et al.  Speech recognition under conditions of frequency-place compression and expansion. , 2003, The Journal of the Acoustical Society of America.

[3]  Renato Nobili,et al.  How well do we understand the cochlea? , 1998, Trends in Neurosciences.

[4]  Hugh J. McDermott,et al.  Application of loudness models to sound processing for cochlear implants. , 2003, The Journal of the Acoustical Society of America.

[5]  B J Gantz,et al.  Single-channel to multichannel conversions in adult cochlear implant subjects. , 1998, The American journal of otology.

[6]  Peter J. Blamey,et al.  Tone discrimination in Cantonese-speaking children using a cochlear implant , 2002, Clinical linguistics & phonetics.

[7]  Monita Chatterjee,et al.  Modulation masking in cochlear implant listeners: envelope versus tonotopic components. , 2003, The Journal of the Acoustical Society of America.

[8]  J. Knutson,et al.  The effects of familiarity and complexity on appraisal of complex songs by cochlear implant recipients and normal hearing adults. , 2003, Journal of music therapy.

[9]  B. Moore An Introduction to the Psychology of Hearing , 1977 .

[10]  Charles A. Miller,et al.  Electrode configuration influences action potential initiation site and ensemble stochastic response properties , 2003, Hearing Research.

[11]  Stuart Rosen,et al.  Simulations of tonotopically mapped speech processors for cochlear implant electrodes varying in insertion depth. , 2003, The Journal of the Acoustical Society of America.

[12]  Jan Wouters,et al.  Better place-coding of the fundamental frequency in cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[13]  B. Moore,et al.  Effect of the speed of a single-channel dynamic range compressor on intelligibility in a competing speech task. , 2003, The Journal of the Acoustical Society of America.

[14]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[15]  R. Cowan,et al.  Spatial spread of neural excitation in cochlear implant recipients: comparison of improved ECAP method and psychophysical forward masking , 2003, Hearing Research.

[16]  Richard S Tyler,et al.  Update on bilateral cochlear implantation , 2003, Current opinion in otolaryngology & head and neck surgery.

[17]  Astrid van Wieringen,et al.  Temporal pitch mechanisms in acoustic and electric hearing. , 2002, The Journal of the Acoustical Society of America.

[18]  P. Belafsky,et al.  Topical Nasal Anesthesia and Laryngopharyngeal Sensory Testing: A Prospective, Double-Blind Crossover Study , 2003, The Annals of otology, rhinology, and laryngology.

[19]  B. Moore Cochlear Hearing Loss , 2019, The SAGE Encyclopedia of Human Communication Sciences and Disorders.

[20]  Leslie M Collins,et al.  Psychophysical threshold variability in cochlear implant subjects , 2003, Hearing Research.

[21]  Brian C J Moore,et al.  Coding of Sounds in the Auditory System and Its Relevance to Signal Processing and Coding in Cochlear Implants , 2003, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[22]  Paul J. Abbas,et al.  Effects of electrode-to-fiber distance on temporal neural response with electrical stimulation , 2004, IEEE Transactions on Biomedical Engineering.

[23]  D. Eddington Speech discrimination in deaf subjects with cochlear implants. , 1979, The Journal of the Acoustical Society of America.

[24]  Nam H. Kim,et al.  Three-dimensional localization of cochlear implant electrodes using epipolar stereophotogrammetry , 2004, IEEE Transactions on Biomedical Engineering.

[25]  Heather A. Kreft,et al.  Effects of pulse rate on threshold and dynamic range in Clarion cochlear-implant users. , 2004, The Journal of the Acoustical Society of America.

[26]  Bruce J Gantz,et al.  Speech recognition in noise for cochlear implant listeners: benefits of residual acoustic hearing. , 2004, The Journal of the Acoustical Society of America.

[27]  Bryan E Pfingst,et al.  Relative importance of temporal envelope and fine structure in lexical-tone perception. , 2003, The Journal of the Acoustical Society of America.

[28]  Blake S Wilson,et al.  Cochlear implants: some likely next steps. , 2003, Annual review of biomedical engineering.

[29]  Robert S Hong,et al.  High-rate conditioning pulse trains in cochlear implants: dynamic range measures with sinusoidal stimuli. , 2003, The Journal of the Acoustical Society of America.

[30]  Charles A. Miller,et al.  How do cochlear prostheses work? , 1999, Current Opinion in Neurobiology.

[31]  Bertrand Delgutte,et al.  Improved neural representation of vowels in electric stimulation using desynchronizing pulse trains. , 2003, The Journal of the Acoustical Society of America.

[32]  E. Javel,et al.  Electrical stimulation of the auditory nerve: II. Effect of stimulus waveshape on single fibre response properties , 1999, Hearing Research.

[33]  R. Tyler,et al.  Speech perception, localization, and lateralization with bilateral cochlear implants. , 2003, The Journal of the Acoustical Society of America.

[34]  Qian-Jie Fu,et al.  The effects of short-term training for spectrally mismatched noise-band speech. , 2003, The Journal of the Acoustical Society of America.

[35]  P. Joris Interaural Time Sensitivity Dominated by Cochlea-Induced Envelope Patterns , 2003, The Journal of Neuroscience.

[36]  J. Firszt,et al.  Electrophysiologic Effects of Placing Cochlear Implant Electrodes in a Perimodiolar Position in Young Children , 2004, The Laryngoscope.

[37]  H Steven Colburn,et al.  Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user. , 2003, The Journal of the Acoustical Society of America.

[38]  Bertrand Delgutte,et al.  Desynchronization of electrically evoked auditory-nerve activity by high-frequency pulse trains of long duration. , 2003, The Journal of the Acoustical Society of America.

[39]  Marco Pelizzone,et al.  Forward masking in different cochlear implant systems. , 2003, The Journal of the Acoustical Society of America.

[40]  Andrew J Oxenham,et al.  Correct tonotopic representation is necessary for complex pitch perception. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Bertrand Delgutte,et al.  Phase-locking of auditory-nerve discharges to sinusoidal electric stimulation of the cochlea , 1992, Hearing Research.

[42]  C. Jolly,et al.  Quadrupolar stimulation for cochlear prostheses: modeling and experimental data , 1996, IEEE Transactions on Biomedical Engineering.

[43]  Robert S Hong,et al.  Signal Coding in Cochlear Implants: Exploiting Stochastic Effects of Electrical Stimulation , 2003, The Annals of otology, rhinology & laryngology. Supplement.

[44]  J Wouters,et al.  Enhancing the speech envelope of continuous interleaved sampling processors for cochlear implants. , 1999, The Journal of the Acoustical Society of America.

[45]  Peter J Blamey,et al.  Adaptive Dynamic Range Optimization for Cochlear Implants: A Preliminary Study , 2002, Ear and hearing.

[46]  Marco Pelizzone,et al.  Electrical field interactions in different cochlear implant systems. , 2003, The Journal of the Acoustical Society of America.

[47]  Q. Fu Temporal processing and speech recognition in cochlear implant users , 2002, Neuroreport.

[48]  Robert S Hong,et al.  Dynamic Range Enhancement for Cochlear Implants , 2003, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[49]  Richard A Normann,et al.  Cochlear Nerve Stimulation with a 3-Dimensional Penetrating Electrode Array , 2003, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[50]  R J Fretz,et al.  Design and Function: A Physical and Electrical Description of the 3M House Cochlear Implant System , 1985, Ear and hearing.

[51]  A E Vandali,et al.  Emphasis of short-duration acoustic speech cues for cochlear implant users. , 2001, The Journal of the Acoustical Society of America.

[52]  J. Nadol,et al.  Correlation of Acoustic Threshold Measures and Spiral Ganglion Cell Survival in Severe to Profound Sensorineural Hearing Loss: Implications for Cochlear Implantation , 1998, The Annals of otology, rhinology, and laryngology.

[53]  William M. Rabinowitz,et al.  Better speech recognition with cochlear implants , 1991, Nature.

[54]  Astrid van Wieringen,et al.  Pitch of amplitude-modulated irregular-rate stimuli in acoustic and electric hearing. , 2003, The Journal of the Acoustical Society of America.

[55]  Michael K. Qin,et al.  Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers. , 2003, The Journal of the Acoustical Society of America.

[56]  Jeroen J Briaire,et al.  Optimizing the Number of Electrodes with High-rate Stimulation of the Clarion CII Cochlear Implant , 2003, Acta oto-laryngologica.

[57]  Belinda A Henry,et al.  The resolution of complex spectral patterns by cochlear implant and normal-hearing listeners. , 2003, The Journal of the Acoustical Society of America.

[58]  W. House,et al.  Long Term Results of Electrode Implantation and Electronic Stimulation of the Cochlea in Man , 1973, The Annals of otology, rhinology, and laryngology.

[59]  Bertrand Delgutte,et al.  Improved temporal coding of sinusoids in electric stimulation of the auditory nerve using desynchronizing pulse trains. , 2003, The Journal of the Acoustical Society of America.

[60]  Qian-Jie Fu,et al.  Frequency Mapping in Cochlear Implants , 2002, Ear and hearing.