Prediction of vowel identification for cochlear implant using a computational model

A computational biophysical auditory nerve fiber model along with mathematical algorithms are presented that predict vowel identification for cochlear implant (CI) users based on the predicted peripheral neural representations of speech information (i.e., neurogram). Our model simulates the discharge patterns of electrically-stimulated auditory nerve fibers along the length of the cochlea and quantifies the similarity between the neurograms for different speech signals. The effects of background noise (+15, +10, +5, 0, and 5dB SNR) and stimulation rate (900, 1200, and 1800pps/ch) on vowel identification were evaluated and compared to CI subject data to demonstrate the performance of our model. Results from both the computational modeling and clinical test showed that vowel identification performance decreased as background noise increased while vowel identification was not significantly influenced by the stimulation rate. The proposed method, both objective and automated, can be used for a wide range of stimulus conditions, signal processing, and different biological conditions in the implanted ears.

[1]  Jace Wolfe,et al.  The Effect of Front-End Processing on Cochlear Implant Performance of Children , 2011, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[2]  Sung Hwa Hong,et al.  Effects of Electrode Position on Spatiotemporal Auditory Nerve Fiber Responses: A 3D Computational Model Study , 2015, Comput. Math. Methods Medicine.

[3]  J. Hanekom,et al.  An analysis of the effects of electrical field interaction with an acoustic model of cochlear implants. , 2011, The Journal of the Acoustical Society of America.

[4]  Jose L. Salmeron,et al.  Benchmarking main activation functions in fuzzy cognitive maps , 2009, Expert Syst. Appl..

[5]  T. Lenarz,et al.  Performance and Preference for ACE Stimulation Rates Obtained with Nucleus RP 8 and Freedom System , 2007, Ear and hearing.

[6]  P. Stypulkowski,et al.  Physiological properties of the electrically stimulated auditory nerve. II. Single fiber recordings , 1984, Hearing Research.

[7]  Diane Kewley-Port,et al.  Vowel formant discrimination for high-fidelity speech. , 2004, The Journal of the Acoustical Society of America.

[8]  M F Dorman,et al.  The Identification of Consonants and Vowels by Cochlear Implant Patients Using a 6‐Channel Continuous Interleaved Sampling Processor and by Normal‐Hearing Subjects Using Simulations of Processors with Two to Nine Channels , 1998, Ear and hearing.

[9]  Charles A. Miller,et al.  Auditory nerve responses to monophasic and biphasic electric stimuli , 2001, Hearing Research.

[10]  Zachary M. Smith,et al.  Examining the Electro-Neural Interface of Cochlear Implant Users Using Psychophysics, CT Scans, and Speech Understanding , 2014, Journal of the Association for Research in Otolaryngology.

[11]  Andrew Hines,et al.  Speech intelligibility from image processing , 2010, Speech Commun..

[12]  Elaine Saunders,et al.  Psychophysics of a prototype peri-modiolar cochlear implant electrode array , 2001, Hearing Research.

[13]  K. Osen,et al.  The cochlear nerve in the cat: Topography, cochleotopy, and fiber spectrum , 1978, The Journal of comparative neurology.

[14]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[15]  Bryan E Pfingst,et al.  Across-site patterns of modulation detection: relation to speech recognition. , 2012, The Journal of the Acoustical Society of America.

[16]  K. Plant,et al.  Speech Perception as a Function of Electrical Stimulation Rate: Using the Nucleus 24 Cochlear Implant System , 2000, Ear and hearing.

[17]  Paul J. Abbas,et al.  Simulation of the Electrically Stimulated Cochlear Neuron: Modeling Adaptation to Trains of Electric Pulses , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Blake S Wilson,et al.  Cochlear implants: current designs and future possibilities. , 2008, Journal of rehabilitation research and development.

[19]  J. Frijns,et al.  Spatial selectivity in a rotationally symmetric model of the electrically stimulated cochlea , 1996, Hearing Research.

[20]  J. Nadol,et al.  Comparative anatomy of the cochlea and auditory nerve in mammals , 1988, Hearing Research.

[21]  M. White,et al.  A stochastic model of the electrically stimulated auditory nerve: single-pulse response , 1999, IEEE Transactions on Biomedical Engineering.

[22]  Q J Fu,et al.  Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing. , 1998, The Journal of the Acoustical Society of America.

[23]  Carson C. Chow,et al.  Spontaneous action potentials due to channel fluctuations. , 1996, Biophysical journal.

[24]  Stefano Cosentino,et al.  Objective speech intelligibility measurement for cochlear implant users in complex listening environments , 2013, Speech Commun..

[25]  Robert V. Shannon,et al.  Effect of Stimulation Rate on Cochlear Implant Users’ Phoneme, Word and Sentence Recognition in Quiet and in Noise , 2010, Audiology and Neurotology.

[26]  Michael K. Qin,et al.  Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers. , 2003, The Journal of the Acoustical Society of America.

[27]  Fan-Gang Zeng,et al.  Cochlear Implants: System Design, Integration, and Evaluation , 2008, IEEE Reviews in Biomedical Engineering.

[28]  Robert V Shannon,et al.  Effects of Stimulation Rate on Speech Recognition with Cochlear Implants , 2005, Audiology and Neurotology.

[29]  Fan-Gang Zeng,et al.  Spectral and Temporal Cues in Cochlear Implant Speech Perception , 2006, Ear and hearing.

[30]  Qian-Jie Fu,et al.  Effects of Speech Processing Strategy on Chinese Tone Recognition by Nucleus-24 Cochlear Implant Users , 2004, Ear and hearing.

[31]  L. Cartee,et al.  Spiral ganglion cell site of excitation II: Numerical model analysis , 2006, Hearing Research.

[32]  Paul J. Abbas,et al.  Biophysical Model of an Auditory Nerve Fiber With a Novel Adaptation Component , 2009, IEEE Transactions on Biomedical Engineering.

[33]  Muhammad S A Zilany,et al.  Modeling auditory-nerve responses for high sound pressure levels in the normal and impaired auditory periphery. , 2006, The Journal of the Acoustical Society of America.

[34]  M. Liberman,et al.  Morphometry of intracellularly labeled neurons of the auditory nerve: Correlations with functional properties , 1984, The Journal of comparative neurology.

[35]  Paul J. Abbas,et al.  The Dependence of Auditory Nerve Rate Adaptation on Electric Stimulus Parameters, Electrode Position, and Fiber Diameter: A Computer Model Study , 2010, Journal of the Association for Research in Otolaryngology.

[36]  A. R. Kaiser,et al.  A mathematical model of vowel identification by users of cochlear implants. , 2010, The Journal of the Acoustical Society of America.

[37]  Sebastian Möller,et al.  Speech Quality Estimation: Models and Trends , 2011, IEEE Signal Processing Magazine.

[38]  Tiago H. Falk,et al.  A Non-Intrusive Quality and Intelligibility Measure of Reverberant and Dereverberated Speech , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[39]  Frank Rattay,et al.  A model of the electrically excited human cochlear neuron I. Contribution of neural substructures to the generation and propagation of spikes , 2001, Hearing Research.

[40]  C. Watson,et al.  Formant-frequency discrimination for isolated English vowels. , 1994, The Journal of the Acoustical Society of America.

[41]  Andrew Hines,et al.  Speech intelligibility prediction using a Neurogram Similarity Index Measure , 2012, Speech Commun..

[42]  Paul J. Abbas,et al.  Changes Across Time in Spike Rate and Spike Amplitude of Auditory Nerve Fibers Stimulated by Electric Pulse Trains , 2007, Journal of the Association for Research in Otolaryngology.

[43]  Fan-Gang Zeng,et al.  Effects of cochlear implant processing and fundamental frequency on the intelligibility of competing sentences. , 2007, The Journal of the Acoustical Society of America.