Detection of acoustic temporal fine structure by cochlear implant listeners: Behavioral results and computational modeling

A test of within-channel detection of acoustic temporal fine structure (aTFS) cues is presented. Eight cochlear implant listeners (CI) were asked to discriminate between two Schroeder-phase (SP) complexes using a two-alternative, forced-choice task. Because differences between the acoustic stimuli are primarily constrained to their aTFS, successful discrimination reflects a combination of the subjects' perception of and the strategy's ability to deliver aTFS cues. Subjects were mapped with single-channel Continuous Interleaved Sampling (CIS) and Simultaneous Analog Stimulation (SAS) strategies. To compare within- and across- channel delivery of aTFS cues, a 16-channel clinical HiRes strategy was also fitted. Throughout testing, SAS consistently outperformed the CIS strategy (p ≤ 0.002). For SP stimuli with F0 = 50 Hz, the highest discrimination scores were achieved with the HiRes encoding, followed by scores with the SAS and the CIS strategies, respectively. At 200 Hz, single-channel SAS performed better than HiRes (p = 0.022), demonstrating that under a more challenging testing condition, discrimination performance with a single-channel analog encoding can exceed that of a 16-channel pulsatile strategy. To better understand the intermediate steps of discrimination, a biophysical model was used to examine the neural discharges evoked by the SP stimuli. Discrimination estimates calculated from simulated neural responses successfully tracked the behavioral performance trends of single-channel CI listeners.

[1]  Raghu Kacker,et al.  Digital Library of Mathematical Functions , 2003 .

[2]  W. Bialek,et al.  RELIABILITY AND STATISTICAL EFFICIENCY OF A BLOWFLY MOVEMENT-SENSITIVE NEURON , 1995 .

[3]  Fan-Gang Zeng,et al.  Music Perception with Temporal Cues in Acoustic and Electric Hearing , 2004, Ear and hearing.

[4]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[5]  Jayaganesh Swaminathan,et al.  Quantifying Envelope and Fine-Structure Coding in Auditory Nerve Responses to Chimaeric Speech , 2009, Journal of the Association for Research in Otolaryngology.

[6]  Fan-Gang Zeng,et al.  Temporal pitch in electric hearing , 2002, Hearing Research.

[7]  M. Leek,et al.  Auditory temporal resolution in birds: discrimination of harmonic complexes. , 2002, The Journal of the Acoustical Society of America.

[8]  William M. Rabinowitz,et al.  Better speech recognition with cochlear implants , 1991, Nature.

[9]  Brian C J Moore,et al.  Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech. , 2008, The Journal of the Acoustical Society of America.

[10]  J. White,et al.  Channel noise in neurons , 2000, Trends in Neurosciences.

[11]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[12]  Les E. Atlas,et al.  Single sideband encoder for music coding in cochlear implants , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  H J McDermott,et al.  Pitch ranking with nonsimultaneous dual-electrode electrical stimulation of the cochlea. , 1994, The Journal of the Acoustical Society of America.

[14]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[15]  M. Egelhaaf,et al.  Information and Discriminability as Measures of Reliability of Sensory Coding , 2007, PloS one.

[16]  Marjorie R. Leek,et al.  The effect of sweep direction on avian auditory brainstem responses , 2005 .

[17]  Leslie M. Collins,et al.  Predicting auditory tone-in-noise detection performance: the effects of neural variability , 2004, IEEE Transactions on Biomedical Engineering.

[18]  Ji-Jon Sit,et al.  a cochlear- i mplant p rocessor for encoding m usic and l owering s timulation p ower , 2008 .

[19]  Xing Li,et al.  The ability of cochlear implant users to use temporal envelope cues recovered from speech frequency modulation. , 2012, The Journal of the Acoustical Society of America.

[20]  B. Moore The Role of Temporal Fine Structure Processing in Pitch Perception, Masking, and Speech Perception for Normal-Hearing and Hearing-Impaired People , 2008, Journal of the Association for Research in Otolaryngology.

[21]  Laurel H. Carney,et al.  Evaluating Auditory Performance Limits: I. One-Parameter Discrimination Using a Computational Model for the Auditory Nerve , 2001, Neural Computation.

[22]  A. Paintal,et al.  Effects of temperature on conduction in single vagal and saphenous myelinated nerve fibres of the cat. , 1965, The Journal of physiology.

[23]  Conor J. Houghton,et al.  A New Multineuron Spike Train Metric , 2008, Neural Computation.

[24]  Evan Balaban,et al.  Voice gender perception by cochlear implantees. , 2009, The Journal of the Acoustical Society of America.

[25]  T. Yin,et al.  Responses to amplitude-modulated tones in the auditory nerve of the cat. , 1992, The Journal of the Acoustical Society of America.

[26]  Peggy B Nelson,et al.  Understanding speech in modulated interference: cochlear implant users and normal-hearing listeners. , 2003, The Journal of the Acoustical Society of America.

[27]  Jong Ho Won,et al.  Clinical assessment of music perception in Korean cochlear implant listeners , 2010, Acta oto-laryngologica.

[28]  Paul J. Abbas,et al.  Changes in Auditory Nerve Responses Across the Duration of Sinusoidally Amplitude-Modulated Electric Pulse-Train Stimuli , 2010, Journal of the Association for Research in Otolaryngology.

[29]  Jong Ho Won,et al.  Development and Validation of the University of Washington Clinical Assessment of Music Perception Test , 2009, Ear and hearing.

[30]  Jay T. Rubinstein,et al.  Stochastic Population Model for Electrical Stimulation of the Auditory Nerve , 2009, IEEE Transactions on Biomedical Engineering.

[31]  B C Moore,et al.  Detection of frequency modulation at low modulation rates: evidence for a mechanism based on phase locking. , 1996, The Journal of the Acoustical Society of America.

[32]  M. J. Osberger,et al.  HiResolutionTM and Conventional Sound Processing in the HiResolutionTM Bionic Ear: Using Appropriate Outcome Measures to Assess Speech Recognition Ability , 2004, Audiology and Neurotology.

[33]  Charles A Miller,et al.  Response of the auditory nerve to sinusoidal electrical stimulation: effects of high-rate pulse trains , 2004, Hearing Research.

[34]  Brian C J Moore,et al.  Speech perception problems of the hearing impaired reflect inability to use temporal fine structure , 2006, Proceedings of the National Academy of Sciences.

[35]  Michael K. Qin,et al.  Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers. , 2003, The Journal of the Acoustical Society of America.

[36]  Jong Ho Won,et al.  Sensitivity of psychophysical measures to signal processor modifications in cochlear implant users , 2010, Hearing Research.

[37]  Fan-Gang Zeng,et al.  Encoding frequency Modulation to improve cochlear implant performance in noise , 2005, IEEE Transactions on Biomedical Engineering.

[38]  Chris van den Honert,et al.  Dual-electrode pitch discrimination with sequential interleaved stimulation by cochlear implant users. , 2006, The Journal of the Acoustical Society of America.

[39]  Manfred R. Schroeder,et al.  Synthesis of low-peak-factor signals and binary sequences with low autocorrelation (Corresp.) , 1970, IEEE Trans. Inf. Theory.

[40]  Dirk Van Compernolle,et al.  Pitch perception by cochlear implant subjects. , 1987, The Journal of the Acoustical Society of America.

[41]  Bryan E Pfingst,et al.  Relative importance of temporal envelope and fine structure in lexical-tone perception. , 2003, The Journal of the Acoustical Society of America.

[42]  J. T. Rubinstein,et al.  The neuronal response to electrical constant-amplitude pulse train stimulation: evoked compound action potential recordings , 2000, Hearing Research.

[43]  O Ghitza,et al.  On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception. , 2001, The Journal of the Acoustical Society of America.

[44]  Christian Lorenzi,et al.  The ability of listeners to use recovered envelope cues from speech fine structure. , 2006, The Journal of the Acoustical Society of America.

[45]  Jonathan D Victor,et al.  Spike train metrics , 2005, Current Opinion in Neurobiology.

[46]  Micheal L Dent,et al.  Masking by harmonic complexes in birds: behavioral thresholds and cochlear responses , 2001, Hearing Research.

[47]  A. Paintal,et al.  The influence of diameter of medullated nerve fibres of cats on the rising and falling phases of the spike and its recovery , 1966, The Journal of physiology.

[48]  Blake S. Wilson,et al.  Cochlear implants: A remarkable past and a brilliant future , 2008, Hearing Research.

[49]  J. Knutson,et al.  Recognition of familiar melodies by adult cochlear implant recipients and normal-hearing adults , 2002, Cochlear implants international.

[50]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[51]  K. Osen,et al.  The cochlear nerve in the cat: Topography, cochleotopy, and fiber spectrum , 1978, The Journal of comparative neurology.

[52]  Christian Lorenzi,et al.  Speech identification based on temporal fine structure cues. , 2008, The Journal of the Acoustical Society of America.

[53]  Fan-Gang Zeng,et al.  Speech recognition with amplitude and frequency modulations. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[54]  M F Dorman,et al.  Frequency discrimination and speech recognition by patients who use the Ineraid and continuous interleaved sampling cochlear-implant signal processors. , 1996, The Journal of the Acoustical Society of America.

[55]  R. Shannon Temporal modulation transfer functions in patients with cochlear implants. , 1992, The Journal of the Acoustical Society of America.

[56]  William B. Kristan,et al.  Quantifying Stimulus Discriminability: A Comparison of Information Theory and Ideal Observer Analysis , 2005, Neural Computation.

[57]  Clemens Zierhofer,et al.  Frequency discrimination with sequential or simultaneous stimulation in MED-EL cochlear implants , 2007, Acta oto-laryngologica.

[58]  Blake S Wilson,et al.  Two New Directions in Speech Processor Design for Cochlear Implants , 2005, Ear and hearing.

[59]  Jay T. Rubinstein,et al.  Discrimination of Schroeder-Phase Harmonic Complexes by Normal-Hearing and Cochlear-Implant Listeners , 2008, Journal of the Association for Research in Otolaryngology.

[60]  Charles A. Miller,et al.  Auditory nerve responses to monophasic and biphasic electric stimuli , 2001, Hearing Research.

[61]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[62]  Paul J. Abbas,et al.  Effects of electrode-to-fiber distance on temporal neural response with electrical stimulation , 2004, IEEE Transactions on Biomedical Engineering.

[63]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[64]  M. Liberman,et al.  Morphometry of intracellularly labeled neurons of the auditory nerve: Correlations with functional properties , 1984, The Journal of comparative neurology.

[65]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[66]  Bernhard Ronacher,et al.  Discrimination of behaviorally relevant signals by auditory receptor neurons , 2001, Neurocomputing.

[67]  Les E. Atlas,et al.  Harmonic coherent demodulation for improving sound coding in cochlear implants , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[68]  Zachary M. Smith,et al.  Chimaeric sounds reveal dichotomies in auditory perception , 2002, Nature.

[69]  W. Rushton A theory of the effects of fibre size in medullated nerve , 1951, The Journal of physiology.

[70]  Kourosh Saberi,et al.  A common neural code for frequency- and amplitude-modulated sounds , 1995, Nature.

[71]  G. Stickney,et al.  On the dichotomy in auditory perception between temporal envelope and fine structure cues. , 2004, The Journal of the Acoustical Society of America.

[72]  Bernhard Ronacher,et al.  Auditory discrimination of amplitude modulations based on metric distances of spike trains. , 2007, Journal of neurophysiology.

[73]  Les E. Atlas,et al.  Time-Frequency Coherent Modulation Filtering of Nonstationary Signals , 2009, IEEE Transactions on Signal Processing.

[74]  M. Dorman,et al.  Performance of subjects fit with the Advanced Bionics CII and Nucleus 3G cochlear implant devices. , 2004, Archives of otolaryngology--head & neck surgery.

[75]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[76]  Rahul Sarpeshkar,et al.  A Low-Power Asynchronous Interleaved Sampling Algorithm for Cochlear Implants That Encodes Envelope and Phase Information , 2007, IEEE Transactions on Biomedical Engineering.

[77]  Marjorie R. Leek,et al.  Discrimination of Time-Reversed Harmonic Complexes by Normal-Hearing and Hearing-Impaired Listeners , 2009, Journal of the Association for Research in Otolaryngology.