Relative Contributions of Temporal Envelope and Fine Structure Cues to Lexical Tone Recognition in Hearing-Impaired Listeners

It has been reported that normal-hearing Chinese speakers base their lexical tone recognition on fine structure regardless of temporal envelope cues. However, a few psychoacoustic and perceptual studies have demonstrated that listeners with sensorineural hearing impairment may have an impaired ability to use fine structure information, whereas their ability to use temporal envelope information is close to normal. The purpose of this study is to investigate the relative contributions of temporal envelope and fine structure cues to lexical tone recognition in normal-hearing and hearing-impaired native Mandarin Chinese speakers. Twenty-two normal-hearing subjects and 31 subjects with various degrees of sensorineural hearing loss participated in the study. Sixteen sets of Mandarin monosyllables with four tone patterns for each were processed through a “chimeric synthesizer” in which temporal envelope from a monosyllabic word of one tone was paired with fine structure from the same monosyllable of other tones. The chimeric tokens were generated in the three channel conditions (4, 8, and 16 channels). Results showed that differences in tone responses among the three channel conditions were minor. On average, 90.9%, 70.9%, 57.5%, and 38.2% of tone responses were consistent with fine structure for normal-hearing, moderate, moderate to severe, and severely hearing-impaired groups respectively, whereas 6.8%, 21.1%, 31.4%, and 44.7% of tone responses were consistent with temporal envelope cues for the above-mentioned groups. Tone responses that were consistent neither with temporal envelope nor fine structure had averages of 2.3%, 8.0%, 11.1%, and 17.1% for the above-mentioned groups of subjects. Pure-tone average thresholds were negatively correlated with tone responses that were consistent with fine structure, but were positively correlated with tone responses that were based on the temporal envelope cues. Consistent with the idea that the spectral resolvability is responsible for fine structure coding, these results demonstrated that, as hearing loss becomes more severe, lexical tone recognition relies increasingly on temporal envelope rather than fine structure cues due to the widened auditory filters.

[1]  Brian C. J. Moore,et al.  Frequency discrimination of complex tones by hearing-impaired subjects: Evidence for loss of ability to use temporal fine structure , 2006, Hearing Research.

[2]  Brian C J Moore,et al.  The importance of temporal fine structure information in speech at different spectral regions for normal-hearing and hearing-impaired subjects. , 2010, The Journal of the Acoustical Society of America.

[3]  Ning Zhou,et al.  Relative contributions of spectral and temporal cues for speech recognition in patients with sensorineural hearing loss. , 2009 .

[4]  Wenle Zhang,et al.  Lexical Tone Recognition with an Artificial Neural Network , 2008, Ear and hearing.

[5]  Tone Detection in Mandarin-speaking Hearing-impaired Subjects , 2000, Audiology : official organ of the International Society of Audiology.

[6]  Brian C J Moore,et al.  Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech. , 2008, The Journal of the Acoustical Society of America.

[7]  R. Carlyon,et al.  Concurrent Sound Segregation in Electric and Acoustic Hearing , 2007, Journal of the Association for Research in Otolaryngology.

[8]  Brian C J Moore,et al.  Speech perception problems of the hearing impaired reflect inability to use temporal fine structure , 2006, Proceedings of the National Academy of Sciences.

[9]  Christian Lorenzi,et al.  Effects of spectral smearing and temporal fine structure degradation on speech masking release. , 2009, The Journal of the Acoustical Society of America.

[10]  Ning Zhou,et al.  Tone perception and production in pediatric cochlear implants users , 2011, Acta oto-laryngologica.

[11]  Emily Buss,et al.  Temporal Fine-Structure Cues to Speech and Pure Tone Modulation in Observers with Sensorineural Hearing Loss , 2004, Ear and hearing.

[12]  B C Moore,et al.  Pitch discrimination and phase sensitivity in young and elderly subjects and its relationship to frequency selectivity. , 1992, The Journal of the Acoustical Society of America.

[13]  Bryan E Pfingst,et al.  Features of stimulation affecting tonal-speech perception: implications for cochlear prostheses. , 2002, The Journal of the Acoustical Society of America.

[14]  Alexandra Kaider,et al.  A New Fine Structure Speech Coding Strategy: Speech Perception at a Reduced Number of Channels , 2008, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[15]  Christian Lorenzi,et al.  Speech identification based on temporal fine structure cues. , 2008, The Journal of the Acoustical Society of America.

[16]  Jayaganesh Swaminathan,et al.  Across-Fiber Coding of Temporal Fine-Structure: Effects of Noise-Induced Hearing Loss on Auditory-Nerve Responses , 2010 .

[17]  Clemens Zierhofer,et al.  Temporal fine structure in cochlear implants: Preliminary speech perception results in Cantonese-speaking implant users , 2010, Acta oto-laryngologica.

[18]  Torsten Dau,et al.  Binaural pitch perception in normal-hearing and hearing-impaired listeners , 2007, Hearing Research.

[19]  B. Pfingst,et al.  Spectral and temporal cues for speech recognition: Implications for auditory prostheses , 2008, Hearing Research.

[20]  Brian C. J. Moore,et al.  Discrimination of the fundamental frequency of complex tones with fixed and shifting spectral envelopes by normally hearing and hearing-impaired subjects , 2003, Hearing Research.

[21]  Dominik Riss,et al.  1-year results using the Opus speech processor with the fine structure speech coding strategy , 2009, Acta oto-laryngologica.

[22]  C. Turner,et al.  Limiting spectral resolution in speech for listeners with sensorineural hearing loss. , 1999, Journal of speech, language, and hearing research : JSLHR.

[23]  Fan-Gang Zeng,et al.  Mandarin tone recognition in cochlear-implant subjects , 2004, Hearing Research.

[24]  Michael G. Heinz,et al.  Envelope Coding in Auditory Nerve Fibers Following Noise-Induced Hearing Loss , 2010, Journal of the Association for Research in Otolaryngology.

[25]  C W Turner,et al.  Use of temporal envelope cues in speech recognition by normal and hearing-impaired listeners. , 1995, The Journal of the Acoustical Society of America.

[26]  G. Stickney,et al.  On the dichotomy in auditory perception between temporal envelope and fine structure cues. , 2004, The Journal of the Acoustical Society of America.

[27]  Andrew J Oxenham,et al.  The relationship between frequency selectivity and pitch discrimination: sensorineural hearing loss. , 2006, The Journal of the Acoustical Society of America.

[28]  Bryan E Pfingst,et al.  Relative importance of temporal envelope and fine structure in lexical-tone perception. , 2003, The Journal of the Acoustical Society of America.

[29]  Jayaganesh Swaminathan,et al.  Quantifying Envelope and Fine-Structure Coding in Auditory Nerve Responses to Chimaeric Speech , 2009, Journal of the Association for Research in Otolaryngology.

[30]  D. D. Greenwood A cochlear frequency-position function for several species--29 years later. , 1990, The Journal of the Acoustical Society of America.

[31]  Christian Lorenzi,et al.  Perception of temporal fine-structure cues in speech with minimal envelope cues for listeners with mild-to-moderate hearing loss , 2010, International journal of audiology.

[32]  Torsten Dau,et al.  Relations between frequency selectivity, temporal fine-structure processing, and speech reception in impaired hearing. , 2009, The Journal of the Acoustical Society of America.

[33]  Ying-Yee Kong,et al.  Temporal and spectral cues in Mandarin tone recognition , 2004 .

[34]  S. Bacon,et al.  Modulation detection in subjects with relatively flat hearing losses. , 1992, Journal of speech and hearing research.

[35]  R. Carlyon,et al.  Limitations on rate discrimination. , 2002, The Journal of the Acoustical Society of America.

[36]  Les E. Atlas,et al.  Coherent envelope detection for modulation filtering of speech , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[37]  Margaret W Skinner,et al.  Speech Recognition in Cochlear Implant Recipients: Comparison of Standard HiRes and HiRes 120 Sound Processing , 2009, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[38]  Fan-Gang Zeng,et al.  Encoding frequency Modulation to improve cochlear implant performance in noise , 2005, IEEE Transactions on Biomedical Engineering.

[39]  Brian C J Moore,et al.  Abnormal processing of temporal fine structure in speech for frequencies where absolute thresholds are normal. , 2009, The Journal of the Acoustical Society of America.

[40]  Zachary M. Smith,et al.  Chimaeric sounds reveal dichotomies in auditory perception , 2002, Nature.

[41]  Brian C J Moore,et al.  Moderate cochlear hearing loss leads to a reduced ability to use temporal fine structure information. , 2007, The Journal of the Acoustical Society of America.

[42]  Fan-Gang Zeng,et al.  Temporal pitch in electric hearing , 2002, Hearing Research.

[43]  E. Bedrosian A Product Theorem for Hilbert Transforms , 1963 .

[44]  Ning Zhou,et al.  Lexical Tone Perception with HiResolution and HiResolution 120 Sound-Processing Strategies in Pediatric Mandarin-Speaking Cochlear Implant Users , 2009, Ear and hearing.

[45]  F B Simmons,et al.  Electrical stimulation of the auditory nerve in man. , 1966, Archives of otolaryngology.

[46]  Xu Li,et al.  Relative Contributions of Spectral and Temporal Cues for Speech Recognition in Patients with Sensorineural Hearing Loss , 2008 .

[47]  B. Moore The Role of Temporal Fine Structure Processing in Pitch Perception, Masking, and Speech Perception for Normal-Hearing and Hearing-Impaired People , 2008, Journal of the Association for Research in Otolaryngology.

[48]  R. Shannon Multichannel electrical stimulation of the auditory nerve in man. I. Basic psychophysics , 1983, Hearing Research.

[49]  E. Lopez-Poveda,et al.  The neurophysiological bases of auditory perception , 2010 .

[50]  C. Lorenzi,et al.  Effects of lowpass and highpass filtering on the intelligibility of speech based on temporal fine structure or envelope cues , 2010, Hearing Research.

[51]  Ning Zhou,et al.  Musical pitch and lexical tone perception with cochlear implants , 2011, International journal of audiology.

[52]  Christian Lorenzi,et al.  The ability of listeners to use recovered envelope cues from speech fine structure. , 2006, The Journal of the Acoustical Society of America.

[53]  Ning Zhou,et al.  Tonal Languages and Cochlear Implants , 2011 .