The effect of enhancing temporal periodicity cues on Cantonese tone recognition by cochlear implantees

Abstract Objectives: This study investigates the efficacy of a cochlear implant (CI) processing method that enhances temporal periodicity cues of speech. Design: Subjects participated in word and tone identification tasks. Two processing conditions – the conventional advanced combination encoder (ACE) and tone-enhanced ACE were tested. Test materials were Cantonese disyllabic words recorded from one male and one female speaker. Speech-shaped noise was added to clean speech. The fundamental frequency information for periodicity enhancement was extracted from the clean speech. Electrical stimuli generated from the noisy speech with and without periodicity enhancement were presented via direct stimulation using a Laura 34 research processor. Subjects were asked to identify the presented word. Study sample: Seven post-lingually deafened native Cantonese-speaking CI users. Results: Percent correct word, segmental structure, and tone identification scores were calculated. While word and segmental structure identification accuracy remained similar between the two processing conditions, tone identification in noise was better with tone-enhanced ACE than with conventional ACE. Significant improvement on tone perception was found only for the female voice. Conclusions: Temporal periodicity cues are important to tone perception in noise. Pitch and tone perception by CI users could be improved when listeners received enhanced temporal periodicity cues.

[1]  H J McDermott,et al.  Pitch matching of amplitude-modulated current pulse trains by cochlear implantees: the effect of modulation depth. , 1995, The Journal of the Acoustical Society of America.

[2]  S. Rosen.  Temporal information in speech: acoustic, auditory and linguistic aspects. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[3]  Jay T. Rubinstein,et al.  Clinical Assessment of Music Perception in Cochlear Implant Listeners , 2008, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[4]  Fan-Gang Zeng,et al.  Cochlear implant speech recognition with speech maskers. , 2004, The Journal of the Acoustical Society of America.

[5]  Alan V. Oppenheim,et al.  Discrete-time signal processing (2nd ed.) , 1999 .

[6]  Heather A. Kreft,et al.  Modulation rate discrimination using half-wave rectified and sinusoidally amplitude modulated stimuli in cochlear-implant users. , 2010, The Journal of the Acoustical Society of America.

[7]  E. M. Burns,et al.  Played-again SAM: Further observations on the pitch of amplitude-modulated noise , 1981 .

[8]  R. Shannon.  Temporal modulation transfer functions in patients with cochlear implants. , 1992, The Journal of the Acoustical Society of America.

[9]  C A van Hasselt,et al.  Cantonese tone perception ability of cochlear implant children in comparison with normal-hearing children. , 2002, International journal of pediatric otorhinolaryngology.

[10]  Fan-Gang Zeng,et al.  Music Perception with Temporal Cues in Acoustic and Electric Hearing , 2004, Ear and hearing.

[11]  DeLiang Wang,et al.  HMM-Based Multipitch Tracking for Noisy and Reverberant Speech , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[12]  Gail S Donaldson,et al.  Spatial tuning curves from apical, middle, and basal electrodes in cochlear implant users. , 2011, The Journal of the Acoustical Society of America.

[13]  Ning Zhou,et al.  Tonal Languages and Cochlear Implants , 2011 .

[14]  Koch Sigmund Ed,et al.  Psychology: A Study of A Science , 1962 .

[15]  Jan Wouters,et al.  Better place-coding of the fundamental frequency in cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[16]  Meng Yuan,et al.  Cantonese tone recognition with enhanced temporal periodicity cues. , 2009, The Journal of the Acoustical Society of America.

[17]  J. Knutson,et al.  Recognition of familiar melodies by adult cochlear implant recipients and normal-hearing adults , 2002, Cochlear implants international.

[18]  J. Smurzyński,et al.  Pitch identification and discrimination for complex tones with many harmonics , 1990 .

[19]  Andrew E. Vandali,et al.  Development of a temporal fundamental frequency coding strategy for cochlear implants. , 2011, The Journal of the Acoustical Society of America.

[20]  Hugh J. McDermott,et al.  Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. , 2005, The Journal of the Acoustical Society of America.

[21]  P. Boersma.  Praat : doing phonetics by computer (version 5.1.05) , 2009 .

[23]  Andrew E. Vandali,et al.  New cochlear implant coding strategy for tonal language speakers , 2008, International journal of audiology.

[24]  Andrew E Vandali,et al.  Enhancement of temporal cues to pitch in cochlear implants: effects on pitch ranking. , 2012, The Journal of the Acoustical Society of America.

[25]  L Geurts,et al.  Coding of the fundamental frequency in continuous interleaved sampling processors for cochlear implants. , 2001, The Journal of the Acoustical Society of America.

[26]  Jan Wouters,et al.  Perception of Mandarin Chinese with cochlear implants using enhanced temporal pitch cues , 2012, Hearing Research.

[27]  H J McDermott,et al.  Pitch percepts associated with amplitude-modulated current pulse trains in cochlear implantees. , 1994, The Journal of the Acoustical Society of America.

[28]  Mike Brookes,et al.  A Pitch Estimation Filter robust to high levels of noise (PEFAC) , 2011, 2011 19th European Signal Processing Conference.

[29]  William M. Rabinowitz,et al.  Better speech recognition with cochlear implants , 1991, Nature.

[30]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[31]  J. Licklider,et al.  A duplex theory of pitch perception , 1951, Experientia.

[32]  Michael K. Qin,et al.  Effects of Envelope-Vocoder Processing on F0 Discrimination and Concurrent-Vowel Identification , 2005, Ear and hearing.

[33]  Ying-Yee Kong,et al.  Temporal and spectral cues in Mandarin tone recognition , 2004 .

[34]  Trevor H. Chen,et al.  Seeing pitch: visual information for lexical tones of Mandarin-Chinese. , 2008, The Journal of the Acoustical Society of America.

[35]  R. Plomp.  Pitch of complex tones. , 1966, The Journal of the Acoustical Society of America.

[36]  Qian-Jie Fu,et al.  Effects of spectral shifting on speech perception in noise , 2010, Hearing Research.

[37]  Marc Moonen,et al.  Improved Music Perception with Explicit Pitch Coding in Cochlear Implants , 2006, Audiology and Neurotology.

[38]  J. Tomblin,et al.  Production and Perception of Speech Intonation in Pediatric Cochlear Implant Recipients and Individuals with Normal Hearing , 2008, Ear and hearing.

[39]  M. Chatterjee,et al.  Detection and rate discrimination of amplitude modulation in electrical hearing. , 2011, The Journal of the Acoustical Society of America.

[40]  Stuart Rosen,et al.  Enhancement of temporal periodicity cues in cochlear implants: effects on prosodic perception and vowel identification. , 2005, The Journal of the Acoustical Society of America.

[41]  Alexander L. Francis,et al.  The perception of Cantonese lexical tones by early-deafened cochlear implantees. , 2002, The Journal of the Acoustical Society of America.

[42]  Fan-Gang Zeng,et al.  Mandarin tone recognition in cochlear-implant subjects , 2004, Hearing Research.

[43]  Abeer Alwan,et al.  SAFE: A Statistical Approach to F0 Estimation Under Clean and Noisy Conditions , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[44]  Qian-Jie Fu,et al.  Noise Susceptibility of Cochlear Implant Users: The Role of Spectral Resolution and Smearing , 2005, Journal of the Association for Research in Otolaryngology.

[45]  Bryan E Pfingst,et al.  Relative importance of temporal envelope and fine structure in lexical-tone perception. , 2003, The Journal of the Acoustical Society of America.

[46]  R. Ritsma.  Frequencies dominant in the perception of the pitch of complex sounds. , 1966, The Journal of the Acoustical Society of America.

[47]  Feng Huang,et al.  Pitch Estimation in Noisy Speech Using Accumulated Peak Spectrum and Sparse Estimation Technique , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[48]  R. Meddis,et al.  A unitary model of pitch perception. , 1997, The Journal of the Acoustical Society of America.

[49]  Monita Chatterjee,et al.  Processing F0 with cochlear implants: Modulation frequency discrimination and speech intonation recognition , 2008, Hearing Research.

[50]  D. Hilbert.  Grundzuge Einer Allgemeinen Theorie Der Linearen Integralgleichungen , 2009 .

[51]  K. Plant,et al.  Speech Perception as a Function of Electrical Stimulation Rate: Using the Nucleus 24 Cochlear Implant System , 2000, Ear and hearing.

[52]  Ying-Yee Kong,et al.  Limits of temporal pitch in cochlear implants. , 2009, The Journal of the Acoustical Society of America.

[53]  Stuart Rosen,et al.  Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[54]  H J McDermott,et al.  Musical pitch perception with electrical stimulation of the cochlea. , 1997, The Journal of the Acoustical Society of America.

[55]  Zachary M. Smith,et al.  Chimaeric sounds reveal dichotomies in auditory perception , 2002, Nature.

[56]  Fan-Gang Zeng,et al.  Temporal pitch in electric hearing , 2002, Hearing Research.

[57]  Astrid van Wieringen,et al.  Improved fundamental frequency coding in cochlear implant signal processing. , 2009, The Journal of the Acoustical Society of America.

[58]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .