Voice Discrimination by Adults with Cochlear Implants: the Benefits of Early Implantation for Vocal-Tract Length Perception

Cochlear implant (CI) users find it extremely difficult to discriminate between talkers, which may partially explain why they struggle to understand speech in a multi-talker environment. Recent studies, based on findings with postlingually deafened CI users, suggest that these difficulties may stem from their limited use of vocal-tract length (VTL) cues due to the degraded spectral resolution transmitted by the CI device. The aim of the present study was to assess the ability of adult CI users who had no prior acoustic experience, i.e., prelingually deafened adults, to discriminate between resynthesized “talkers” based on either fundamental frequency (F0) cues, VTL cues, or both. Performance was compared to individuals with normal hearing (NH), listening either to degraded stimuli, using a noise-excited channel vocoder, or non-degraded stimuli. Results show that (a) age of implantation was associated with VTL but not F0 cues in discriminating between talkers, with improved discrimination for those subjects who were implanted at earlier age; (b) there was a positive relationship for the CI users between VTL discrimination and speech recognition score in quiet and in noise, but not with frequency discrimination or cognitive abilities; (c) early-implanted CI users showed similar voice discrimination ability as the NH adults who listened to vocoded stimuli. These data support the notion that voice discrimination is limited by the speech processing of the CI device. However, they also suggest that early implantation may facilitate sensory-driven tonotopicity and/or improve higher-order auditory functions, enabling better perception of VTL spectral cues for voice discrimination.

[1]  G S Donaldson,et al.  Place-pitch sensitivity and its relation to consonant recognition by cochlear implant listeners using the MPEAK and SPEAK speech processing strategies. , 2000, The Journal of the Acoustical Society of America.

[2]  M. Dorman,et al.  The influence of a sensitive period on central auditory development in children with unilateral and bilateral cochlear implants , 2005, Hearing Research.

[3]  Jong Ho Won,et al.  Spectral-Ripple Resolution Correlates with Speech Reception in Noise in Cochlear Implant Users , 2007, Journal of the Association for Research in Otolaryngology.

[4]  D. Kovačić,et al.  Hearing History Influences Voice Gender Perceptual Performance in Cochlear Implant Users , 2010, Ear and hearing.

[5]  Roy D Patterson,et al.  The interaction of vocal characteristics and audibility in the recognition of concurrent syllables. , 2009, The Journal of the Acoustical Society of America.

[6]  L. Kishon-Rabin,et al.  Does Feedback Matter in an Auditory Frequency Discrimination Learning Task? , 2010, Journal of basic and clinical physiology and pharmacology.

[7]  A. Boothroyd Statistical theory of the speech discrimination score. , 1968, The Journal of the Acoustical Society of America.

[8]  Xin Luo,et al.  Pitch contour identification with combined place and temporal cues using cochlear implants. , 2012, The Journal of the Acoustical Society of America.

[9]  M. Chatterjee,et al.  Fundamental-frequency discrimination using noise-band-vocoded harmonic complexes in older listeners with normal hearing. , 2015, The Journal of the Acoustical Society of America.

[10]  Monita Chatterjee,et al.  Processing F0 with cochlear implants: Modulation frequency discrimination and speech intonation recognition , 2008, Hearing Research.

[11]  Qian-Jie Fu,et al.  Voice gender identification by cochlear implant users: the role of spectral and temporal resolution. , 2005, The Journal of the Acoustical Society of America.

[12]  Q J Fu,et al.  Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing. , 1998, The Journal of the Acoustical Society of America.

[13]  Dawn Langdon,et al.  Executive function and language in deaf children. , 2008, Journal of deaf studies and deaf education.

[14]  Deniz Başkent,et al.  Factors limiting vocal-tract length discrimination in cochlear implant simulations. , 2015, The Journal of the Acoustical Society of America.

[15]  J. Bourke,et al.  Substrate ablation of ventricular tachycardia in structural heart disease: a new dimension? , 2011, European heart journal.

[16]  Effects of chronic cochlear electrical stimulation after an extended period of profound deafness on primary auditory cortex organization in cats , 2014, The European journal of neuroscience.

[17]  P. Belin,et al.  Thinking the voice: neural correlates of voice perception , 2004, Trends in Cognitive Sciences.

[18]  Roy D Patterson,et al.  The mutual roles of temporal glimpsing and vocal characteristics in cocktail-party listening. , 2011, The Journal of the Acoustical Society of America.

[19]  Andrej Kral,et al.  Reorganization of the Connectivity of Cortical Field DZ in Congenitally Deaf Cat , 2013, PloS one.

[20]  Fan-Gang Zeng,et al.  Temporal pitch in electric hearing , 2002, Hearing Research.

[21]  Benjamin Munson,et al.  Phonetic identification in quiet and in noise by listeners with cochlear implants. , 2005, The Journal of the Acoustical Society of America.

[22]  C E Schreiner,et al.  Neuronal responses in cat primary auditory cortex to electrical cochlear stimulation. III. Activation patterns in short- and long-term deafness. , 1999, Journal of neurophysiology.

[23]  Kevin H Franck,et al.  Frequency and electrode discrimination in children with cochlear implants , 2010, Hearing Research.

[24]  P. Barone,et al.  Gender categorization in cochlear implant users. , 2013, Journal of speech, language, and hearing research : JSLHR.

[25]  D. Winfield The postnatal development of synapses in the different laminae of the visual cortex in the normal kitten and in kittens with eyelid suture. , 1983, Brain research.

[26]  Leslie M. Collins,et al.  Mandarin Chinese tone identification in cochlear implants: Predictions from acoustic models , 2008, Hearing Research.

[27]  Matthew B. Winn,et al.  Assessment of Spectral and Temporal Resolution in Cochlear Implant Users Using Psychoacoustic Discrimination and Speech Cue Categorization , 2016, Ear and hearing.

[28]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[29]  Deniz Başkent,et al.  Gender Categorization Is Abnormal in Cochlear Implant Users , 2014, Journal of the Association for Research in Otolaryngology.

[30]  T Lenarz,et al.  Optical imaging of cat auditory cortical organization after electrical stimulation of a multichannel cochlear implant: differential effects of acute and chronic stimulation. , 1997, The American journal of otology.

[31]  F. Zeng,et al.  Speaker recognition with temporal cues in acoustic and electric hearing. , 2005, The Journal of the Acoustical Society of America.

[32]  Marc Moonen,et al.  Relative contributions of temporal and place pitch cues to fundamental frequency discrimination in cochlear implantees. , 2004, The Journal of the Acoustical Society of America.

[33]  Raymond L. Goldsworthy,et al.  Psychoacoustic and Phoneme Identification Measures in Cochlear-Implant and Normal-Hearing Listeners , 2013, Trends in amplification.

[34]  Eric Moulines,et al.  Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones , 1989, Speech Commun..

[35]  Xin Luo,et al.  Cochlear Implants Special Issue Article: Vocal Emotion Recognition by Normal-Hearing Listeners and Cochlear Implant Users , 2007, Trends in amplification.

[36]  Jan Wouters,et al.  Multichannel Place Pitch Sensitivity in Cochlear Implant Recipients , 2004, Journal of the Association for Research in Otolaryngology.

[37]  A Kral,et al.  Postnatal cortical development in congenital auditory deprivation. , 2005, Cerebral cortex.

[38]  André Syrota,et al.  Cochlear Implant Benefits in Deafness Rehabilitation: PET Study of Temporal Voice Activations , 2007, Journal of Nuclear Medicine.

[39]  P. Huttenlocher,et al.  Regional differences in synaptogenesis in human cerebral cortex , 1997, The Journal of comparative neurology.

[40]  Herman J. M. Steeneken,et al.  Phoneme-group specific octave-band weights in predicting speech intelligibility , 2002, Speech Commun..

[41]  A. Kral Auditory critical periods: A review from system’s perspective , 2013, Neuroscience.

[42]  R. Shannon,et al.  Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants. , 2001, The Journal of the Acoustical Society of America.

[43]  J. Galvin,et al.  The Role of Spectral and Temporal Cues in Voice Gender Discrimination by Normal-Hearing Listeners and Cochlear Implant Users , 2004, Journal of the Association for Research in Otolaryngology.

[44]  D. Houston,et al.  Auditory Discrimination of Lexical Stress Patterns in Hearing-Impaired Infants with Cochlear Implants Compared with Normal Hearing: Influence of Acoustic Cues and Listening Experience to the Ambient Language , 2016, Ear and hearing.

[45]  Thomas C. Walters,et al.  Discrimination of speaker sex and size when glottal-pulse rate and vocal-tract length are controlled. , 2007, The Journal of the Acoustical Society of America.

[46]  Liat Kishon-Rabin,et al.  ARE THE PERCEPTUAL EFFECTS OF SPECTRAL SMEARING INFLUENCED BY SPEAKER GENDER? , 2004, Journal of basic and clinical physiology and pharmacology.

[47]  Christopher M. Conway,et al.  The Importance of Sound for Cognitive Sequencing Abilities , 2009, Current directions in psychological science.

[48]  R. Klinke,et al.  Hearing after congenital deafness: central auditory plasticity and sensory deprivation. , 2002, Cerebral cortex.

[49]  D J Van Tasell,et al.  Electrode ranking of "place pitch" and speech recognition in electrical hearing. , 1995, The Journal of the Acoustical Society of America.

[50]  B. Pfingst,et al.  Spectral and temporal cues for speech recognition: Implications for auditory prostheses , 2008, Hearing Research.

[51]  T. Griffiths,et al.  What is an auditory object? , 2004, Nature Reviews Neuroscience.

[52]  Yi Xu,et al.  Encoding Emotions in Speech with the Size Code , 2009, Phonetica.

[53]  Jong Ho Won,et al.  Relationship between channel interaction and spectral-ripple discrimination in cochlear implant users. , 2011, The Journal of the Acoustical Society of America.

[54]  David B Pisoni,et al.  Measures of Digit Span and Verbal Rehearsal Speed in Deaf Children After More Than 10 Years of Cochlear Implantation , 2011, Ear and hearing.

[55]  Xin Luo,et al.  Speech Recognition and Temporal Amplitude Modulation Processing by Mandarin-Speaking Cochlear Implant Users , 2008, Ear and hearing.

[56]  Hintat Cheung,et al.  Perception and Production of Mandarin Tones in Prelingually Deaf Children with Cochlear Implants , 2004, Ear and hearing.

[57]  F. Zeng,et al.  Comparison of Bimodal and Bilateral Cochlear Implant Users on Speech Recognition With Competing Talker, Music Perception, Affective Prosody Discrimination, and Talker Identification , 2010, Ear and hearing.

[58]  D. Ellemberg,et al.  Deficits in auditory frequency discrimination and speech recognition in cochlear implant users , 2015, Cochlear implants international.

[59]  Belinda A Henry,et al.  Spectral peak resolution and speech recognition in quiet: normal hearing, hearing impaired, and cochlear implant listeners. , 2005, The Journal of the Acoustical Society of America.

[60]  Mm. Liabre Standard Progressive Matrices , 1984 .

[61]  M. Svirsky,et al.  Development of Language and Speech Perception in Congenitally, Profoundly Deaf Children as a Function of Age at Cochlear Implantation , 2004, Audiology and Neurotology.

[62]  B. Papsin,et al.  Effects of cochlear implant use on the electrically evoked middle latency response in children , 2005, Hearing Research.

[63]  Shinji Maeda,et al.  Fundamental frequency histograms measured by electroglottography during speech: a pilot study for standardization. , 2006, Journal of voice : official journal of the Voice Foundation.

[64]  Stefan R Schweinberger,et al.  Influences of fundamental frequency, formant frequencies, aperiodicity, and spectrum level on the perception of voice gender. , 2014, Journal of speech, language, and hearing research : JSLHR.

[65]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[66]  D. Irvine,et al.  Effects of deafness and cochlear implant use on temporal response characteristics in cat primary auditory cortex , 2014, Hearing Research.

[67]  B. Fraysse,et al.  Voice discrimination in cochlear-implanted deaf subjects , 2011, Hearing Research.

[68]  James B. Dewey,et al.  Effects of fundamental frequency and vocal-tract length cues on sentence segregation by listeners with hearing loss. , 2011, The Journal of the Acoustical Society of America.

[69]  Marc Moonen,et al.  Improved Music Perception with Explicit Pitch Coding in Cochlear Implants , 2006, Audiology and Neurotology.

[70]  Andrej Kral,et al.  Brain plasticity under cochlear implant stimulation. , 2006, Advances in oto-rhino-laryngology.

[71]  Ning Zhou,et al.  Lexical Tone Perception with HiResolution and HiResolution 120 Sound-Processing Strategies in Pediatric Mandarin-Speaking Cochlear Implant Users , 2009, Ear and hearing.

[72]  R. Shannon Multichannel electrical stimulation of the auditory nerve in man. I. Basic psychophysics , 1983, Hearing Research.

[73]  Eric W Healy,et al.  Sensitivity to isolated and concurrent intensity and fundamental frequency increments by cochlear implant users under natural listening conditions. , 2006, The Journal of the Acoustical Society of America.

[74]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[75]  Robert K. Shepherd,et al.  Deafness-Induced Changes in the Auditory Pathway: Implications for Cochlear Implants , 2001, Audiology and Neurotology.

[76]  Qian-Jie Fu,et al.  Melodic Pitch Perception and Lexical Tone Perception in Mandarin-Speaking Cochlear Implant Users , 2015, Ear and hearing.

[77]  A. Bronkhorst The cocktail-party problem revisited: early processing and selection of multi-talker speech , 2015, Attention, Perception, & Psychophysics.

[78]  D. Wechsler Wechsler Intelligence Scale for Children , 2020, Definitions.

[79]  B. Kollmeier Overcoming language barriers: Matrix sentence tests with closed speech corpora , 2015, International journal of audiology.

[80]  Roy D Patterson,et al.  The interaction of glottal-pulse rate and vocal-tract length in judgements of speaker size, sex, and age. , 2005, The Journal of the Acoustical Society of America.

[81]  Martin Walger,et al.  The Use of Voice Cues for Speaker Gender Recognition in Cochlear Implant Recipients. , 2016, Journal of speech, language, and hearing research : JSLHR.

[82]  D. Irvine,et al.  Cochlear implant use following neonatal deafness influences the cochleotopic organization of the primary auditory cortex in cats , 2009, The Journal of comparative neurology.

[83]  C. Darwin,et al.  Effects of fundamental frequency and vocal-tract length changes on attention to one of two simultaneous talkers. , 2003, The Journal of the Acoustical Society of America.

[84]  M. Turvey,et al.  The motor theory of speech perception reviewed , 2006, Psychonomic bulletin & review.

[85]  R. Mühler,et al.  Development of a Speaker Discrimination Test for Cochlear Implant Users Based on the Oldenburg Logatome Corpus , 2008, ORL.

[86]  Deniz Başkent,et al.  Musician advantage for speech-on-speech perception. , 2016, The Journal of the Acoustical Society of America.

[87]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[88]  D. Pisoni,et al.  Executive functioning skills in long-term users of cochlear implants: a case control study. , 2013, Journal of pediatric psychology.

[89]  T. Tombaugh Trail Making Test A and B: normative data stratified by age and education. , 2004, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.