Acoustic and Electrical Pattern Analysis of Consonant Perceptual Cues Used by Cochlear Implant Users

It is hypothesized that for postlingually deafened adult cochlear implant (CI) users, a significant source of their perceptual performance variability is attributable to differences in their ability to discriminate the basic perceptual cues that are important in speech recognition. Previous research on ‘electric hearing’ has identified consistent perceptual cues for vowel recognition. However, the results on consonant perception by CI users are less clear. The primary purpose of this study is to present a quantitative method of evaluating potential ‘electric cues’ used by CI users in consonant identification. Since the actual input signals to the auditory periphery of CI users are electric in nature, we elected to measure the CI electric discharge patterns in addition to the original acoustic waveforms. The characteristics of the electric discharge patterns in response to intervocalic consonants were quantified and correlated with the dimensions of CI patients’ perceptual spaces, which were computed from multidimensional scaling analyses of their consonant confusion matrices. The results agree with most, but not all, commonly accepted acoustic cues used by normal-hearing listeners. The correlation findings also suggest that CI users employ different sets of ‘electric cues’ in perceiving consonants that differ in their manner of articulation. Specifically, spectral and temporal cues associated with slowly changing formant structures and transitions, and features associated with frication and high-frequency noise, are all highly correlated with the perceptual dimensions of all CI users. However, rapidly changing formant transitions, such as those present in stop consonants, did not appear to play a significant role in consonant recognition by more poorly performing CI subjects. The perceptual results were consistent with our physical findings that the SPEAK coding strategy partially degraded the rapidly changing formant transitions.

[1]  A. Liberman,et al.  The role of consonant-vowel transitions in the perception of the stop and nasal consonants. , 1954 .

[2]  G. A. Miller,et al.  An Analysis of Perceptual Confusions Among Some English Consonants , 1955 .

[3]  G. A. Miller,et al.  Erratum: An Analysis of Perceptual Confusions Among Some English Consonants [J. Acoust. Soc. Am. 27, 339 (1955)] , 1955 .

[4]  A. Liberman,et al.  Tempo of frequency change as a cue for distinguishing classes of speech sounds. , 1956, Journal of experimental psychology.

[5]  R. Shepard Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space , 1957 .

[6]  A. Liberman,et al.  Acoustic Cues for the Perception of Initial /w, j, r, l/ in English , 1957 .

[7]  A. Djourno,et al.  De l'excitation électrique du nerfcochléaire chez l'homme, par induction à distance, a l'aide d'un micro bobinage inclus à demeure. , 1957 .

[8]  R. Shepard Stimulus and response generalization: tests of a model relating generalization to distance in psychological space. , 1958, Journal of experimental psychology.

[9]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[10]  W. Klein,et al.  Vowel spectra, vowel spaces, and vowel identification. , 1970, The Journal of the Acoustical Society of America.

[11]  J. Lackner,et al.  The Psychological Representation of Speech Sounds , 1975, The Quarterly journal of experimental psychology.

[12]  S. Blumstein,et al.  Invariant cues for place of articulation in stop consonants. , 1978, The Journal of the Acoustical Society of America.

[13]  P. Arabie,et al.  Auditory versus phonetic accounts of observed confusions between consonant phonemes. , 1979, The Journal of the Acoustical Society of America.

[14]  S. Blumstein,et al.  Perceptual integration of the murmur and formant transitions for place of articulation in nasal consonants. , 1984, The Journal of the Acoustical Society of America.

[15]  A cross-language investigation of the stop, affricate and fricate manners of articultion , 1985 .

[16]  B. Repp Perception of the [m]-[n] distinction in CV syllables. , 1986, The Journal of the Acoustical Society of America.

[17]  P M Seligman,et al.  Vowel and consonant recognition of cochlear implant patients using formant-estimating speech processors. , 1987, The Journal of the Acoustical Society of America.

[18]  Luboš Voldřich,et al.  Correlative study of sensory cell density and cochlear length in humans , 1987, Hearing Research.

[19]  N. Viemeister,et al.  Intensity discrimination, increment detection, and magnitude estimation for 1-kHz tones. , 1988, The Journal of the Acoustical Society of America.

[20]  B H Repp,et al.  Perception of the [m]-[n] distinction in VC syllables. , 1988, The Journal of the Acoustical Society of America.

[21]  F K Kuk,et al.  Performance of some of the better cochlear-implant patients. , 1989, Journal of speech and hearing research.

[22]  R V Shannon,et al.  Detection of gaps in sinusoids and pulse trains by patients with cochlear implants. , 1989, The Journal of the Acoustical Society of America.

[23]  A. Jongman Duration of frication noise required for identification of English fricatives. , 1989, The Journal of the Acoustical Society of America.

[24]  M F Dorman,et al.  Acoustic cues for consonant identification by patients who use the Ineraid cochlear implant. , 1990, The Journal of the Acoustical Society of America.

[25]  Raymond D. Kent,et al.  Acoustic Analysis of Speech , 2009 .

[26]  Graeme M. Clark,et al.  Factors Predicting Postoperative Sentence Scores in Postlinguistically Deaf Adult Cochlear Implant Patients , 1992, The Annals of otology, rhinology, and laryngology.

[27]  R S Tyler,et al.  Consonant recognition by some of the better cochlear-implant patients. , 1992, The Journal of the Acoustical Society of America.

[28]  A. Bosman,et al.  Phoneme recognition by deaf individuals using the multichannel nucleus cochlear implant. , 1992, Acta oto-laryngologica.

[29]  H J McDermott,et al.  Perceptual Performance of Subjects with Cochlear Implants Using the Spectral Maxima Sound Processor (SMSP) and the Mini Speech Processor (MSP) , 1993, Ear and hearing.

[30]  P J Abbas,et al.  Multivariate Predictors of Audiological Success with Multichannel Cochlear Implants , 1993, The Annals of otology, rhinology, and laryngology.

[31]  J K Shallop,et al.  Evaluation of a new spectral peak coding strategy for the Nucleus 22 Channel Cochlear Implant System. , 1994, The American journal of otology.

[32]  L M Collins,et al.  Temporal pattern discrimination and speech recognition under electrical stimulation. , 1994, The Journal of the Acoustical Society of America.

[33]  D J Van Tasell,et al.  Electrode ranking of "place pitch" and speech recognition in electrical hearing. , 1995, The Journal of the Acoustical Society of America.

[34]  N. Dillier,et al.  Electrodographic analysis and field evaluation of the Speak coding strategy. , 1995, The Annals of otology, rhinology & laryngology. Supplement.

[35]  G S Donaldson,et al.  Intensity discrimination as a function of stimulus level with electric stimulation. , 1996, The Journal of the Acoustical Society of America.

[36]  G. Woodworth,et al.  A within-subject comparison of adult patients using the Nucleus F0F1F2 and F0F1F2B3B4B5 speech processing strategies. , 1996, Journal of speech and hearing research.

[37]  L Whitford,et al.  Factors affecting auditory performance of postlinguistically deaf adults using cochlear implants. , 1996, Audiology & neuro-otology.

[38]  R V Shannon,et al.  Speech recognition as a function of the number of electrodes used in the SPEAK cochlear implant speech processor. , 1997, Journal of speech, language, and hearing research : JSLHR.

[39]  D. Buonomano,et al.  Learning and Generalization of Auditory Temporal–Interval Discrimination in Humans , 1997, The Journal of Neuroscience.

[40]  S. Staller,et al.  Speech perception abilities of adult and pediatric Nucleus implant recipients using the Spectral Peak (SPEAK) coding strategy. , 1997, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[41]  L M Collins,et al.  Comparison of electrode discrimination, pitch ranking, and pitch scaling data in postlingually deafened adult cochlear implant subjects. , 1997, Journal of the Acoustical Society of America.

[42]  A E Carney,et al.  Effect of relative amplitude and formant transitions on perception of place of articulation by adult listeners with cochlear implants. , 1997, Journal of speech, language, and hearing research : JSLHR.

[43]  A van Wieringen,et al.  Natural vowel and consonant recognition by Laura cochlear implantees. , 1999, Ear and hearing.

[44]  C S Throckmorton,et al.  Investigation of the effects of temporal and spatial interactions on speech-recognition skills in cochlear-implant subjects. , 1999, The Journal of the Acoustical Society of America.

[45]  G S Donaldson,et al.  Place-pitch sensitivity and its relation to consonant recognition by cochlear implant listeners using the MPEAK and SPEAK speech processing strategies. , 2000, The Journal of the Acoustical Society of America.

[46]  H J McDermott,et al.  The relationship between speech perception and electrode discrimination in cochlear implantees. , 2000, The Journal of the Acoustical Society of America.

[47]  B. Wright Why and How We Study Human Learning on Basic Auditory Tasks , 2001, Audiology and Neurotology.

[48]  P. Jusczyk,et al.  Speech Perception and Spoken Word Recognition: Past and Present , 2002, Ear and hearing.

[49]  A Quentin Summerfield,et al.  Use of vocalic information in the identification of /s/ and /sh/ by children with cochlear implants. , 2002, Ear and hearing.

[50]  Jeroen J. Briaire,et al.  Initial Evaluation of the Clarion CII Cochlear Implant: Speech Perception and Neural Response Imaging , 2002, Ear and hearing.

[51]  Norbert Dillier,et al.  A Software Tool for Analyzing Multichannel Cochlear Implant Signals , 2003, Ear and hearing.

[52]  Coarticulation • Suprasegmentals,et al.  Acoustic Phonetics , 2019, The SAGE Encyclopedia of Human Communication Sciences and Disorders.