The impact of spectral resolution on the mismatch response to Mandarin Chinese tones: An ERP study of cochlear implant simulations

OBJECTIVE This study examined the impact of spectral resolution on the processing of lexical tones and the number of frequency channels required for a cochlear implant (CI) to transmit Chinese tonal information to the brain. METHODS ERPs were recorded in an auditory oddball task. Normal-hearing participants listened to speech sounds of two tones and their CI simulations in 1, 4, 8, or 32 channels. The mismatch response elicited by speech sounds and CI simulations in different numbers of channels were compared. RESULTS The mismatch negativity (MMN) was observed for speech sounds. For the 1-channel CI simulations, deviants elicited a more positive waveform than standard stimuli. No MMN response was observed with the 4-channel simulations. A reliable MMN response was observed for the 8- and 32-channel simulations. The MMN responses elicited by the 8- and 32-channel simulations were equivalent in magnitudes and smaller than that elicited by speech sounds. CONCLUSIONS More than eight frequency channels are required for a CI to transmit Chinese tonal information. The presence of both positive and negative mismatch responses suggests multiple mechanisms underlying auditory mismatch responses. SIGNIFICANCE The current findings of spectral resolution constraints on the transmission of tonal information should be taken into account in the design of the CI devices.

[1]  S. Luck,et al.  ERP Components: The Ups and Downs of Brainwave Recordings , 2011 .

[2]  Fan-Gang Zeng,et al.  Mandarin tone recognition in cochlear-implant subjects , 2004, Hearing Research.

[3]  D. D. Greenwood.  A cochlear frequency-position function for several species--29 years later. , 1990, The Journal of the Acoustical Society of America.

[4]  C. Adams,et al.  Mismatch negativity and frequency representational width in children with specific language impairment , 2008, Developmental medicine and child neurology.

[5]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[6]  Richard A. Harshman,et al.  Cross language differences in tone perception , 1977 .

[7]  Brian C J Moore,et al.  Coding of Sounds in the Auditory System and Its Relevance to Signal Processing and Coding in Cochlear Implants , 2003, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[8]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[9]  Chao He,et al.  Mismatch Responses to Pitch Changes in Early Infancy , 2007, Journal of Cognitive Neuroscience.

[10]  Valerie L. Shafer,et al.  Maturation of Mismatch Negativity in Typically Developing Infants and Preschool Children , 2002, Ear and hearing.

[11]  趙 元任.  Mandarin primer : an intensive course in spoken Chinese , 1948 .

[12]  A. Friederici,et al.  Neural manifestation of cognitive and precognitive mismatch detection in early infancy , 2002, Neuroreport.

[13]  Hintat Cheung,et al.  Perception and Production of Mandarin Tones in Prelingually Deaf Children with Cochlear Implants , 2004, Ear and hearing.

[14]  L. Trainor,et al.  Measuring temporal resolution in infants using mismatch negativity , 2001, Neuroreport.

[15]  S. Dehaene,et al.  Speed and cerebral correlates of syllable discrimination in infants , 1994, Nature.

[16]  Stuart Rosen,et al.  Acoustic cues to tonal contrasts in Mandarin: implications for cochlear implants. , 2008, The Journal of the Acoustical Society of America.

[17]  Yuen Ren Chao,et al.  Mandarin primer, an intensive course in spoken Chinese , 1948 .

[18]  D H Whalen,et al.  Information for Mandarin Tones in the Amplitude Contour and in Brief Segments , 1990, Phonetica.

[19]  D. Brandeis,et al.  Development of the automatic mismatch response: from frontal positivity in kindergarten children to the mismatch negativity , 2003, Clinical Neurophysiology.

[20]  L. Trainor,et al.  Changes in auditory cortex and the development of mismatch negativity between 2 and 6 months of age. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  S. R. Butler,et al.  Electrophysiological indicator of awakening from coma , 1993, The Lancet.

[22]  Hui-Mei Yang,et al.  Speech perception of Mandarin Chinese speaking young children after cochlear implant use: effect of age at implantation. , 2003, International journal of pediatric otorhinolaryngology.

[23]  Bryan E Pfingst,et al.  Features of stimulation affecting tonal-speech perception: implications for cochlear prostheses. , 2002, The Journal of the Acoustical Society of America.

[24]  Stuart Rosen,et al.  Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[25]  H. Semlitsch,et al.  A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. , 1986, Psychophysiology.

[26]  Robert V. Shannon,et al.  Importance of tonal envelope cues in Chinese speech recognition , 1995 .

[27]  J. Howie,et al.  Acoustical Studies of Mandarin Vowels and Tones , 1976 .

[28]  F. Zeng,et al.  Identification of temporal envelope cues in Chinese tone recognition , 2000 .

[29]  Q J Fu,et al.  Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing. , 1998, The Journal of the Acoustical Society of America.

[30]  F. Zeng,et al.  Importance of tonal envelope cues in Chinese speech recognition. , 1998, The Journal of the Acoustical Society of America.

[31]  Yu-Lin Tzeng,et al.  Mismatch responses to lexical tone, initial consonant, and vowel in Mandarin-speaking preschoolers , 2012, Neuropsychologia.

[32]  Yi Xu,et al.  Information for Mandarin tones in the amplitude contour and in brief segments , 1990 .

[33]  R. Näätänen,et al.  Auditory frequency discrimination and event-related potentials. , 1985, Electroencephalography and clinical neurophysiology.

[34]  R. V. Shannon,et al.  Evoked cortical activity and speech recognition as a function of the number of simulated cochlear implant channels , 2009, Clinical Neurophysiology.

[35]  Perrine Ruby,et al.  Odd Sound Processing in the Sleeping Brain , 2008, Journal of Cognitive Neuroscience.

[36]  K. Eklund,et al.  Event‐related brain potentials to change in rapidly presented acoustic stimuli in newborns , 1997 .

[37]  R. Shannon,et al.  Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants. , 2001, The Journal of the Acoustical Society of America.