Weighting Pitch Contour and Loudness Contour in Mandarin Tone Perception in Cochlear Implant Listeners

Previous investigations found that loudness-contours within individual Mandarin monosyllables can drive categorical perception of Mandarin tone for cochlear implant (CI) users, while in normal hearing (NH) subjects the pitch contour is phonologically acknowledged to be the dominant cue. Here we further examine the weighting strategy of pitch induced and loudness induced contour identification on Mandarin tone perception by CI users. Twenty-seven versions of the disyllabic utterance /Lao3 Shi/ with orthogonally manipulated loudnesscontour and pitch-contour of the voiced portion of the second monosyllable /Shi/ served as the stimuli to both CI and NH subjects. In Mandarin, if /Shi/ is pronounced with high-flatpitched Tone 1 the word means “teacher”, with rising Tone 2 it means “well-behaved”, or with falling Tone 4 it means “always”. CI users generally had poorer word-recognition scores and their inter-subject variance was large. While NH subjects recognized tone reliably based on pitch-contour, half of the CI users relied on pitch-contour, the other half on loudness-contour, implying systematic differences in pitch coding in their CI processing. This paradigm of orthogonal manipulation of pitch and loudness contours could be developed into improved audiometric tests of Mandarin tone perception and pitch coding with CIs.

[1]  D H Whalen,et al.  Information for Mandarin Tones in the Amplitude Contour and in Brief Segments , 1990, Phonetica.

[2]  Hideki Kawahara,et al.  Algorithm amalgam: morphing waveform based methods, sinusoidal models and STRAIGHT , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Josh H McDermott,et al.  PSYCHOLOGICAL SCIENCE Research Article Is Relative Pitch Specific to Pitch? , 2022 .

[4]  Daniel Pressnitzer,et al.  What breaks a melody: Perceiving F0 and intensity sequences with a cochlear implant , 2010, Hearing Research.

[5]  Fan-Gang Zeng Tonal Language Processing , 2012 .

[6]  Xin Luo,et al.  Contour identification with pitch and loudness cues using cochlear implants. , 2014, The Journal of the Acoustical Society of America.

[7]  Adam M. Croom Auditory Neuroscience: Making Sense of Sound , 2014 .

[8]  Josh H. McDermott,et al.  Diversity in pitch perception revealed by task dependence , 2017, Nature Human Behaviour.

[9]  M. Deroche,et al.  Processing of Acoustic Cues in Lexical-Tone Identification by Pediatric Cochlear-Implant Recipients. , 2017, Journal of speech, language, and hearing research : JSLHR.

[10]  Qian-Jie Fu,et al.  Implementation and preliminary evaluation of ‘C-tone’: A novel algorithm to improve lexical tone recognition in Mandarin-speaking cochlear implant users , 2017, Cochlear implants international.

[11]  Xia Li,et al.  Loudness Contour Can Influence Mandarin Tone Recognition: Vocoder Simulation and Cochlear Implants , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  A. Oxenham How We Hear: The Perception and Neural Coding of Sound , 2018, Annual review of psychology.