Setting the tone: An ERP investigation of the influences of phonological similarity on spoken word recognition in Mandarin Chinese

We investigated the influences of phonological similarity on the time course of spoken word processing in Mandarin Chinese. Event related potentials were recorded while adult native speakers of Mandarin (N=19) judged whether auditory words matched or mismatched visually presented pictures. Mismatching words were of the following nature: segmental (e.g., picture: hua1 'flower'; sound: hua4 'painting'); cohort (e.g., picture: hua1 'flower'; sound: hui1 'gray'); rhyme (e.g., picture: hua1 'flower'; sound: gua1 'melon'); tonal (e.g., picture: hua1 'flower'; sound: jing1 'whale'); unrelated (e.g., picture: hua1 'flower'; sound: lang2 'wolf'). Expectancy violations in the segmental condition showed an early-going modulation of components (starting at 250 ms post-stimulus onset), suggesting that listeners used tonal information to constrain word recognition as soon as it became available, just like they did with phonemic information in the cohort condition. However, effects were less persistent and more left-lateralized in the segmental than cohort condition, suggesting dissociable cognitive processes underlie access to tonal versus phonemic information. Cohort versus rhyme mismatches showed distinct patterns of modulation which were very similar to what has been observed in English, suggesting onsets and rimes are weighted similarly across the two languages. Last, we did not observe effects for whole-syllable mismatches above and beyond those for mismatches in individual components, suggesting the syllable does not merit a special status in Mandarin spoken word recognition. These results are discussed with respect to modifications needed for existing models to accommodate the tonal languages spoken by a large proportion of the world's speakers.

[1]  Jeffrey G Malins,et al.  The roles of tonal and segmental information in Mandarin spoken word recognition: An eyetracking study , 2010 .

[2]  A. Cutler,et al.  Lexical tone in Cantonese spoken-word processing , 1997, Perception & psychophysics.

[3]  J. Connolly,et al.  The Cambridge Handbook of Psycholinguistics: Event-Related Potentials and Magnetic Fields Associated with Spoken Word Recognition , 2012 .

[4]  William D. Marslen-Wilson,et al.  Words, Morphemes, and Syllables in the Chinese Mental Lexicon. , 1994 .

[5]  D. Lehmann,et al.  Reference-free identification of components of checkerboard-evoked multichannel potential fields. , 1980, Electroencephalography and clinical neurophysiology.

[6]  William D. Marslen-Wilson,et al.  Constraints of Lexical Tone on Semantic Activation in Chinese Spoken Word Recognition , 2004 .

[7]  Marcus Taft,et al.  Judging homophony in Chinese : the influence of tones , 1992 .

[8]  Marc F. Joanisse,et al.  Investigating the Time Course of Spoken Word Recognition: Electrophysiological Evidence for the Influences of Phonological Similarity , 2009, Journal of Cognitive Neuroscience.

[9]  Marc F. Joanisse,et al.  Specific phonological impairments in dyslexia revealed by eyetracking , 2006, Cognition.

[10]  Bruno H. Repp,et al.  Integration of segmental and tonal information in speech perception: A cross‐linguistic study , 1990 .

[11]  J. Howie,et al.  On the Domain of Tone in Mandarin , 1974 .

[12]  Paul D. Allopenna,et al.  Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models , 1998 .

[13]  J. Connolly,et al.  Event-Related Potential Components Reflect Phonological and Semantic Processing of the Terminal Word of Spoken Sentences , 1994, Journal of Cognitive Neuroscience.

[14]  J. Connolly,et al.  Electrophysiological markers of pre-lexical speech processing: Evidence for bottom–up and top–down effects on spoken word processing , 2009, Biological Psychology.

[15]  Jingjing Guo,et al.  Time course of Chinese monosyllabic spoken word recognition: Evidence from ERP analyses , 2011, Neuropsychologia.

[16]  B. Milner,et al.  A Cross-Linguistic PET Study of Tone Perception in Mandarin Chinese and English Speakers , 2001, NeuroImage.

[17]  D. Pisoni,et al.  Recognizing Spoken Words: The Neighborhood Activation Model , 1998, Ear and hearing.

[18]  W. Marslen-Wilson Functional parallelism in spoken word-recognition , 1987, Cognition.

[19]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[20]  Peter Hagoort,et al.  The Processing Nature of the N400: Evidence from Masked Priming , 1993, Journal of Cognitive Neuroscience.

[21]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[22]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[23]  H. Shu,et al.  Spoken word recognition in context: Evidence from Chinese ERP analyses , 2006, Brain and Language.

[24]  M. Lowe,et al.  Neural correlates of segmental and tonal information in speech perception , 2003, Human brain mapping.

[25]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[26]  A. Cutler,et al.  Pitch accent in spoken-word recognition in Japanese. , 1999, The Journal of the Acoustical Society of America.

[27]  Fan-Gang Zeng,et al.  Opposite patterns of hemisphere dominance for early auditory processing of lexical tones and consonants , 2006, Proceedings of the National Academy of Sciences.

[28]  Cynthia M. Connine,et al.  Processing Spoken Chinese: The Role of Tone Information , 1999 .

[29]  A. Cutler,et al.  Exploring the Role of Lexical stress in Lexical Recognition , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[30]  Min Wang,et al.  Subsyllabic unit preference in young Chinese children , 2008, Applied Psycholinguistics.

[31]  Hsuan-Chih Chen,et al.  Brain Responses to Segmentally and Tonally Induced Semantic Violations in Cantonese , 2005, Journal of Cognitive Neuroscience.

[32]  J. Connolly,et al.  Influence of phonological expectations during a phoneme deletion task: evidence from event-related brain potentials. , 2003, Psychophysiology.