Syllabic tone articulation influences the identification and use of words during Chinese sentence reading: Evidence from ERP and eye movement recordings

In two experiments, we examined the contribution of articulation-specific features to visual word recognition during the reading of Chinese. In spoken Standard Chinese, a syllable with a full tone can be tone-neutralized through sound weakening and pitch contour change, and there are two types of two-character compound words with respect to their articulation variation. One type requires articulation of a full tone for each constituent character, and the other requires a full- and a neutral-tone articulation for the first and second characters, respectively. Words of these two types with identical first characters were selected and embedded in sentences. Native speakers of Standard Chinese were recruited to read the sentences. In Experiment 1, the individual words of a sentence were presented serially at a fixed pace while event-related potentials were recorded. This resulted in less-negative N100 and anterior N250 amplitudes and in more-negative N400 amplitudes when targets contained a neutral tone. Complete sentences were visible in Experiment 2, and eye movements were recorded while participants read. Analyses of oculomotor activity revealed shorter viewing durations and fewer refixations on—and fewer regressive saccades to—target words when their second syllable was articulated with a neutral rather than a full tone. Together, the results indicate that readers represent articulation-specific word properties, that these representations are routinely activated early during the silent reading of Chinese sentences, and that the representations are also used during later stages of word processing.

[1]  Jie-Li Tsai,et al.  Parafoveal semantic information extraction in traditional Chinese reading. , 2012, Acta psychologica.

[2]  Laurie Beth Feldman,et al.  Morphological aspects of language processing. , 1997 .

[3]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[4]  G. Underwood Eye guidance in reading and scene perception , 1998 .

[5]  Jian Wang,et al.  Reading Chinese Script : A Cognitive Analysis , 1999 .

[6]  Katherine L. Wheat,et al.  During Visual Word Recognition, Phonology Is Accessed within 100 ms and May Be Mediated by a Speech Production Code: Evidence from Magnetoencephalography , 2010, The Journal of Neuroscience.

[7]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[8]  Lisa D. Sanders,et al.  Skilled readers begin processing sub-phonemic features by 80ms during visual word recognition: Evidence from ERPs , 2009, Biological Psychology.

[9]  D. Huszty,et al.  Equipment for measuring the flow-resistance of porous and fibrous materials , 1972 .

[10]  K. Rayner,et al.  Representing syllable information during silent reading: Evidence from eye movements , 2004 .

[11]  Cynthia M Connine,et al.  Is phonological context always used to recognize variant forms in spoken word recognition? The role of variant frequency and context distribution. , 2009, Journal of experimental psychology. Human perception and performance.

[12]  Jane Ashby,et al.  Prosody in Skilled Silent Reading: Evidence from Eye Movements. , 2006 .

[13]  Albrecht W Inhoff,et al.  Visual word recognition during reading is followed by subvocal articulation. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[14]  M. Richt Readers of Chinese extract semantic information from parafoveal words , 2009 .

[15]  Charles A. Perfetti,et al.  The Constituency Model of Chinese Word Identification , 1999 .

[16]  Kara D. Federmeier,et al.  Aging in context: age-related changes in context use during language comprehension. , 2005, Psychophysiology.

[17]  Kara D. Federmeier,et al.  The N400 as a snapshot of interactive processing: Evidence from regression analyses of orthographic neighbor and lexical associate effects. , 2011, Psychophysiology.

[18]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[19]  Katherine J. Midgley,et al.  An ERP investigation of masked cross-script translation priming , 2010, Brain Research.

[20]  Cynthia M. Connine,et al.  Rule-governed missing information in spoken word recognition: Schwa vowel deletion , 2002, Perception & psychophysics.

[21]  Ralph Radach,et al.  Phonological representation of words in working memory during sentence reading , 2004, Psychonomic bulletin & review.

[22]  Paul A Luce,et al.  Representation of lexical form: evidence from studies of sublexical ambiguity. , 2005, Journal of experimental psychology. Human perception and performance.

[23]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[24]  William D. Marslen-Wilson,et al.  Phonology, orthography, and semantic activation in reading Chinese , 1999 .

[25]  A. Inhoff,et al.  Use of parafoveally visible characters during the reading of Chinese sentences. , 2002, Journal of experimental psychology. Human perception and performance.

[26]  Cedric E. Ginestet ggplot2: Elegant Graphics for Data Analysis , 2011 .

[27]  Erik D. Reichle,et al.  Eye movements in reading and information processing : , 2015 .

[28]  C. Clifton,et al.  The prosodic property of lexical stress affects eye movements during silent reading , 2005, Cognition.

[29]  L. Tan,et al.  Phonological codes as early sources of constraint in Chinese word identification: A review of current discoveries and theoretical accounts , 1998 .

[30]  Ying Liu,et al.  The lexical constituency model: some implications of research on Chinese for general theories of reading. , 2005, Psychological review.

[31]  Kara D. Federmeier,et al.  The association between aerobic fitness and language processing in children: Implications for academic achievement , 2014, Brain and Cognition.

[32]  W. Marslen-Wilson,et al.  The relative time course of semantic and phonological activation in reading Chinese. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[33]  S. Goldinger,et al.  What the reader’s eye tells the mind’s ear: Silent reading activates inner speech , 1997, Perception & psychophysics.

[34]  Ming Yan,et al.  Preview fixation duration modulates identical and semantic preview benefit in Chinese reading , 2012 .

[35]  Chia-Ying Lee,et al.  Orthographic combinability and phonological consistency effects in reading Chinese phonograms: An event-related potential study , 2009, Brain and Language.

[36]  J. Grainger,et al.  Semantic transparency and masked morphological priming: an ERP investigation. , 2007, Psychophysiology.

[37]  L. Tan,et al.  Visual Chinese Character Recognition: Does Phonological Information Mediate Access to Meaning? , 1997 .

[38]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[39]  Marcus Taft,et al.  The representation of bound morphemes in the lexicon: A Chinese study. , 1995 .

[40]  Wang,et al.  The effects of pitch and duration on the perception of the neutral tone in standard Chinese , 2004 .

[41]  William D. Marslen-Wilson,et al.  Pseudohomophone effects in processing Chinese compound words , 2009 .

[42]  Ming Yan,et al.  Syllable articulation influences foveal and parafoveal processing of words during the silent reading of Chinese sentences , 2014 .

[43]  Ruth Filik,et al.  Inner Speech during Silent Reading Reflects the Reader's Regional Accent , 2011, PloS one.

[44]  D. Norris Models of visual word recognition , 2013, Trends in Cognitive Sciences.

[45]  Norval Smith,et al.  Studies in Chinese phonology , 1997 .

[46]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[47]  趙 元任,et al.  A grammar of spoken Chinese = 中國話的文法 , 1968 .

[48]  W. Kuo,et al.  Cognitive and neural basis of the consistency and lexicality effects in reading Chinese , 2010, Journal of Neurolinguistics.

[49]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[50]  Regine Bader,et al.  The FN400 is functionally distinct from the N400 , 2012, NeuroImage.

[51]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[52]  Charles A. Perfetti,et al.  The Universal Grammar of Reading , 2003 .

[53]  M. Brysbaert,et al.  SUBTLEX-CH: Chinese Word and Character Frequencies Based on Film Subtitles , 2010, PloS one.

[54]  Kristi A. Kiyonaga,et al.  The time course of orthographic and phonological code activation. , 1993, Psychological science.

[55]  Hsuan-Chih Chen,et al.  Eye movement control in reading: Logographic Chinese versus alphabetic scripts. , 2012, PsyCh journal.

[56]  D. Hung,et al.  Use of phonological codes for Chinese characters: Evidence from processing of parafoveal preview when reading sentences , 2004, Brain and Language.

[57]  Kara D. Federmeier,et al.  Age-related changes in the impact of contextual strength on multiple aspects of sentence comprehension. , 2012, Psychophysiology.

[58]  K. Alter,et al.  The relevance of rhythmical alternation in language processing: An ERP study on English compounds , 2014, Brain and Language.

[59]  B. Oken,et al.  Statistical issues concerning computerized analysis of brainwave topography , 1986, Annals of neurology.

[60]  J. Ashby Phonology is fundamental in skilled reading: Evidence from ERPs , 2010, Psychonomic bulletin & review.

[61]  Nathalie N. Bélanger,et al.  Chinese deaf readers have early access to parafoveal semantics. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[62]  Jonathan Grainger,et al.  On the Time Course of Visual Word Recognition: An Event-related Potential Investigation using Masked Repetition Priming , 2006, Journal of Cognitive Neuroscience.

[63]  Hsuan-Chich Chen,et al.  Limited role of phonology in reading Chinese two-character compounds: Evidence from an ERP study , 2014, Neuroscience.

[64]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[65]  Cynthia M. Connine,et al.  Lexical representation of phonological variation in spoken word recognition , 2007 .

[66]  K. Rastle,et al.  Masked phonological priming effects in English: Are they real? Do they matter? , 2006, Cognitive Psychology.

[67]  R. Frost Toward a strong phonological theory of visual word recognition: true issues and false trails. , 1998 .

[68]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[69]  W. Jialing The representation of the neutral tone in Chinese Putonghua , 1997 .

[70]  M. Turvey,et al.  Vowel duration affects visual word identification: evidence that the mediating phonology is phonetically informed. , 2004, Journal of experimental psychology. Human perception and performance.

[71]  Kathleen Rastle,et al.  Visual Word Recognition , 2007, The Oxford Handbook of Psycholinguistics.

[72]  Ram Frost,et al.  A universal approach to modeling visual word recognition and reading: Not only possible, but also inevitable , 2012, Behavioral and Brain Sciences.

[73]  Yi Xu,et al.  Production of Weak Elements in Speech – Evidence from F₀ Patterns of Neutral Tone in Standard Chinese , 2006, Phonetica.

[74]  J. Ashby,et al.  Prosodic phonological representations early in visual word recognition. , 2008, Journal of experimental psychology. Human perception and performance.

[75]  A. Inhoff,et al.  Chapter 2 – Definition and Computation of Oculomotor Measures in the Study of Cognitive Processes , 1998 .

[76]  Niels O. Schiller,et al.  The role of orthography and phonology in English: An ERP study on first and second language reading aloud , 2012, Brain Research.

[77]  David A. Balota,et al.  Visual Word Recognition , 2015, Linguistics.

[78]  L. Huestegge Effects of Vowel Length on Gaze Durations in Silent and Oral Reading , 2010 .

[79]  Wei Zhou,et al.  A validation of parafoveal semantic information extraction in reading Chinese , 2013 .

[80]  Liang Xu,et al.  Natural Proteasome Inhibitor Celastrol Suppresses Androgen-Independent Prostate Cancer Progression by Modulating Apoptotic Proteins and NF-kappaB , 2010, PloS one.

[81]  Chen Baoguo THE TIME COURSE OF GRAPHIC, PHONOLOGICAL AND SEMANTIC INFORMATION PROCESSING IN CHINESE CHARACTER RECOGNITION(I) , 2001 .