The time course of orthographic and semantic activation in Chinese character recognition: evidence from anERP study

ABSTRACT In this investigation, a picture-character matching task using the event-related potential (ERP) technique was conducted to identify the temporal dynamics of orthographic and semantic activation during Chinese character recognition. The ERP results revealed that the impact of orthography occurred early and was long-lasting, whereas the semantic effect was comparatively late. In particular, the orthographic effect exhibited a larger occipital N170, smaller frontal P200, and larger N400 component for characters sharing orthographic information with paired pictures. The observed orthographic effect may reflect the processing of characters shifting from radical-level facilitation at the N170 and P200 to lexical-level competition at the N400. In contrast, a semantic effect was only found at the N400. Additionally, a significant orthography by semantic interaction was found at the N400, reflecting the relevance of orthography during semantic activation in Chinese character recognition which suggested that character meaning could be directly accessed from orthography for skilled readers.

[1]  Janet Hui-wen Hsiao,et al.  Neural correlates of foveal splitting in reading: Evidence from an ERP study of Chinese character recognition , 2007, Neuropsychologia.

[2]  J F Juola,et al.  Dimensions of lexical coding in Chinese and English , 1982, Memory & cognition.

[3]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[4]  Xu-Chu Weng,et al.  Selectivity of N170 in the left hemisphere as an electrophysiological marker for expertise in reading Chinese , 2012, Neuroscience Bulletin.

[5]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[6]  D. Hung,et al.  Temporal dynamics of the consistency effect in reading Chinese: an event-related potentials study , 2007, Neuroreport.

[7]  Charles A. Perfetti,et al.  The time course of graphic, phonological, and semantic activation in Chinese character identification , 1998 .

[8]  Richard R. Rosinski,et al.  Picture-word interference is semantically based. , 1977 .

[9]  Gang Peng,et al.  Pre-lexical phonological processing in reading Chinese characters: An ERP study , 2014, Journal of Neurolinguistics.

[10]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[11]  Kara D. Federmeier,et al.  A Rose by Any Other Name: Long-Term Memory Structure and Sentence Processing , 1999 .

[12]  X. Weng,et al.  Left-lateralized N170 response to unpronounceable pseudo but not false Chinese characters—the key role of orthography , 2011, Neuroscience.

[13]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[14]  Ying Liu,et al.  ERP evidence for the time course of graphic, phonological, and semantic information in Chinese meaning and pronunciation decisions. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[15]  In-Mao Liu,et al.  Script Factors that Affect Literacy: Alphabetic vs. Logographic Languages , 1995 .

[16]  Ying,et al.  The timing of graphic, phonological and semantic activation of high and low frequency Chinese characters： An ERP study , 2007 .

[17]  John F. Connolly,et al.  Assessment of children's receptive vocabulary using event-related brain potentials: Development of a clinically valid test , 1995 .

[18]  M. Taft,et al.  The nature of the mental representation of radicals in Chinese: a priming study. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[19]  Andres H. Neuhaus,et al.  Spatiotemporal dynamics of early cortical gesture processing , 2014, NeuroImage.

[20]  P. Starreveld,et al.  Time-course analysis of semantic and orthographic context effects in picture naming. , 1996 .

[21]  Ted Rule,et al.  Chinese Language , 2009 .

[22]  Kin Fai Ellick Wong,et al.  Orthographic and Phonological Processing in Reading Chinese Text: Evidence From Eye Fixations , 1999 .

[23]  William S-Y. Wang,et al.  Achieving constancy in spoken word identification: Time course of talker normalization , 2013, Brain and Language.

[24]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[25]  R Frost,et al.  Toward a strong phonological theory of visual word recognition: true issues and false trails. , 1998, Psychological bulletin.

[26]  Markus F. Damian,et al.  Seriality of semantic and phonological processes during overt speech in Mandarin as revealed by event-related brain potentials , 2015, Brain and Language.

[27]  I. Su,et al.  An ERP study of effects of regularity and consistency in delayed naming and lexicality judgment in a logographic writing system , 2014, Front. Psychol..

[28]  A. Mecklinger,et al.  From orthography to meaning: an electrophysiological investigation of the role of phonology in accessing meaning of Chinese single-character words , 2010, Neuroscience.

[29]  Thomas Crump,et al.  Visible Speech: The Diverse Oneness of Writing Systems. , 1990 .

[30]  Jonathan Grainger,et al.  An ERP investigation of visual word recognition in syllabary scripts , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[31]  Ying Liu,et al.  The lexical constituency model: some implications of research on Chinese for general theories of reading. , 2005, Psychological review.

[32]  Zhixing Jin,et al.  The processing of phonological, orthographical, and lexical information of Chinese characters in sentence contexts: An ERP study , 2011, Brain Research.

[33]  Antje S. Meyer,et al.  Exploring the time course of lexical access in language production : Picture word interference studies , 1990 .

[34]  J. Ziegler,et al.  From print to meaning: an electrophysiological investigation of the role of phonology in accessing word meaning. , 1999, Psychophysiology.

[35]  Chia-Ying Lee,et al.  Orthographic combinability and phonological consistency effects in reading Chinese phonograms: An event-related potential study , 2009, Brain and Language.

[36]  M. Turvey,et al.  Visual lexical access is initially phonological: 1. Evidence from associative priming by words, homophones, and pseudohomophones. , 1994, Journal of experimental psychology. General.

[37]  M. Taft.  The Handbook of East Asian Psycholinguistics: Processing of characters by native Chinese readers , 2006 .

[38]  Qingfang Zhang,et al.  Orthographic facilitation effects on spoken word production: Evidence from Chinese , 2009 .

[39]  Qingfang Zhang,et al.  Independent Effects of Orthographic and Phonological Facilitation on Spoken Word Production in Mandarin , 2009, Language and speech.

[40]  A. Pollatsek,et al.  Automatic access of semantic information by phonological codes in visual word recognition. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[41]  B. Weekes,et al.  Effects of Semantic Radicals on Chinese Character Categorization and character Decision , 2004 .

[42]  A. Caramazza.  How many levels of processing are there in lexical access , 1997 .

[43]  Hsuan-Chich Chen,et al.  Limited role of phonology in reading Chinese two-character compounds: Evidence from an ERP study , 2014, Neuroscience.

[44]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[45]  Hsuan-Chich Chen,et al.  An early locus of associative and categorical context effects in speech production: evidence from an ERP study using the picture–word interference paradigm , 2017 .

[46]  Alfonso Caramazza.  Access of phonological and orthographic lexical forms : evidence from dissociations in reading and spelling , 1997 .

[47]  Peter Indefrey,et al.  The Spatial and Temporal Signatures of Word Production Components: A Critical Update , 2011, Front. Psychology.

[48]  E. Williams.  Experimental Designs Balanced for the Estimation of Residual Effects of Treatments , 1949 .

[49]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[50]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[51]  Qingfang Zhang,et al.  Transforming semantic interference into facilitation in a picture–word interference task , 2015, Applied Psycholinguistics.

[52]  A. Caramazza,et al.  The Autonomy of Lexical Orthography , 1997 .

[53]  Marta Kutas,et al.  Interplay between computational models and cognitive electrophysiology in visual word recognition , 2007, Brain Research Reviews.

[54]  Yanjie Su,et al.  Semantic Radicals Contribute More Than Phonetic Radicals to the Recognition of Chinese Phonograms: Behavioral and ERP Evidence in a Factorial Study , 2017, Front. Psychol..

[55]  H. Shu,et al.  Lexical activation during the recognition of Chinese characters: Evidence against early phonological activation , 2001, Psychonomic bulletin & review.

[56]  A. Friederici.  Event-related brain potential studies in language , 2004, Current neurology and neuroscience reports.

[57]  Peter Hagoort,et al.  The Processing Nature of the N400: Evidence from Masked Priming , 1993, Journal of Cognitive Neuroscience.

[58]  Sam-Po Law,et al.  Neural correlates of concreteness effect in semantic processing of single Chinese characters using mixed-effects modeling , 2017, Journal of Neurolinguistics.

[59]  Yiu-Kei Tsang,et al.  ERPs reveal sub-lexical processing in Chinese character recognition , 2012, Neuroscience Letters.

[60]  J. Pernier,et al.  ERP Manifestations of Processing Printed Words at Different Psycholinguistic Levels: Time Course and Scalp Distribution , 1999, Journal of Cognitive Neuroscience.

[61]  I. Su,et al.  Taking a Radical Position: Evidence for Position-Specific Radical Representations in Chinese Character Recognition Using Masked Priming ERP , 2012, Front. Psychology.

[62]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[63]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[64]  D. Hung,et al.  The temporal signatures of semantic and phonological activations for Chinese sublexical processing: An event-related potential study , 2006, Brain Research.

[65]  Markus F. Damian,et al.  Tracking the time course of lexical access in orthographic production: An event-related potential study of word frequency effects in written picture naming , 2016, Brain and Language.

[66]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[67]  C. C. Wood,et al.  Event-related potentials, lexical decision and semantic priming. , 1985, Electroencephalography and clinical neurophysiology.

[68]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[69]  Brendan S. Weekes,et al.  Picture word interference effects on naming in Chinese , 2002 .

[70]  Bruce D. McCandliss,et al.  The development of reading impairment: a cognitive neuroscience model. , 2003, Mental retardation and developmental disabilities research reviews.

[71]  C. Perfetti,et al.  A rose is a REEZ: The two-cycles model of phonology assembly in reading English , 1995 .

[72]  Kui Wang.  An electrophysiological investigation of the role of orthography in accessing meaning of Chinese single-character words , 2011, Neuroscience Letters.

[73]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[74]  William D. Marslen-Wilson,et al.  Sublexical Processing in Reading Chinese , 1999 .