The second-order effect of orthography-to-phonology mapping consistency on Chinese spoken word recognition

Abstract The influences of the orthography-to-phonology (O-to-P) mapping consistency as the first-order effect on visual word recognition are well documented. Few studies have investigated the second-order O-to-P consistency effect on spoken word recognition. To address this issue, Experiment 1 asked participants to perform a writing-to-dictation task for 230 Chinese monosyllabic words and found that the response accuracy increased with the homophone density, and the homophone density, O-to-P consistency, and character frequency also affected the generation probability and reaction time of written responses. Experiment 2 involved manipulating the homophone density of the spoken words and the O-to-P consistency of the written characters in writing to dictation with event-related potential measurement. The data revealed an interactive effect between the O-to-P consistency and homophone density on frontal-central N400 and a homophone density effect on the posterior late positivity component. The results support the reverberation effect of the O-to-P consistency on Chinese spoken word recognition.

[1]  W. Kuo,et al.  The Explicit and Implicit Phonological Processing of Chinese Characters and Words in Taiwanese Deaf Signers , 2016 .

[2]  Brendan S. Weekes,et al.  Effects of Consistency and Age of Acquisition on Reading and Spelling among Developing Readers , 2006 .

[3]  Julia D. I. Meuwese,et al.  Can the meaning of multiple words be integrated unconsciously? , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  W. Kuo,et al.  Cognitive and neural basis of the consistency and lexicality effects in reading Chinese , 2010, Journal of Neurolinguistics.

[5]  Jie-Li Tsai,et al.  Orthographic neighborhood effects in reading Chinese two-character words , 2006, Neuroreport.

[6]  Katherine J. Midgley,et al.  When beef primes reef more than leaf: orthographic information affects phonological priming in spoken word recognition. , 2009, Psychophysiology.

[7]  Qingfang Zhang,et al.  Phonological Codes Constrain Output of Orthographic Codes via Sublexical and Lexical Routes in Chinese Written Production , 2015, PloS one.

[8]  Yoonhyoung Lee,et al.  ERP index of the morphological family size effect during word recognition , 2012, Neuropsychologia.

[9]  Michael D. Rugg,et al.  The relationship between electrophysiological correlates of recollection and amount of information retrieved , 2006, Brain Research.

[10]  Conrad Perry,et al.  A phoneme-grapheme feedback consistency effect , 2003, Psychonomic bulletin & review.

[11]  Johannes C. Ziegler,et al.  Orthographic effects in spoken language: On-line activation or phonological restructuring? , 2009, Brain Research.

[12]  D. Jared Spelling-Sound Consistency and Regularity Effects in Word Naming , 2002 .

[13]  Katherine J. Midgley,et al.  Interactions in the neighborhood: Effects of orthographic and phonological neighbors on N400 amplitude , 2017, Journal of Neurolinguistics.

[14]  Chia-Wei Sun,et al.  A Brain-Wave-Actuated Small Robot Car Using Ensemble Empirical Mode Decomposition-Based Approach , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  T. Swaab,et al.  Orthographic neighborhood effects as a function of word frequency: an event-related potential study. , 2012, Psychophysiology.

[16]  C. Barry,et al.  Written spelling to dictation: Sound-to-spelling regularity affects both writing latencies and durations. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[17]  Zaizhu Han,et al.  Cognitive mechanism of writing to dictation of logographic characters , 2011, Applied Psycholinguistics.

[18]  James M. McQueen,et al.  Tracking lexical consolidation with ERPs: Lexical and semantic-priming effects on N400 and LPC responses to newly-learned words , 2015, Neuropsychologia.

[19]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[20]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[21]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[22]  Cynthia R Hunter Is the time course of lexical activation and competition in spoken word recognition affected by adult aging? An event-related potential (ERP) study , 2016, Neuropsychologia.

[23]  Kara D. Federmeier,et al.  A Beautiful Day in the Neighborhood: An Event-Related Potential Study of Lexical Relationships and Prediction in Context. , 2009, Journal of memory and language.

[24]  Chia-Ying Lee,et al.  Effects of orthographic consistency and homophone density on Chinese spoken word recognition , 2016, Brain and Language.

[25]  Jon Andoni Duñabeitia,et al.  Orthographic and associative neighborhood density effects: what is shared, what is different? , 2010, Psychophysiology.

[26]  Isabel Lacruz,et al.  Feedforward and Feedback Consistency Effects for High- and Low-Frequency Words in Lexical Decision and Naming , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[27]  Johannes C. Ziegler,et al.  On-line activation of orthography in spoken word recognition , 2008, Brain Research.

[28]  K. Spencer Predicting children's word-spelling difficulty for common English words from measures of orthographic transparency, phonemic and graphemic length and word frequency. , 2007, British journal of psychology.

[29]  S. Andrews The effect of orthographic similarity on lexical retrieval: Resolving neighborhood conflicts , 1997 .

[30]  Rainer Hammwöhner,et al.  Ensemble Empirical Mode Decomposition Analysis of EEG Data Collected during a Contour Integration Task , 2015, PloS one.

[31]  Patrick Bonin,et al.  Writing to dictation in real time in adults: What are the determinants of written latencies , 2002 .

[32]  Kenneth I. Forster,et al.  No enemies in the neighborhood: absence of inhibitory neighborhood effects in lexical decision and semantic categorization. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[33]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[34]  R. Peereman,et al.  Is perception a two-way street ?: The case of feedback consistency in visual word recognition , 1998 .

[35]  Jyotsna Vaid,et al.  Homophone density and phonological frequency in Chinese word recognition , 2009 .

[36]  P. Fox,et al.  The Neural System Underlying Chinese Logograph Reading , 2001, NeuroImage.

[37]  Régine Kolinsky,et al.  The locus of the orthographic consistency effect in auditory word recognition: Further evidence from French , 2007 .

[38]  Alan W. L. Chiu,et al.  Classification of intended motor movement using surface EEG ensemble empirical mode decomposition , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Wei-Kuang Liang,et al.  An improved method for measuring mismatch negativity using ensemble empirical mode decomposition , 2016, Journal of Neuroscience Methods.

[40]  R. Peereman,et al.  Consistency and word-frequency effects on spelling among first-to fifth-grade French children : A regression-based study , 2008 .

[41]  Stéphane Dufau,et al.  On-line Orthographic Influences on Spoken Language in a Semantic Task , 2009, Journal of Cognitive Neuroscience.

[42]  Slawomir J. Nasuto,et al.  Evaluation of Empirical Mode Decomposition for Event-Related Potential Analysis , 2011, EURASIP J. Adv. Signal Process..

[43]  David I. Donaldson,et al.  The neural mechanism underlying recollection is sensitive to the quality of episodic memory: Event related potentials reveal a some-or-none threshold , 2015, NeuroImage.

[44]  Mark S. Seidenberg,et al.  Orthographic effects on rhyme monitoring. , 1979 .

[45]  Guillaume Thierry,et al.  Brain potentials reveal semantic priming in both the ‘active’ and the ‘non-attended’ language of early bilinguals , 2009, NeuroImage.

[46]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[47]  Chia-Ying Lee,et al.  The Feedback Consistency Effect in Chinese Character Recognition: Evidence from a Psycholinguistic Norm , 2015 .

[48]  J. Ziegler,et al.  Feedback consistency effects in visual and auditory word recognition: where do we stand after more than a decade? , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[49]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[50]  Marcus Taft,et al.  Automatic activation of orthography in spoken word recognition: Pseudohomograph priming , 2008 .

[51]  A. Jacobs,et al.  On the role of competing word units in visual word recognition: The neighborhood frequency effect , 1989, Perception & psychophysics.

[52]  J. Grainger,et al.  An Electrophysiological Study of the Effects of Orthographic Neighborhood Size on Printed Word Perception , 2002, Journal of Cognitive Neuroscience.

[53]  J. Ziegler,et al.  Visual and Phonological Codes in Letter and Word Recognition: Evidence from Incremental Priming , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[54]  Kaia L. Vilberg,et al.  Functional significance of retrieval‐related activity in lateral parietal cortex: Evidence from fMRI and ERPs , 2009, Human brain mapping.

[55]  D. Hung,et al.  Temporal dynamics of the consistency effect in reading Chinese: an event-related potentials study , 2007, Neuroreport.

[56]  Jean-Rémi King,et al.  Probing ERP correlates of verbal semantic processing in patients with impaired consciousness , 2015, Neuropsychologia.

[57]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[58]  A. Pollatsek,et al.  The effects of "neighborhood size" in reading and lexical decision. , 1999, Journal of experimental psychology. Human perception and performance.

[59]  Jonathan Grainger,et al.  Language effects in second language learners and proficient bilinguals investigated with event-related potentials , 2009, Journal of Neurolinguistics.

[60]  Mark S. Seidenberg,et al.  The basis of consistency effects in word naming , 1990 .

[61]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[62]  H. Lyytinen,et al.  Hilbert-Huang versus Morlet wavelet transformation on mismatch negativity of children in uninterrupted sound paradigm , 2009, Nonlinear biomedical physics.

[63]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[64]  Orthographic congruency effects in the suprasegmental domain: Evidence from Thai , 2008, Quarterly journal of experimental psychology.

[65]  D. Hung,et al.  The temporal signatures of semantic and phonological activations for Chinese sublexical processing: An event-related potential study , 2006, Brain Research.

[66]  Jie-Li Tsai,et al.  Consistency, Regularity, and Frequency Effects in Naming Chinese Characters , 2005 .

[67]  Patrick Bonin,et al.  Frequency effects in the written and spoken production of homophonic picture names , 2002 .

[68]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[69]  B. Weekes,et al.  Effects of feedforward and feedback consistency on reading and spelling in dyslexia. , 2005, Dyslexia.

[70]  Xiaojian Li,et al.  The nature of the homophone density effect: An ERP study with Chinese spoken monosyllable homophones , 2012, Neuroscience Letters.

[71]  Jie-Li Tsai,et al.  A psycholinguistic database for traditional Chinese character naming , 2015, Behavior Research Methods.

[72]  D. Hung,et al.  Use of phonological codes for Chinese characters: Evidence from processing of parafoveal preview when reading sentences , 2004, Brain and Language.

[73]  A Revonsuo,et al.  Dissimilar age influences on two ERP waveforms (LPC and N400) reflecting semantic context effect. , 1996, Brain research. Cognitive brain research.

[74]  G. Stone,et al.  Perception Is a Two-Way Street: Feedforward and Feedback Phonology in Visual Word Recognition ☆ , 1997 .

[75]  G. Thierry,et al.  Do Spanish–English Bilinguals have Their Fingers in Two Pies – or is It Their Toes? An Electrophysiological Investigation of Semantic Access in Bilinguals , 2012, Front. Psychology.

[76]  Sam-Po Law,et al.  Feedback Consistency Effect on Writing-to-Dictation Task in Chinese , 2011 .

[77]  R. Harald Baayen,et al.  Analyzing linguistic data: a practical introduction to statistics using R, 1st Edition , 2008 .

[78]  J. Hsieh,et al.  Empirical Mode Decomposition-Based Approach for Intertrial Analysis of Olfactory Event-Related Potential Features , 2012, Chemosensory Perception.

[79]  Debra Jared,et al.  Spelling-Sound Consistency Affects the Naming of High-Frequency Words , 1997 .

[80]  M. Gareth Gaskell,et al.  Reading spoken words: Orthographic effects in auditory priming , 2007, Cognition.

[81]  Michael J Cortese,et al.  Visual word recognition of single-syllable words. , 2004, Journal of experimental psychology. General.

[82]  G O Stone,et al.  Building a resonance framework for word recognition using design and system principles. , 1994, Journal of experimental psychology. Human perception and performance.

[83]  J. Ziegler,et al.  The Feedback Consistency Effect in Lexical Decision and Naming , 1997 .

[84]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[85]  R. Peereman,et al.  Do Phonological Codes Constrain the Selection of Orthographic Codes in Written Picture Naming , 2001 .

[86]  Jie-Li Tsai,et al.  Neuronal correlates of consistency and frequency effects on Chinese character naming: an event-related fMRI study , 2004, NeuroImage.

[87]  Chia-Ying Lee,et al.  Orthographic combinability and phonological consistency effects in reading Chinese phonograms: An event-related potential study , 2009, Brain and Language.

[88]  S. Andrews Frequency and neighborhood effects on lexical access: Activation or search? , 1989 .