Words and pictures: An electrophysiological investigation of domain specific processing in native Chinese and English speakers

Comparisons of word and picture processing using event-related potentials (ERPs) are contaminated by gross physical differences between the two types of stimuli. In the present study, we tackle this problem by comparing picture processing with word processing in an alphabetic and a logographic script, that are also characterized by gross physical differences. Native Mandarin Chinese speakers viewed pictures (line drawings) and Chinese characters (Experiment 1), native English speakers viewed pictures and English words (Experiment 2), and naïve Chinese readers (native English speakers) viewed pictures and Chinese characters (Experiment 3) in a semantic categorization task. The varying pattern of differences in the ERPs elicited by pictures and words across the three experiments provided evidence for (i) script-specific processing arising between 150 and 200 ms post-stimulus onset, (ii) domain-specific but script-independent processing arising between 200 and 300 ms post-stimulus onset, and (iii) processing that depended on stimulus meaningfulness in the N400 time window. The results are interpreted in terms of differences in the way visual features are mapped onto higher-level representations for pictures and words in alphabetic and logographic writing systems.

[1]  David L. Sheinberg,et al.  The role of category learning in the acquisition and retention of perceptual expertise: A behavioral and neurophysiological study , 2008, Brain Research.

[2]  Daniel Brandeis,et al.  Evidence for developmental changes in the visual word processing network beyond adolescence , 2006, NeuroImage.

[3]  Ying Liu,et al.  ERP evidence for the time course of graphic, phonological, and semantic information in Chinese meaning and pronunciation decisions. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[4]  H. Neville,et al.  Maturational Constraints on Functional Specializations for Language Processing: ERP and Behavioral Evidence in Bilingual Speakers , 1996, Journal of Cognitive Neuroscience.

[5]  J. Grainger,et al.  Crowding affects letters and symbols differently. , 2010, Journal of experimental psychology. Human perception and performance.

[6]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[7]  Marcus Taft,et al.  Positional Specificity of Radicals in Chinese Character Recognition , 1999 .

[8]  Daniel Brandeis,et al.  Coarse neural tuning for print peaks when children learn to read , 2006, NeuroImage.

[9]  D Friedman,et al.  Scaling is necessary when making comparisons between shapes of event-related potential topographies: a reply to Haig et al. , 1999, Psychophysiology.

[10]  James W. Tanaka,et al.  A Reevaluation of the Electrophysiological Correlates of Expert Object Processing , 2006, Journal of Cognitive Neuroscience.

[11]  C. C. Wood,et al.  Event-related potentials, lexical decision and semantic priming. , 1985, Electroencephalography and clinical neurophysiology.

[12]  M. Kutas,et al.  Event-related brain potentials to semantically inappropriate and surprisingly large words , 1980, Biological Psychology.

[13]  J. Tanaka,et al.  A Neural Basis for Expert Object Recognition , 2001, Psychological science.

[14]  Blake W. Johnson,et al.  Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts , 2002, Clinical Neurophysiology.

[15]  J. Kounios,et al.  Dual-coding, context-availability, and concreteness effects in sentence comprehension: an electrophysiological investigation. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[16]  C. Joyce,et al.  The face-sensitive N170 and VPP components manifest the same brain processes: The effect of reference electrode site , 2005, Clinical Neurophysiology.

[17]  J. Pernier,et al.  ERP Manifestations of Processing Printed Words at Different Psycholinguistic Levels: Time Course and Scalp Distribution , 1999, Journal of Cognitive Neuroscience.

[18]  M. Kutas,et al.  Neurophysiological evidence for visual perceptual categorization of words and faces within 150 ms. , 1998, Psychophysiology.

[19]  H. Neville,et al.  Language and , 2019, Adventure Diffusion.

[20]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[21]  E. Halgren,et al.  Cognitive response profile of the human fusiform face area as determined by MEG. , 2000, Cerebral cortex.

[22]  James W. Tanaka,et al.  Activation of Preexisting and Acquired Face Representations: The N250 Event-related Potential as an Index of Face Familiarity , 2006, Journal of Cognitive Neuroscience.

[23]  Stanislas Dehaene,et al.  Specialization within the ventral stream: the case for the visual word form area , 2004, NeuroImage.

[24]  T. Allison,et al.  Word recognition in the human inferior temporal lobe , 1994, Nature.

[25]  M. Rugg,et al.  Event-related potentials and the semantic matching of pictures , 1990, Brain and Cognition.

[26]  J. Theios,et al.  Theoretical analysis of the cognitive processing of lexical and pictorial stimuli: reading, naming, and visual and conceptual comparisons. , 1989, Psychological review.

[27]  K R Paap,et al.  Word shape's in poor shape for the race to the lexicon. , 1984, Journal of experimental psychology. Human perception and performance.

[28]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[29]  M. Potter,et al.  Time to understand pictures and words , 1975, Nature.

[30]  P. Holcomb,et al.  Event-Related Brain Potentials Reflect Semantic Priming in an Object Decision Task , 1994, Brain and Cognition.

[31]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[32]  P. Holcomb.  Semantic priming and stimulus degradation: implications for the role of the N400 in language processing. , 2007, Psychophysiology.

[33]  Marta Kutas,et al.  Neurophysiological Evidence for the Time Course of Activation of Global Shape, Part, and Local Contour Representations during Visual Object Categorization and Memory , 2007, Journal of Cognitive Neuroscience.

[34]  Jonathan Grainger,et al.  Cracking the orthographic code: An introduction , 2008 .

[35]  Kara D. Federmeier,et al.  Meaning and modality: influences of context, semantic memory organization, and perceptual predictability on picture processing. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[36]  N. Fujimaki,et al.  Masked immediate-repetition-priming effect on the early lexical process in the bilateral anterior temporal areas assessed by neuromagnetic responses , 2010, Neuroscience Research.

[37]  R. Salmelin,et al.  Dynamics of letter string perception in the human occipitotemporal cortex. , 1999, Brain : a journal of neurology.

[38]  Bruce D. McCandliss,et al.  Fast, visual specialization for reading in English revealed by the topography of the N170 ERP response , 2005, Behavioral and Brain Functions.

[39]  Marta Kutas,et al.  Time Course of Processes and Representations Supporting Visual Object Identification and Memory , 2003, Journal of Cognitive Neuroscience.

[40]  Jonathan Grainger,et al.  On the Time Course of Visual Word Recognition: An Event-related Potential Investigation using Masked Repetition Priming , 2006, Journal of Cognitive Neuroscience.

[41]  Marta Kutas,et al.  The intractability of scaling scalp distributions to infer neuroelectric sources. , 2002, Psychophysiology.

[42]  Hyun Wook Park,et al.  Spatiotemporal brain activation pattern during word/picture perception by native Koreans , 2004, Neuroreport.

[43]  J. Grainger,et al.  Exploring the temporal dynamics of visual word recognition in the masked repetition priming paradigm using event-related potentials , 2007, Brain Research.

[44]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[45]  Marianna D. Eddy,et al.  Masked repetition priming and event-related brain potentials: a new approach for tracking the time-course of object perception. , 2006, Psychophysiology.

[46]  M. Bar,et al.  Humans Prefer Curved Visual Objects , 2006, Psychological science.

[47]  Urs Maurer,et al.  Left-lateralized N170 Effects of Visual Expertise in Reading: Evidence from Japanese Syllabic and Logographic Scripts , 2008, Journal of Cognitive Neuroscience.

[48]  C. C. Wood,et al.  Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. , 1985, Electroencephalography and clinical neurophysiology.

[49]  P. Holcomb,et al.  An electrophysiological investigation of semantic priming with pictures of real objects. , 1999, Psychophysiology.

[50]  M. Sigman,et al.  The neural code for written words: a proposal , 2005, Trends in Cognitive Sciences.

[51]  Jonathan Grainger,et al.  Serial position effects in the identification of letters, digits, and symbols. , 2009, Journal of experimental psychology. Human perception and performance.

[52]  J. Tanaka,et al.  An electrophysiological comparison of visual categorization and recognition memory , 2002, Cognitive, affective & behavioral neuroscience.