Hierarchical coding of characters in the ventral and dorsal visual streams of Chinese language processing

Functional and spatial hierarchical organization of increasingly language-like word forms has been proposed for alphabetic languages at the occipitotemporal cortex for visual word recognition. In the logographic Chinese language system, similar functional and spatial hierarchical presentations of brain responses to sublexical orthographic structure are beginning to be explored. In this study, we used whole-brain fMRI to show that a hierarchical coding of increasingly language-like character type is present in multiple Chinese language processing areas. Fluent Chinese readers were presented with Chinese synonyms/non-synonym pairs, identical/non-identical non-pronounceable pseudo-character pairs constructed with Chinese radicals, and identical/non-identical Korean character pairs. We observed the presence of a spatial gradient for increasing language-like character types in the ventral and dorsal visual streams of the cortex. At the left occipitotemporal cortex of the ventral visual stream, we observed a posterior-to-anterior gradient of character type selectivity with the anterior fusiform region being more selective for real Chinese characters and the posterior fusiform region being more selective for Korean characters. At the left and right intraparietal sulci of the dorsal visual stream, a medial-to-lateral gradient of character type selectivity was observed, with the lateral edge being more selective for real Chinese characters, the medial edge being more selective for pseudo-characters, and with less activation attributable to Korean characters. Spatial gradients of selecting character type were also identified in prefrontal cortex, dorsal striatum and lateral temporal cortex. The results suggest that the left occipitotemporal cortex and both left and right intraparietal sulci are tuned with a functional and spatial hierarchical sensitivity to the presence of semantic elements as well as different orthographic structures.

[1]  Y. T. Wu,et al.  A left-lateralized network for reading Chinese words: a 3 T fMRI study , 2001, Neuroreport.

[2]  S. Dehaene,et al.  Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. , 2002, Brain : a journal of neurology.

[3]  J. Binder,et al.  A Parametric Manipulation of Factors Affecting Task-induced Deactivation in Functional Neuroimaging , 2003, Journal of Cognitive Neuroscience.

[4]  Colin M. Brown,et al.  The Neural Circuitry Involved in the Reading of German Words and Pseudowords: A PET Study , 1999, Journal of Cognitive Neuroscience.

[5]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[6]  G Jobard,et al.  Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies , 2003, NeuroImage.

[7]  N. Geschwind Disconnexion syndromes in animals and man. II. , 1965, Brain : a journal of neurology.

[8]  S. Petersen,et al.  Activation of extrastriate and frontal cortical areas by visual words and word-like stimuli. , 1990, Science.

[9]  R. Frackowiak,et al.  Demonstrating the implicit processing of visually presented words and pseudowords. , 1996, Cerebral cortex.

[10]  M. Moscovitch,et al.  Top-down and bottom-up attention to memory: A hypothesis (AtoM) on the role of the posterior parietal cortex in memory retrieval , 2008, Neuropsychologia.

[11]  P. Matthews,et al.  Testing for Dual Brain Processing Routes in Reading: A Direct Contrast of Chinese Character and Pinyin Reading Using fMRI , 2002, Journal of Cognitive Neuroscience.

[12]  M. Chee,et al.  Relative Language Proficiency Modulates BOLD Signal Change when Bilinguals Perform Semantic Judgments , 2001, NeuroImage.

[13]  Patrice D. Tremoulet,et al.  Indexing and the object concept: developing `what' and `where' systems , 1998, Trends in Cognitive Sciences.

[14]  T. L. Davis,et al.  Language dominance determined by whole brain functional MRI in patients with brain lesions , 1999, Neurology.

[15]  Tzu-Chen Yeh,et al.  Frequency effects of Chinese character processing in the brain: an event-related fMRI study , 2003, NeuroImage.

[16]  P. Fox,et al.  Neuroanatomical correlates of phonological processing of Chinese characters and alphabetic words: A meta‐analysis , 2005, Human brain mapping.

[17]  Helen L Jamison,et al.  Morphology and the internal structure of words. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[18]  M. Sigman,et al.  The neural code for written words: a proposal , 2005, Trends in Cognitive Sciences.

[19]  Karl J. Friston,et al.  The Effects of Presentation Rate During Word and Pseudoword Reading: A Comparison of PET and fMRI , 2000, Journal of Cognitive Neuroscience.

[20]  P T Fox,et al.  An fMRI study with written Chinese , 2001, Neuroreport.

[21]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[22]  C. Pallier,et al.  Left insula activation: a marker for language attainment in bilinguals. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[23]  K J Friston,et al.  The predictive value of changes in effective connectivity for human learning. , 1999, Science.

[24]  E. T. Possing,et al.  Neural Correlates of Lexical Access during Visual Word Recognition , 2003, Journal of Cognitive Neuroscience.

[25]  N C Andreasen,et al.  Functional MRI statistical software packages: A comparative analysis , 1998, Human brain mapping.

[26]  P M Matthews,et al.  Towards understanding language organisation in the brain using fMRI , 2003, Human brain mapping.

[27]  S. Dehaene,et al.  The visual word form area: a prelexical representation of visual words in the fusiform gyrus , 2002, Neuroreport.

[28]  Talma Hendler,et al.  Center–periphery organization of human object areas , 2001, Nature Neuroscience.

[29]  A M Dale,et al.  Event-related functional MRI: past, present, and future. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[30]  J. A. Frost,et al.  Function of the left planum temporale in auditory and linguistic processing , 1996, NeuroImage.

[31]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[32]  S. Yeh,et al.  Role of structure and component in judgments of visual similarity of Chinese characters. , 2002, Journal of experimental psychology. Human perception and performance.

[33]  Sabine Kastner,et al.  Representation of Eye Movements and Stimulus Motion in Topographically Organized Areas of Human Posterior Parietal Cortex , 2008, The Journal of Neuroscience.

[34]  P T Fox,et al.  Brain activation in the processing of Chinese characters and words: A functional MRI study , 2000, Human brain mapping.

[35]  C. Price The anatomy of language: contributions from functional neuroimaging , 2000, Journal of anatomy.

[36]  Chun Siong Soon,et al.  Relative language proficiency modulates BOLD signal change when bilinguals perform semantic judgements , 2001, NeuroImage.

[37]  Barry Dainton,et al.  Stream of Consciousness , 2000, Tragedy of the Commons (Poetry).

[38]  B. Devaux,et al.  Functional MR Imaging in Assessment of Language Dominance in Epileptic Patients , 2003 .

[39]  M. Chee,et al.  Mandarin and English Single Word Processing Studied with Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[40]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[41]  S. Petersen,et al.  Effects of Lexicality, Frequency, and Spelling-to-Sound Consistency on the Functional Anatomy of Reading , 1999, Neuron.

[42]  Jeffrey R. Binder,et al.  Tuning of the human left fusiform gyrus to sublexical orthographic structure , 2006, NeuroImage.

[43]  Po-Lei Lee,et al.  Orthographic and phonological processing of Chinese characters: an fMRI study , 2004, NeuroImage.

[44]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[45]  B. Rosen,et al.  Auditory and visual word processing studied with fMRI , 1999, Human brain mapping.

[46]  Rene Vohn,et al.  The subcortical role of language processing. High level linguistic features such as ambiguity-resolution and the human brain; an fMRI study , 2008, NeuroImage.

[47]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[48]  Yoshikazu Ugawa,et al.  Parietal Dysgraphia: Characterization of Abnormal Writing Stroke Sequences, Character Formation and Character Recall , 2007, Behavioural neurology.

[49]  N. Geschwind Disconnexion syndromes in animals and man. I. , 1965, Brain : a journal of neurology.

[50]  P. Fox,et al.  The Neural System Underlying Chinese Logograph Reading , 2001, NeuroImage.

[51]  Brent R Logan,et al.  An evaluation of spatial thresholding techniques in fMRI analysis , 2008, Human brain mapping.

[52]  J. Dejerine,et al.  Contribution a l'etude anatomo-pathologique et clinique des differentes varietes de cecite verbale , 2000 .

[53]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[54]  M. Tagamets,et al.  A Parametric Approach to Orthographic Processing in the Brain: An fMRI Study , 2000, Journal of Cognitive Neuroscience.

[55]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[56]  Gui Xue,et al.  Language experience shapes fusiform activation when processing a logographic artificial language: An fMRI training study , 2006, NeuroImage.

[57]  Hsuan-Chih Chen,et al.  The Visual Word Form Area: Evidence from an fMRI study of implicit processing of Chinese characters , 2008, NeuroImage.

[59]  J. A. Frost,et al.  Determination of language dominance using functional MRI , 1996, Neurology.

[60]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[61]  D. Caplan,et al.  Processing of Visually Presented Sentences in Mandarin and English Studied with fMRI , 1999, Neuron.

[62]  N. Kanwisher,et al.  Visual word processing and experiential origins of functional selectivity in human extrastriate cortex , 2007, Proceedings of the National Academy of Sciences.

[63]  J. Pujol,et al.  Cerebral lateralization of language in normal left-handed people studied by functional MRI , 1999, Neurology.

[64]  Edmund T. Rolls,et al.  Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[65]  S. Petersen,et al.  Neuroimaging studies of word reading. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[66]  Jeffrey R. Binder,et al.  Interrupting the “stream of consciousness”: An fMRI investigation , 2006, NeuroImage.

[67]  M. Chee,et al.  Overlap and Dissociation of Semantic Processing of Chinese Characters, English Words, and Pictures: Evidence from fMRI , 2000, NeuroImage.

[68]  Shimon Ullman,et al.  Class Information Predicts Activation by Object Fragments in Human Object Areas , 2008, Journal of Cognitive Neuroscience.

[69]  Daniel S. Margulies,et al.  Mapping the functional connectivity of anterior cingulate cortex , 2007, NeuroImage.

[70]  A. Mechelli,et al.  Neuroimaging Studies of Word and Pseudoword Reading: Consistencies, Inconsistencies, and Limitations , 2003, Journal of Cognitive Neuroscience.

[71]  M. Milham,et al.  Competition for priority in processing increases prefrontal cortex's involvement in top-down control: an event-related fMRI study of the stroop task. , 2003, Brain research. Cognitive brain research.

[72]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[73]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[74]  Jim M. Monti,et al.  Neural Integration of Top-Down Spatial and Feature-Based Information in Visual Search , 2008, The Journal of Neuroscience.

[75]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[76]  Michael S. Beauchamp,et al.  A Parametric fMRI Study of Overt and Covert Shifts of Visuospatial Attention , 2001, NeuroImage.

[77]  J. Desmond,et al.  The neural basis of visual skill learning: an fMRI study of mirror reading. , 1998, Cerebral cortex.

[78]  J. Hirsch,et al.  fMRI Evidence for Cortical Modification during Learning of Mandarin Lexical Tone , 2003, Journal of Cognitive Neuroscience.

[79]  Russell A. Poldrack,et al.  The Neural Substrates of Visual Perceptual Learning of Words: Implications for the Visual Word Form Area Hypothesis , 2007, Journal of Cognitive Neuroscience.

[80]  J. A. Frost,et al.  Conceptual Processing during the Conscious Resting State: A Functional MRI Study , 1999, Journal of Cognitive Neuroscience.

[81]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.