Brain activation for reading and listening comprehension: An fMRI study of modality effects and individual differences in language comprehension.

The study compared the brain activation patterns associated with the comprehension of written and spoken Portuguese sentences. An fMRI study measured brain activity while participants read and listened to sentences about general world knowledge. Participants had to decide if the sentences were true or false. To mirror the transient nature of spoken sentences, visual input was presented in rapid serial visual presentation format. The results showed a common core of amodal left inferior frontal and middle temporal gyri activation, as well as modality specific brain activation associated with listening and reading comprehension. Reading comprehension was associated with more left-lateralized activation and with left inferior occipital cortex (including fusiform gyrus) activation. Listening comprehension was associated with extensive bilateral temporal cortex activation and more overall activation of the whole cortex. Results also showed individual differences in brain activation for reading comprehension. Readers with lower working memory capacity showed more activation of right-hemisphere areas (spillover of activation) and more activation in the prefrontal cortex, potentially associated with more demand placed on executive control processes. Readers with higher working memory capacity showed more activation in a frontal-posterior network of areas (left angular and precentral gyri, and right inferior frontal gyrus). The activation of this network may be associated with phonological rehearsal of linguistic information when reading text presented in rapid serial visual format. The study demonstrates the modality fingerprints for language comprehension and indicates how low- and high working memory capacity readers deal with reading text presented in serial format.

[1]  Kenneth I. Forster,et al.  Visual perception of rapidly presented word sequences of varying complexity , 1970 .

[2]  N. Geschwind Language and the brain. , 1972, Scientific American.

[3]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[4]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[5]  M. D’Esposito,et al.  The neural basis of the central executive system of working memory , 1995, Nature.

[6]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[7]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[8]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[9]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[10]  G. McCarthy,et al.  Human Brain Mapping 6:1–13(1998) � Functional MRI Studies of Auditory Comprehension , 2022 .

[11]  B MacWhinney,et al.  Quick, automatic, and general activation of orthographic and phonological representations in young readers. , 1999, Developmental psychology.

[12]  James R. Booth,et al.  The Association of Rapid Temporal Perception With Orthographic and Phonological Processing in Children and Adults With Reading Impairment , 2000 .

[13]  D. Perani,et al.  A cultural effect on brain function , 2000, Nature Neuroscience.

[14]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[15]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[16]  R. Cabeza,et al.  Handbook of functional neuroimaging of cognition , 2001 .

[17]  Cathy J. Price,et al.  Functional Neuroimaging of Language , 2001 .

[18]  F. Fazio,et al.  Dyslexia: Cultural Diversity and Biological Unity , 2001, Science.

[19]  M. Just,et al.  The neural bases of sentence comprehension: a fMRI examination of syntactic and lexical processing. , 2001, Cerebral cortex.

[20]  Erica B. Michael,et al.  fMRI investigation of sentence comprehension by eye and by ear: Modality fingerprints on cognitive processes , 2001, Human brain mapping.

[21]  R T Constable,et al.  Functional MRI of Language Processing: Dependence on Input Modality and Temporal Lobe Epilepsy , 2001, Epilepsia.

[22]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[23]  James R. Booth,et al.  Functional Anatomy of Intra- and Cross-Modal Lexical Tasks , 2002, NeuroImage.

[24]  S. Dehaene,et al.  Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. , 2002, Brain : a journal of neurology.

[25]  Joel R. Meyer,et al.  Modality independence of word comprehension , 2002, Human brain mapping.

[26]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[27]  Susanne M. Jaeggi,et al.  Does excessive memory load attenuate activation in the prefrontal cortex? Load-dependent processing in single and dual tasks: functional magnetic resonance imaging study , 2003, NeuroImage.

[28]  P. H. Seymour,et al.  Foundation literacy acquisition in European orthographies. , 2003, British journal of psychology.

[29]  G Jobard,et al.  Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies , 2003, NeuroImage.

[30]  M. Just,et al.  From the Selectedworks of Marcel Adam Just Brain Imaging of Tongue-twister Sentence Comprehension: Twisting the Tongue and the Brain Brain Imaging of Tongue-twister Sentence Comprehension: Twisting the Tongue and the Brain , 2022 .

[31]  Weijia Ni,et al.  Sentence complexity and input modality effects in sentence comprehension: an fMRI study , 2004, NeuroImage.

[32]  Fernando C. Capovilla,et al.  Processamento cognitivo em crianças com e sem dificuldades de leitura , 2004 .

[33]  Stanislas Dehaene,et al.  Specialization within the ventral stream: the case for the visual word form area , 2004, NeuroImage.

[34]  W. Schneider,et al.  Cross‐cultural effect on the brain revisited: Universal structures plus writing system variation , 2005, Human brain mapping.

[35]  P. Fox,et al.  Neuroanatomical correlates of phonological processing of Chinese characters and alphabetic words: A meta‐analysis , 2005, Human brain mapping.

[36]  Edward Herskovits,et al.  The roles of the “visual word form area” in reading , 2005, NeuroImage.

[37]  Russell A. Poldrack,et al.  Imaging phonology without print: Assessing the neural correlates of phonemic awareness using fMRI , 2005, NeuroImage.

[38]  Bernard Mazoyer,et al.  Word and non-word reading: What role for the Visual Word Form Area? , 2005, NeuroImage.

[39]  Paul M Matthews,et al.  The Role of the Posterior Fusiform Gyrus in Reading , 2006, Journal of Cognitive Neuroscience.

[40]  M. Just,et al.  Neuroimaging Contributions to the Understanding of Discourse Processes , 2006 .

[41]  Marcel Adam Just,et al.  Individual Differences in Sentence Comprehension: A Functional Magnetic Resonance Imaging Investigation of Syntactic and Lexical Processing Demands , 2007, Journal of Cognitive Neuroscience.

[42]  Bernard Mazoyer,et al.  Impact of modality and linguistic complexity during reading and listening tasks , 2007, NeuroImage.

[43]  Marcel Adam Just,et al.  Brain bases of individual differences in cognition , 2008 .

[44]  M. Just,et al.  Japanese and English sentence reading comprehension and writing systems: An fMRI study of first and second language effects on brain activation* , 2009, Bilingualism: Language and Cognition.

[45]  Michael J Cortese,et al.  Handbook of Psycholinguistics , 2011 .

[46]  Tim Radford,et al.  International Book of Dyslexia : A Cross-Language Comparison and Practice Guide , 2022 .