Pictures of a thousand words: Investigating the neural mechanisms of reading with extremely rapid event-related fMRI

Reading is one of the most important skills human beings can acquire, but has proven difficult to study naturalistically using functional magnetic resonance imaging (fMRI). We introduce a novel Event-Related Reading (ERR) fMRI approach that enables reliable estimation of the neural correlates of single-word processing during reading of rapidly presented narrative text (200-300 ms/word). Application to an fMRI experiment in which subjects read coherent narratives and made no overt responses revealed widespread effects of orthographic, phonological, contextual, and semantic variables on brain activation. Word-level variables predicted activity in classical language areas as well as the inferotemporal visual word form area, specifically supporting a role for the latter in mapping visual forms onto articulatory or acoustic representations. Additional analyses demonstrated that ERR results replicate across experiments and predict reading comprehension. The ERR approach represents a powerful and extremely flexible new approach for studying reading and language behavior with fMRI.

[1]  Michael P. Kaschak,et al.  Neuroimaging studies of language production and comprehension. , 2003, Annual review of psychology.

[2]  L. Tyler,et al.  Grammatical categories in the brain: the role of morphological structure. , 2007, Cerebral cortex.

[3]  W. F. Battig,et al.  Handbook of semantic word norms , 1978 .

[4]  A M Dale,et al.  Randomized event‐related experimental designs allow for extremely rapid presentation rates using functional MRI , 1998, Neuroreport.

[5]  Dan Klein,et al.  Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network , 2003, NAACL.

[6]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[7]  Gui Xue,et al.  Language experience shapes fusiform activation when processing a logographic artificial language: An fMRI training study , 2006, NeuroImage.

[8]  D. Schacter,et al.  Task-specific repetition priming in left inferior prefrontal cortex. , 2000, Cerebral cortex.

[9]  Jemett L. Desmond,et al.  Semantic encoding and retrieval in the left inferior prefrontal cortex: a functional MRI study of task difficulty and process specificity , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Evelyn C. Ferstl,et al.  The extended language network: A meta‐analysis of neuroimaging studies on text comprehension , 2008, Human brain mapping.

[12]  R. Barker,et al.  One boy's day : a specimen record of behavior , 1951 .

[13]  B. Weekes Differential Effects of Number of Letters on Word and Nonword Naming Latency , 1997 .

[14]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[15]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[16]  K. Pugh,et al.  The Neurobiological Basis of Skilled and Impaired Reading: Recent Findings and New Directions , 2004, The Cognitive Neuroscience of Reading.

[17]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[18]  Karen M. Jones,et al.  Phonological decoding involves left posterior fusiform gyrus , 2005, Human brain mapping.

[19]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[20]  Randy L. Buckner,et al.  Rapid self-paced event-related functional MRI , 2001, NeuroImage.

[21]  Martin Kronbichler,et al.  The visual word form area and the frequency with which words are encountered: evidence from a parametric fMRI study , 2004, NeuroImage.

[22]  Evelyn C. Ferstl,et al.  The role of coherence and cohesion in text comprehension: an event-related fMRI study. , 2001, Brain research. Cognitive brain research.

[23]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[24]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[25]  David A. Balota,et al.  Visual Word Recognition: The Journey from Features to Meaning (A Travel Update) , 2006 .

[26]  M. Just,et al.  The neural bases of sentence comprehension: a fMRI examination of syntactic and lexical processing. , 2001, Cerebral cortex.

[27]  S. Scott,et al.  Noun imageability and the temporal lobes , 2000, Neuropsychologia.

[28]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[29]  D. Balota,et al.  Moving beyond Coltheart’s N: A new measure of orthographic similarity , 2008, Psychonomic bulletin & review.

[30]  Steven Graham,et al.  Word frequency and subsequent memory effects studied using event-related fMRI , 2003, NeuroImage.

[31]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[32]  Michael J Cortese,et al.  Visual word recognition of single-syllable words. , 2004, Journal of experimental psychology. General.

[33]  Sharon L. Thompson-Schill,et al.  Neuroanatomically separable effects of imageability and grammatical class during single-word comprehension , 2006, Brain and Language.

[34]  Jeffrey M. Zacks,et al.  Neural substrates of narrative comprehension and memory , 2008, NeuroImage.

[35]  S. Petersen,et al.  Neuroimaging studies of word reading. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Guinevere F. Eden,et al.  Meta-Analysis of the Functional Neuroanatomy of Single-Word Reading: Method and Validation , 2002, NeuroImage.

[37]  Tömme Noesselt,et al.  Endoscopic eye tracking system for fMRI , 2007, Journal of Neuroscience Methods.

[38]  Jeffrey R. Binder,et al.  Modulation of the semantic system by word imageability , 2005, NeuroImage.

[39]  Greg B. Simpson,et al.  The influence of phonological neighborhood on visual word perception , 2004, Psychonomic bulletin & review.

[40]  K. Rayner,et al.  Measuring word recognition in reading: eye movements and event-related potentials , 2003, Trends in Cognitive Sciences.

[41]  Bernard Mazoyer,et al.  Word and non-word reading: What role for the Visual Word Form Area? , 2005, NeuroImage.

[42]  Reto Huber,et al.  Sleep deprivation in prion protein deficient mice and control mice: genotype dependent regional rebound , 2002, Neuroreport.

[43]  E. T. Possing,et al.  Neural Correlates of Lexical Access during Visual Word Recognition , 2003, Journal of Cognitive Neuroscience.

[44]  Max Coltheart,et al.  Access to the internal lexicon , 1977 .

[45]  M. Brysbaert,et al.  Reexamining the word length effect in visual word recognition: New evidence from the English Lexicon Project , 2006, Psychonomic bulletin & review.

[46]  S. Dehaene,et al.  Direct Intracranial, fMRI, and Lesion Evidence for the Causal Role of Left Inferotemporal Cortex in Reading , 2006, Neuron.

[47]  Bruce D. McCandliss,et al.  The visual word form area: expertise for reading in the fusiform gyrus , 2003, Trends in Cognitive Sciences.

[48]  Mark Yates,et al.  Phonological neighbors speed visual word processing: evidence from multiple tasks. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[49]  Tzu-Chen Yeh,et al.  Frequency effects of Chinese character processing in the brain: an event-related fMRI study , 2003, NeuroImage.

[50]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[51]  N Burgess,et al.  Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study , 2000, Neuropsychologia.

[52]  Soon Chun Siong,et al.  Comparison of block and event‐related fMRI designs in evaluating the word‐frequency effect , 2003, Human brain mapping.

[53]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[54]  R. Buckner,et al.  Cluster size thresholds for assessment of significant activation in fMRI , 2001, NeuroImage.

[55]  Alfonso Caramazza,et al.  Dissociating neural correlates for nouns and verbs , 2005, NeuroImage.

[56]  Jeffrey M. Zacks,et al.  Human Brain Activity Time-Locked to Narrative Event Boundaries , 2007, Psychological science.

[57]  C. Price The functional anatomy of word comprehension and production , 1998, Trends in Cognitive Sciences.

[58]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.

[59]  S. Dehaene,et al.  The visual word form area: a prelexical representation of visual words in the fusiform gyrus , 2002, Neuroreport.

[60]  M. W. Greenlee,et al.  MR-Eyetracker: a new method for eye movement recording in functional magnetic resonance imaging , 1999, Experimental Brain Research.

[61]  G Jobard,et al.  Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies , 2003, NeuroImage.

[62]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[63]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[64]  Mark Steedman,et al.  Example Selection for Bootstrapping Statistical Parsers , 2003, NAACL.

[65]  Todd B. Parrish,et al.  Real-Time Monitoring of Eye Movements Using Infrared Video-oculography during Functional Magnetic Resonance Imaging of the Frontal Eye Fields , 2000, NeuroImage.

[66]  R Todd Constable,et al.  The neurobiology of adaptive learning in reading: A contrast of different training conditions , 2004, Cognitive, affective & behavioral neuroscience.

[67]  Nikos K Logothetis,et al.  A novel functional magnetic resonance imaging compatible search-coil eye-tracking system. , 2007, Magnetic resonance imaging.

[68]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.