Early Visual Word Processing Is Flexible: Evidence from Spatiotemporal Brain Dynamics

Visual word recognition is often described as automatic, but the functional locus of top–down effects is still a matter of debate. Do task demands modulate how information is retrieved, or only how it is used? We used EEG/MEG recordings to assess whether, when, and how task contexts modify early retrieval of specific psycholinguistic information in occipitotemporal cortex, an area likely to contribute to early stages of visual word processing. Using a parametric approach, we analyzed the spatiotemporal response patterns of occipitotemporal cortex for orthographic, lexical, and semantic variables in three psycholinguistic tasks: silent reading, lexical decision, and semantic decision. Task modulation of word frequency and imageability effects occurred simultaneously in ventral occipitotemporal regions—in the vicinity of the putative visual word form area—around 160 msec, following task effects on orthographic typicality around 100 msec. Frequency and typicality also produced task-independent effects in anterior temporal lobe regions after 200 msec. The early task modulation for several specific psycholinguistic variables indicates that occipitotemporal areas integrate perceptual input with prior knowledge in a task-dependent manner. Still, later task-independent effects in anterior temporal lobes suggest that word recognition eventually leads to retrieval of semantic information irrespective of task demands. We conclude that even a highly overlearned visual task like word recognition should be described as flexible rather than automatic.

[1]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[2]  Cathy J. Price,et al.  Top-down modulation of ventral occipito-temporal responses during visual word recognition , 2011, NeuroImage.

[3]  D. Balota,et al.  Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. , 1984, Journal of experimental psychology. Human perception and performance.

[4]  S. Dehaene Reading in the Brain: The New Science of How We Read , 2009 .

[5]  O. Hauk Only time will tell – why temporal information is essential for our neuroscientific understanding of semantics , 2016, Psychonomic Bulletin & Review.

[6]  F. Pulvermüller,et al.  Task modulation of brain responses in visual word recognition as studied using EEG/MEG and fMRI , 2013, Front. Hum. Neurosci..

[7]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[8]  J. Pernier,et al.  ERP Manifestations of Processing Printed Words at Different Psycholinguistic Levels: Time Course and Scalp Distribution , 1999, Journal of Cognitive Neuroscience.

[9]  Olaf Hauk,et al.  Comparison of noise-normalized minimum norm estimates for MEG analysis using multiple resolution metrics , 2011, NeuroImage.

[10]  Blair C. Armstrong,et al.  The what, when, where, and how of visual word recognition , 2014, Trends in Cognitive Sciences.

[11]  F. Pulvermüller,et al.  Effects of word length and frequency on the human event-related potential , 2004, Clinical Neurophysiology.

[12]  William W. Graves,et al.  Neural Systems for Reading Aloud: A Multiparametric Approach , 2009, Cerebral cortex.

[13]  Seppo P. Ahlfors,et al.  Assessing and improving the spatial accuracy in MEG source localization by depth-weighted minimum-norm estimates , 2006, NeuroImage.

[14]  Friedemann Pulvermüller,et al.  Understanding in an instant: Neurophysiological evidence for mechanistic language circuits in the brain , 2009, Brain and Language.

[15]  Olaf Hauk,et al.  Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data , 2004, NeuroImage.

[16]  S. Dehaene,et al.  The visual word form area: a prelexical representation of visual words in the fusiform gyrus , 2002, Neuroreport.

[17]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[18]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[19]  Friedemann Pulvermüller,et al.  Modulation of brain activity by multiple lexical and word form variables in visual word recognition: A parametric fMRI study , 2008, NeuroImage.

[20]  Dennis Norris,et al.  Putting it all together: a unified account of word recognition and reaction-time distributions. , 2009, Psychological review.

[21]  M. Erb,et al.  The Concreteness Effect: Evidence for Dual Coding and Context Availability , 2000, Brain and Language.

[22]  Matthew H. Davis,et al.  Can cognitive models explain brain activation during word and pseudoword reading? A meta-analysis of 36 neuroimaging studies. , 2013, Psychological bulletin.

[23]  A. Woollams,et al.  Imageability and ambiguity effects in speeded naming: convergence and divergence. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Alec Marantz,et al.  Functional characterisation of letter-specific responses in time, space and current polarity using magnetoencephalography , 2016, NeuroImage.

[25]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[26]  Michael J Cortese,et al.  Visual word recognition of single-syllable words. , 2004, Journal of experimental psychology. General.

[27]  D Norris,et al.  Merging information in speech recognition: Feedback is never necessary , 2000, Behavioral and Brain Sciences.

[28]  D. Norris Models of visual word recognition , 2013, Trends in Cognitive Sciences.

[29]  Dennis Norris,et al.  Perception as evidence accumulation and Bayesian inference: insights from masked priming. , 2008, Journal of experimental psychology. General.

[30]  William D. Marslen-Wilson,et al.  The time course of visual word recognition as revealed by linear regression analysis of ERP data , 2006, NeuroImage.

[31]  C. Koch Strategies and Models of Selective Attention , 2010 .

[32]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[33]  Martin Kronbichler,et al.  The visual word form area and the frequency with which words are encountered: evidence from a parametric fMRI study , 2004, NeuroImage.

[34]  Matthew H. Davis,et al.  Mix, a program for pseudorandomization , 2006, Behavior research methods.

[35]  Friedemann Pulvermüller,et al.  [Q:] When Would You Prefer a SOSSAGE to a SAUSAGE? [A:] At about 100 msec. ERP Correlates of Orthographic Typicality and Lexicality in Written Word Recognition , 2006, Journal of Cognitive Neuroscience.

[36]  Manuel Carreiras,et al.  Syllable congruency and word frequency effects on brain activation , 2009, Human brain mapping.

[37]  Laurie S. Glezer,et al.  Evidence for Highly Selective Neuronal Tuning to Whole Words in the “Visual Word Form Area” , 2009, Neuron.

[38]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[39]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[40]  Bart Machilsen,et al.  Predictive Coding and the Neural Response to Predictable Stimuli , 2010, The Journal of Neuroscience.

[41]  Dennis Norris,et al.  Reading through a noisy channel: why there's nothing special about the perception of orthography. , 2012, Psychological review.

[42]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[43]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[44]  Michael A. Ford,et al.  Can I have a quick word? Early electrophysiological manifestations of psycholinguistic processes revealed by event-related regression analysis of the EEG , 2009, Biological Psychology.

[45]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[46]  M. Kiefer,et al.  Attentional sensitization of unconscious cognition: task sets modulate subsequent masked semantic priming. , 2010, Journal of experimental psychology. General.

[47]  F. Pulvermüller,et al.  Early Parallel Activation of Semantics and Phonology in Picture Naming: Evidence from a Multiple Linear Regression MEG Study , 2014, Cerebral cortex.

[48]  F. Pulvermüller How neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics , 2013, Trends in Cognitive Sciences.

[49]  T. Poggio,et al.  Neural mechanisms of object recognition , 2002, Current Opinion in Neurobiology.

[50]  Nathaniel J. Smith,et al.  Regression-based estimation of ERP waveforms: I. The rERP framework. , 2015, Psychophysiology.

[51]  C. Price,et al.  The Interactive Account of ventral occipitotemporal contributions to reading , 2011, Trends in Cognitive Sciences.

[52]  Marta Kutas,et al.  Alive and Grasping: Stable and Rapid Semantic Access to an Object Category but Not Object Graspability , 2022 .

[53]  S. Taulu,et al.  Presentation of electromagnetic multichannel data: The signal space separation method , 2005 .

[54]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[55]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[56]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[57]  James H. Neely,et al.  Is semantic activation automatic? A critical re-evaluation. , 2001 .

[58]  K. Rayner Eye movements in reading: Models and data , 2003, Behavioral and Brain Sciences.

[59]  C. Fiebach,et al.  fMRI Evidence for Dual Routes to the Mental Lexicon in Visual Word Recognition , 2002, Journal of Cognitive Neuroscience.

[60]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[61]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[62]  Jonathan Grainger,et al.  Seeing the Same Words Differently: The Time Course of Automaticity and Top–Down Intention in Reading , 2015, Journal of Cognitive Neuroscience.

[63]  J B Poline,et al.  Letter Binding and Invariant Recognition of Masked Words , 2004, Psychological science.

[64]  Matthew H. Davis,et al.  Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging , 2008, The European journal of neuroscience.

[65]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[66]  David A. Balota,et al.  Attentional Control and Flexible Lexical Processing : Explorations of the Magic Moment of Word Recognition , 2007 .

[67]  J. W. Thomas Some Theoretical Considerations , 1995 .

[68]  M. Fuchs,et al.  Linear and nonlinear current density reconstructions. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[69]  Jeffrey R. Binder,et al.  Modulation of the semantic system by word imageability , 2005, NeuroImage.

[70]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[71]  Maarten Casteren,et al.  Match: A program to assist in matching the conditions of factorial experiments , 2007, Behavior research methods.

[72]  Jeffrey R. Binder,et al.  Tuning of the human left fusiform gyrus to sublexical orthographic structure , 2006, NeuroImage.

[73]  Friedemann Pulvermüller,et al.  Early influences of word length and frequency: a group study using MEG , 2003, Neuroreport.

[74]  Michael W. L. Chee,et al.  Frequency of Concrete Words Modulates Prefrontal Activation during Semantic Judgments , 2002, NeuroImage.

[75]  M. S. Hämäläinen,et al.  Quantification of the benefit from integrating MEG and EEG data in minimum ℓ2-norm estimation , 2008, NeuroImage.

[76]  Jonathan Grainger,et al.  Watching the Word Go by: On the Time-course of Component Processes in Visual Word Recognition , 2009, Lang. Linguistics Compass.

[77]  S. Dehaene,et al.  The unique role of the visual word form area in reading , 2011, Trends in Cognitive Sciences.

[78]  David A. Medler,et al.  Distinct Brain Systems for Processing Concrete and Abstract Concepts , 2005, Journal of Cognitive Neuroscience.

[79]  Cathy J. Price,et al.  Word or Word-like? Dissociating Orthographic Typicality from Lexicality in the Left Occipito-temporal Cortex , 2011, Journal of Cognitive Neuroscience.

[80]  D. Balota,et al.  A word’s meaning affects the decision in lexical decision , 1984, Memory & cognition.

[81]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[82]  C. Fiebach,et al.  Processing concrete words: fMRI evidence against a specific right-hemisphere involvement , 2004, Neuropsychologia.

[83]  Karl J. Friston,et al.  MEG and EEG data fusion: Simultaneous localisation of face-evoked responses , 2009, NeuroImage.

[84]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[85]  María Ruz,et al.  Attention Modulates Initial Stages of Visual Word Processing , 2008, Journal of Cognitive Neuroscience.

[86]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[87]  Y. Chen,et al.  The time-course of single-word reading: Evidence from fast behavioral and brain responses , 2012, NeuroImage.

[88]  L. Vaina,et al.  Mapping the signal‐to‐noise‐ratios of cortical sources in magnetoencephalography and electroencephalography , 2009, Human brain mapping.

[89]  S. Scott,et al.  Noun imageability and the temporal lobes , 2000, Neuropsychologia.

[90]  Dennis Norris,et al.  The Bayesian reader: explaining word recognition as an optimal Bayesian decision process. , 2006, Psychological review.

[91]  J. Grainger,et al.  Early Goal-Directed Top-Down Influences in the Production of Speech , 2011, Front. Psychology.

[92]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[93]  Dwight J. Kravitz,et al.  Task context impacts visual object processing differentially across the cortex , 2014, Proceedings of the National Academy of Sciences.

[94]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.