Occipital and orbitofrontal hemodynamics during naturally paced reading: An fNIRS study

Humans typically read at incredibly fast rates, because they predict likely occurring words from a given context. Here, we used functional near-infrared spectroscopy (fNIRS) to track the ultra-rapid hemodynamic responses of words presented every 280 ms in a naturally paced sentence context. We found a lower occipital deoxygenation to unpredictable than to predictable words. The greater hemodynamic responses to unexpected words suggest that the visual features of expected words have been pre-activated previous to stimulus presentation. Second, we tested opposing theoretical proposals about the role of the medial orbitofrontal cortex (OFC): Either OFC may respond to the breach of expectation; or OFC is activated when the present stimulus matches the prediction. A significant interaction between word frequency and predictability indicated OFC responses to breaches of expectation for low- but not for high-frequency words: OFC is sensitive to both, bottom-up processing as mediated by word frequency, as well as top-down predictions. Particularly, when a rare word is unpredictable, OFC becomes active. Finally, we discuss how a high temporal resolution can help future studies to disentangle the hemodynamic responses of single trials in such an ultra-rapid event succession as naturally paced reading.

[1]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[2]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[3]  John R. Anderson A Spreading Activation Theory of Memory , 1988 .

[4]  M. Petrides The Orbitofrontal Cortex: Novelty, Deviation from Expectation, and Memory , 2007, Annals of the New York Academy of Sciences.

[5]  M. Bar,et al.  The units of thought , 2007, Hippocampus.

[6]  R. Buxton,et al.  Modeling the hemodynamic response to brain activation , 2004, NeuroImage.

[7]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[8]  A M Dale,et al.  Randomized event‐related experimental designs allow for extremely rapid presentation rates using functional MRI , 1998, Neuroreport.

[9]  D. Cochrane,et al.  Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms , 1949 .

[10]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[11]  J. Obleser,et al.  Expectancy constraints in degraded speech modulate the language comprehension network. , 2010, Cerebral cortex.

[12]  Jeffrey R. Binder,et al.  Where is the Semantic System ? , 2009 .

[13]  R. Buckner,et al.  Dissociation of human prefrontal cortical areas across different speech production tasks and gender groups. , 1995, Journal of neurophysiology.

[14]  Hellmuth Obrig,et al.  Stimulus-Induced and State-Dependent Sustained Gamma Activity Is Tightly Coupled to the Hemodynamic Response in Humans , 2009, The Journal of Neuroscience.

[15]  Markus J. Hofmann,et al.  Remembering Words in Context as Predicted by an Associative Read-Out Model , 2011, Front. Psychology.

[16]  A. Villringer,et al.  Illuminating the BOLD signal: combined fMRI-fNIRS studies. , 2006, Magnetic resonance imaging.

[17]  M. Raichle,et al.  Searching for a baseline: Functional imaging and the resting human brain , 2001, Nature Reviews Neuroscience.

[18]  Peter Boesiger,et al.  Sensitivity-encoded (SENSE) echo planar fMRI at 3T in the medial temporal lobe , 2005, NeuroImage.

[19]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.

[20]  E. Bullmore,et al.  Statistical methods of estimation and inference for functional MR image analysis , 1996, Magnetic resonance in medicine.

[21]  F. Pulvermüller,et al.  Effects of word length and frequency on the human event-related potential , 2004, Clinical Neurophysiology.

[22]  Jeffrey M. Zacks,et al.  Pictures of a thousand words: Investigating the neural mechanisms of reading with extremely rapid event-related fMRI , 2008, NeuroImage.

[23]  Andreas Keil,et al.  The Timing of Emotional Discrimination in Human Amygdala and Ventral Visual Cortex , 2009, The Journal of Neuroscience.

[24]  Alice Mado Proverbio,et al.  From Orthography to Phonetics: ERP Measures of Grapheme-to-Phoneme Conversion Mechanisms in Reading , 2004, Journal of Cognitive Neuroscience.

[25]  C. Fiebach,et al.  Neural Correlates of Syntactic Ambiguity in Sentence Comprehension for Low and High Span Readers , 2004, Journal of Cognitive Neuroscience.

[26]  Marco Zorzi,et al.  Nested incremental modeling in the development of computational theories: the CDP+ model of reading aloud. , 2007, Psychological review.

[27]  M. Bar,et al.  Top-down predictions in the cognitive brain , 2007, Brain and Cognition.

[28]  M F Huque,et al.  Some comments on frequently used multiple endpoint adjustment methods in clinical trials. , 1997, Statistics in medicine.

[29]  Markus J. Hofmann,et al.  Neural correlates of episodic memory: Associative memory and confidence drive hippocampus activations , 2013, Behavioural Brain Research.

[30]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[31]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[32]  Probing the brain with DNA chips , 1999, Nature Neuroscience.

[33]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[34]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[35]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[36]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[37]  Annette Kinder,et al.  Receiver operating characteristics in the lexical decision task: evidence for a simple signal-detection process simulated by the multiple read-out model. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[38]  A. Jacobs,et al.  Old Proverbs in New Skins – An fMRI Study on Defamiliarization , 2012, Front. Psychology.

[39]  Martin Kronbichler,et al.  A dual-route perspective on brain activation in response to visual words: Evidence for a length by lexicality interaction in the visual word form area (VWFA) , 2010, NeuroImage.

[40]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[41]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[42]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[43]  Masako Okamoto,et al.  Virtual spatial registration of stand-alone fNIRS data to MNI space , 2007, NeuroImage.

[44]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[45]  K. Sakai,et al.  Lateralized activation in the inferior frontal cortex during syntactic processing: Event‐related optical topography study , 2002, Human brain mapping.

[46]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[47]  H. Obrig,et al.  Shedding light on words and sentences: Near-infrared spectroscopy in language research , 2012, Brain and Language.

[48]  James L. McClelland Toward a theory of information processing in graded, random, and interactive networks , 1993 .

[49]  A. Ehlis,et al.  Simulation of Near-Infrared Light Absorption Considering Individual Head and Prefrontal Cortex Anatomy: Implications for Optical Neuroimaging , 2011, PloS one.

[50]  C. Price,et al.  The Interactive Account of ventral occipitotemporal contributions to reading , 2011, Trends in Cognitive Sciences.

[51]  C. D. Frith,et al.  The Role of the Dorsolateral Prefrontal Cortex: Evidence from the Effects of Contextual Constraint in a Sentence Completion Task , 2002, NeuroImage.

[52]  M. Kronbichler,et al.  Fixation-Related fMRI Analysis in the Domain of Reading Research: Using Self-Paced Eye Movements as Markers for Hemodynamic Brain Responses During Visual Letter String Processing , 2013, Cerebral cortex.

[53]  M. Mintun,et al.  Brain work and brain imaging. , 2006, Annual review of neuroscience.

[54]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[55]  Rico Fischer,et al.  Priming of visual cortex by temporal attention? The effects of temporal predictability on stimulus(-specific) processing in early visual cortical areas , 2013, NeuroImage.

[56]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[57]  Ann-Christine Ehlis,et al.  Model-based analysis of rapid event-related functional near-infrared spectroscopy (NIRS) data: A parametric validation study , 2007, NeuroImage.

[58]  E. Maguire,et al.  The functional neuroanatomy of comprehension and memory: the importance of prior knowledge. , 1999, Brain : a journal of neurology.

[59]  Markus J. Hofmann,et al.  The Role of Orbitofrontal Cortex in Processing Empathy Stories in 4- to 8-Year-Old Children , 2010, Front. Psychology.

[60]  M. Petrides,et al.  Differential activation of the human orbital, mid-ventrolateral, and mid-dorsolateral prefrontal cortex during the processing of visual stimuli , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[61]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[62]  Hellmuth Obrig,et al.  The oxygenation response to functional stimulation: Is there a physiological meaning to the lag between parameters? , 2007, NeuroImage.

[63]  H. Farmer A new perspective. , 1988, The Journal of the Florida Medical Association.

[64]  Anne Katz Rn,et al.  A New Perspective , 2003 .

[65]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[66]  A. Dale,et al.  Frontiers in Optical Imaging of Cerebral Blood Flow and Metabolism , 2012, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[67]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[68]  J. Wallis Orbitofrontal cortex and its contribution to decision-making. , 2007, Annual review of neuroscience.

[69]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[70]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[71]  G. Pourtois,et al.  Top-down effects on early visual processing in humans: A predictive coding framework , 2011, Neuroscience & Biobehavioral Reviews.

[72]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[73]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[74]  A. Villringer,et al.  Simultaneous EEG–fMRI , 2006, Neuroscience & Biobehavioral Reviews.

[75]  A. Jacobs,et al.  Frequency and predictability effects on event-related potentials during reading , 2006, Brain Research.

[76]  K. Rayner Eye movements in reading and information processing. , 1978, Psychological bulletin.

[77]  K. Kraus,et al.  The DWDS corpus: A reference corpus for the German language of the 20 century , 2006 .

[78]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[79]  Heidrun Wabnitz,et al.  The physiological origin of task-evoked systemic artefacts in functional near infrared spectroscopy , 2012, NeuroImage.

[80]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[81]  Hellmuth Obrig,et al.  Towards a standard analysis for functional near-infrared imaging , 2004, NeuroImage.

[82]  A. Jacobs,et al.  Event-Related Potentials Reveal Rapid Verification of Predicted Visual Input , 2009, PloS one.

[83]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[84]  Jonathan Grainger,et al.  Watching the Word Go by: On the Time-course of Component Processes in Visual Word Recognition , 2009, Lang. Linguistics Compass.

[85]  S. Dehaene,et al.  The unique role of the visual word form area in reading , 2011, Trends in Cognitive Sciences.

[86]  E. Rolls,et al.  The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology , 2004, Progress in Neurobiology.

[87]  Robert T. Knight,et al.  Orbito-frontal Cortex is Necessary for Temporal Context Memory , 2010, Journal of Cognitive Neuroscience.

[88]  Frans W Cornelissen,et al.  Fixation based event‐related fmri analysis: Using eye fixations as events in functional magnetic resonance imaging to reveal cortical processing during the free exploration of visual images , 2012, Human Brain Mapping.

[89]  D. Boas,et al.  Examining the phonological neighborhood density effect using near infrared spectroscopy , 2010, Human brain mapping.

[90]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[91]  M. Posner,et al.  Establishing a time‐line of word recognition: evidence from eye movements and event‐related potentials , 1998, Neuroreport.

[92]  A. Jacobs,et al.  Stimulus onset asynchrony and the timeline of word recognition: Event-related potentials during sentence reading , 2012, Neuropsychologia.

[93]  Aron K Barbey,et al.  Orbitofrontal contributions to human working memory. , 2011, Cerebral cortex.

[94]  B. Rosen,et al.  Evidence of a Cerebrovascular Postarteriole Windkessel with Delayed Compliance , 1999, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[95]  Ann-Christine Ehlis,et al.  Event-related functional near-infrared spectroscopy (fNIRS): Are the measurements reliable? , 2006, NeuroImage.

[96]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[97]  Keith Rayner Eye Movements in Reading , 2001 .

[98]  Hellmuth Obrig,et al.  Differential activation of frontal and parietal regions during visual word recognition: An optical topography study , 2008, NeuroImage.