A Temporal Bottleneck in the Language Comprehension Network

Humans can understand spoken or written sentences presented at extremely fast rates of ∼400 wpm, far exceeding the normal speech rate (∼150 wpm). How does the brain cope with speeded language? And what processing bottlenecks eventually make language incomprehensible above a certain presentation rate? We used time-resolved fMRI to probe the brain responses to spoken and written sentences presented at five compression rates, ranging from intelligible (60–100% of the natural duration) to challenging (40%) and unintelligible (20%). The results show that cortical areas differ sharply in their activation speed and amplitude. In modality-specific sensory areas, activation varies linearly with stimulus duration. However, a large modality-independent left-hemispheric language network, including the inferior frontal gyrus (pars orbitalis and triangularis) and the superior temporal sulcus, shows a remarkably time-invariant response, followed by a sudden collapse for unintelligible stimuli. Finally, linear and nonlinear responses, reflecting a greater effort as compression increases, are seen at various prefrontal and parietal sites. We show that these profiles fit with a simple model according to which the higher stages of language processing operate at a fixed speed and thus impose a temporal bottleneck on sentence comprehension. At presentation rates faster than this internal processing speed, incoming words must be buffered, and intelligibility vanishes when buffer storage and retrieval operations are saturated. Based on their temporal and amplitude profiles, buffer regions can be identified with the left inferior frontal/anterior insula, precentral cortex, and mesial frontal cortex.

[1]  Pierre Jolickur Concurrent Response-Selection Demands Modulate the Attentional Blink , 1999 .

[2]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[3]  Stefan Klöppel,et al.  Combining Functional and Anatomical Connectivity Reveals Brain Networks for Auditory Language Comprehension , 2022 .

[4]  Richard S. J. Frackowiak,et al.  Representation of the temporal envelope of sounds in the human brain. , 2000, Journal of neurophysiology.

[5]  Emmanuel Dupoux,et al.  Perceptual adjustment to highly compressed speech: effects of talker and rate changes. , 1997, Journal of experimental psychology. Human perception and performance.

[6]  Lorraine K Tyler,et al.  Fronto-temporal brain systems supporting spoken language comprehension , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  L Konieczny,et al.  Locality and Parsing Complexity , 2000, Journal of psycholinguistic research.

[8]  Marco Buiatti,et al.  Temporal Integration in Visual Word Recognition , 2010, Journal of Cognitive Neuroscience.

[9]  G Jobard,et al.  Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies , 2003, NeuroImage.

[10]  Jelena Mirkovic,et al.  Incrementality and Prediction in Human Sentence Processing , 2009, Cogn. Sci..

[11]  Ravi S. Menon,et al.  Mental chronometry using latency-resolved functional MRI. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Mariano Sigman,et al.  Parsing a sequence of brain activations at psychological times using fMRI , 2007, NeuroImage.

[13]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[14]  M. Just,et al.  Working memory constraints on the processing of syntactic ambiguity , 1992, Cognitive Psychology.

[15]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[16]  Peter Hagoort,et al.  Word-category violations in patients with Broca’s aphasia: An ERP study , 2005, Brain and Language.

[17]  David Caplan,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1998, NeuroImage.

[18]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.

[19]  J. Mehler,et al.  Understanding Compressed Sentences: The Role of Rhythm and Meaning a , 1993, Annals of the New York Academy of Sciences.

[20]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[21]  Guillaume P. Dehaene,et al.  Functional segregation of cortical language areas by sentence repetition , 2006, Human brain mapping.

[22]  Karl J. Friston,et al.  Characterizing Stimulus–Response Functions Using Nonlinear Regressors in Parametric fMRI Experiments , 1998, NeuroImage.

[23]  Colin M. Brown,et al.  Understanding ambiguous words in sentence contexts: electrophysiological evidence for delayed contextual selection in Broca’s aphasia , 1998, Neuropsychologia.

[24]  Steven Greenberg,et al.  On the Possible Role of Brain Rhythms in Speech Perception: Intelligibility of Time-Compressed Speech with Periodic and Aperiodic Insertions of Silence , 2009, Phonetica.

[25]  S. Dehaene,et al.  Brain Dynamics Underlying the Nonlinear Threshold for Access to Consciousness , 2007, PLoS biology.

[26]  Christopher K. Kovach,et al.  Temporal Envelope of Time-Compressed Speech Represented in the Human Auditory Cortex , 2009, The Journal of Neuroscience.

[27]  D F Stegeman,et al.  Electrophysiological manifestations of open- and closed-class words in patients with Broca's aphasia with agrammatic comprehension. An event-related brain potential study. , 1999, Brain : a journal of neurology.

[28]  J. Mehler,et al.  Adaptation to time-compressed speech: Phonological determinants , 2000, Perception & psychophysics.

[29]  Jonas Obleser,et al.  Disentangling syntax and intelligibility in auditory language comprehension , 2009, Human brain mapping.

[30]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[31]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[32]  R G Shulman,et al.  Functional magnetic resonance imaging assessment of the human brain auditory cortex response to increasing word presentation rates. , 1997, Journal of neurophysiology.

[33]  Murray Grossman,et al.  Dissociable patterns of brain activity during comprehension of rapid and syntactically complex speech: Evidence from fMRI , 2004, Brain and Language.

[34]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[35]  Gary S. Rubin,et al.  Reading without saccadic eye movements , 1992, Vision Research.

[36]  M E Reynolds,et al.  Presentation Rate in Comprehension of Natural and Synthesized Speech , 2001, Perceptual and motor skills.

[37]  Peter Hagoort,et al.  Lexical processing of vocabulary class in patients with Broca’s aphasia: an event-related brain potential study on agrammatic comprehension , 2002, Neuropsychologia.

[38]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[39]  Stanislas Dehaene,et al.  Distinct unimodal and multimodal regions for word processing in the left temporal cortex , 2004, NeuroImage.

[40]  Mariano Sigman,et al.  Frontiers in Computational Neuroscience Computational Neuroscience Neurophysiological Bases of Exponential Sensory Decay and Top-down Memory Retrieval: a Model , 2022 .

[41]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[42]  J. Woolley,et al.  Paradigms and processes in reading comprehension. , 1982, Journal of experimental psychology. General.

[43]  Stanislas Dehaene,et al.  Specialization within the ventral stream: the case for the visual word form area , 2004, NeuroImage.

[44]  B. Dosher,et al.  Fast decay of iconic memory in observers with mild cognitive impairments. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[45]  N. Kanwisher,et al.  Functional Magnetic Resonance Imaging Provides New Constraints on Theories of the Psychological Refractory Period , 2004, Psychological science.

[46]  G. D E H A E N E-L A M B E R T Z,et al.  How Does Early Brain Organization Promote Language Acquisition in Humans ? , 2008 .

[47]  P A Bandettini,et al.  Effects of stimulus rate on signal response during functional magnetic resonance imaging of auditory cortex. , 1994, Brain research. Cognitive brain research.

[48]  Angela D. Friederici,et al.  Temporal dynamics of perisylvian activation during language processing in children and adults , 2008, NeuroImage.

[49]  G. Waters,et al.  The capacity theory of sentence comprehension: critique of Just and Carpenter (1992) , 1996, Psychological review.

[50]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[51]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[52]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[53]  Joseph T. Devlin,et al.  On-line plasticity in spoken sentence comprehension: Adapting to time-compressed speech , 2010, NeuroImage.

[54]  J. Mehler,et al.  Perceptual adjustment to time-compressed speech: A cross-linguistic study , 1998, Memory & cognition.

[55]  Christopher L. Asplund,et al.  Isolation of a Central Bottleneck of Information Processing with Time-Resolved fMRI , 2006, Neuron.

[56]  Jonathan H. Venezia,et al.  Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. , 2010, Cerebral cortex.

[57]  M A Just,et al.  The capacity theory of comprehension: new frontiers of evidence and arguments. , 1996, Psychological review.

[58]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[59]  Matthew H. Davis,et al.  Dissociating speech perception and comprehension at reduced levels of awareness , 2007, Proceedings of the National Academy of Sciences.

[60]  M. Sigman,et al.  Brain Mechanisms of Serial and Parallel Processing during Dual-Task Performance , 2008, The Journal of Neuroscience.

[61]  A. Wingfield,et al.  Neural processing during older adults' comprehension of spoken sentences: age differences in resource allocation and connectivity. , 2010, Cerebral cortex.

[62]  Pieter R. Roelfsema,et al.  The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain , 2010, PLoS Comput. Biol..

[63]  R. Poldrack,et al.  Relations between the Neural Bases of Dynamic Auditory Processing and Phonological Processing: Evidence from fMRI , 2001, Journal of Cognitive Neuroscience.

[64]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[65]  R. Marois,et al.  Capacity limits of information processing in the brain , 2005, Trends in Cognitive Sciences.