Prediction Signatures in the Brain: Semantic Pre-Activation during Language Comprehension

There is broad agreement that context-based predictions facilitate lexical-semantic processing. A robust index of semantic prediction during language comprehension is an evoked response, known as the N400, whose amplitude is modulated as a function of semantic context. However, the underlying neural mechanisms that utilize relations of the prior context and the embedded word within it are largely unknown. We measured magnetoencephalography (MEG) data while participants were listening to simple German sentences in which the verbs were either highly predictive for the occurrence of a particular noun (i.e., provided context) or not. The identical set of nouns was presented in both conditions. Hence, differences for the evoked responses of the nouns can only be due to differences in the earlier context. We observed a reduction of the N400 response for highly predicted nouns. Interestingly, the opposite pattern was observed for the preceding verbs: highly predictive (that is more informative) verbs yielded stronger neural magnitude compared to less predictive verbs. A negative correlation between the N400 effect of the verb and that of the noun was found in a distributed brain network, indicating an integral relation between the predictive power of the verb and the processing of the subsequent noun. This network consisted of left hemispheric superior and middle temporal areas and a subcortical area; the parahippocampus. Enhanced activity for highly predictive relative to less predictive verbs, likely reflects establishing semantic features associated with the expected nouns, that is a pre-activation of the expected nouns.

[1]  Wilson L. Taylor,et al.  “Cloze Procedure”: A New Tool for Measuring Readability , 1953 .

[2]  Peter Elias,et al.  Predictive coding-I , 1955, IRE Trans. Inf. Theory.

[3]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[4]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[5]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[6]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[7]  E. Zurif,et al.  Sentence processing and the mental representation of verbs , 1987, Cognition.

[8]  M. Kutas,et al.  An Electrophysiological Probe of Incidental Semantic Association , 1989, Journal of Cognitive Neuroscience.

[9]  Joanne L. Miller,et al.  Speech Perception , 1990, Springer Handbook of Auditory Research.

[10]  L. Shapiro,et al.  Verb-Argument Structure Processing in Complex Sentences in Broca′s and Wernicke′s Aphasia , 1993, Brain and Language.

[11]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[12]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[14]  C Van Petten,et al.  Time course of word identification and semantic integration in spoken language. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Kara D. Federmeier,et al.  A Rose by Any Other Name: Long-Term Memory Structure and Sentence Processing , 1999 .

[16]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[17]  Irene P. Kan,et al.  Effects of Repetition and Competition on Activity in Left Prefrontal Cortex during Word Generation , 1999, Neuron.

[18]  E. Plante,et al.  Time course of word identification and semantic integration in spoken language. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[19]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[20]  A. Friederici,et al.  Verb Argument Structure Processing: The Role of Verb-Specific and Argument-Specific Information☆☆☆ , 2000 .

[21]  A. Friederici,et al.  Syntactic Gender and Semantic Expectancy: ERPs Reveal Early Autonomy and Late Interaction , 2000, Journal of Cognitive Neuroscience.

[22]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[23]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[24]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[25]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[26]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[27]  L. Pylkkänen,et al.  Neuromagnetic Evidence for the Timing of Lexical Activation: An MEG Component Sensitive to Phonotactic Probability but Not to Neighborhood Density , 2002, Brain and Language.

[28]  Bernardo A. Huberman,et al.  Predicting the Future , 2003, Inf. Syst. Frontiers.

[29]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[30]  L. Pylkkänen,et al.  Tracking the time course of word recognition with MEG , 2003, Trends in Cognitive Sciences.

[31]  Valerie A. Carr,et al.  Spatiotemporal Dynamics of Modality-Specific and Supramodal Word Processing , 2003, Neuron.

[32]  R. Diehl,et al.  Speech Perception , 2004, Annual review of psychology.

[33]  Gustavo Deco,et al.  Predictive Coding in the Visual Cortex by a Recurrent Network with Gabor Receptive Fields , 2001, Neural Processing Letters.

[34]  Friedemann Pulvermüller,et al.  Brain Signatures of Meaning Access in Action Word Recognition , 2005, Journal of Cognitive Neuroscience.

[35]  S. Taulu,et al.  Applications of the signal space separation method , 2005, IEEE Transactions on Signal Processing.

[36]  J. Fell,et al.  Language processing within the human medial temporal lobe , 2005, Hippocampus.

[37]  Katherine A. DeLong,et al.  Probabilistic word pre-activation during language comprehension inferred from electrical brain activity , 2005, Nature Neuroscience.

[38]  R. Salmelin,et al.  Time course of top-down and bottom-up influences on syllable processing in the auditory cortex. , 2006, Cerebral cortex.

[39]  Ping Li,et al.  Mental Representation of Verb Meaning: Behavioral and Electrophysiological Evidence , 2006, Journal of Cognitive Neuroscience.

[40]  A. Jacobs,et al.  Frequency and predictability effects on event-related potentials during reading , 2006, Brain Research.

[41]  A. Nakamura,et al.  Localizing the distributed language network responsible for the N400 measured by MEG during auditory sentence processing , 2006, Brain Research.

[42]  István Ulbert,et al.  Processing stages underlying word recognition in the anteroventral temporal lobe , 2006, NeuroImage.

[43]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[44]  R. Salmelin Clinical neurophysiology of language: The MEG approach , 2007, Clinical Neurophysiology.

[45]  P. Hagoort,et al.  The interaction of discourse context and world knowledge in online sentence comprehension. Evidence from the N400 , 2007, Brain Research.

[46]  Kara D. Federmeier,et al.  Multiple effects of sentential constraint on word processing , 2007, Brain Research.

[47]  Liina Pylkkänen,et al.  An MEG Study of Silent Meaning , 2007, Journal of Cognitive Neuroscience.

[48]  Todd B. Parrish,et al.  Neural Correlates of Verb Argument Structure Processing , 2007, Journal of Cognitive Neuroscience.

[49]  D. Poeppel,et al.  Speech perception at the interface of neurobiology and linguistics , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[51]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[52]  Kara D. Federmeier Thinking ahead: the role and roots of prediction in language comprehension. , 2007, Psychophysiology.

[53]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[54]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[55]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[56]  J. Tracy,et al.  CHAPTER 31 – Mesial Temporal Lobe Epilepsy: A Model for Understanding the Relationship Between Language and Memory , 2008 .

[57]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[58]  Frank Keller,et al.  Data from eye-tracking corpora as evidence for theories of syntactic processing complexity , 2008, Cognition.

[59]  G. Curio,et al.  The Human Thalamus Processes Syntactic and Semantic Language Violations , 2008, Neuron.

[60]  H. Whitaker,et al.  Handbook of the neuroscience of language , 2008 .

[61]  Moshe Bar,et al.  Predictions: a universal principle in the operation of the human brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[62]  Ellen F. Lau,et al.  A lexical basis for N400 context effects: Evidence from MEG , 2009, Brain and Language.

[63]  Karl J. Friston,et al.  Frontiers in Neuroinformatics , 2022 .

[64]  I. Winkler,et al.  I Heard That Coming: Event-Related Potential Evidence for Stimulus-Driven Prediction in the Auditory System , 2009, The Journal of Neuroscience.

[65]  J. Obleser,et al.  Expectancy constraints in degraded speech modulate the language comprehension network. , 2010, Cerebral cortex.

[66]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[67]  C. Price The anatomy of language: a review of 100 fMRI studies published in 2009 , 2010, Annals of the New York Academy of Sciences.

[68]  J. Tenenbaum,et al.  Predicting the future as Bayesian inference: people combine prior knowledge with observations when estimating duration and extent. , 2011, Journal of experimental psychology. General.

[69]  A. Friederici,et al.  Dynamic Causal Modeling of Subcortical Connectivity of Language , 2011, The Journal of Neuroscience.

[70]  A. Friederici The brain basis of language processing: from structure to function. , 2011, Physiological reviews.

[71]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[72]  Rajesh P. N. Rao,et al.  Predictive Coding , 2019, A Blueprint for the Hard Problem of Consciousness.

[73]  G. Pourtois,et al.  Top-down effects on early visual processing in humans: A predictive coding framework , 2011, Neuroscience & Biobehavioral Reviews.

[74]  Suzanne Dikker,et al.  Before the N400: Effects of lexical–semantic violations in visual cortex , 2011, Brain and Language.

[75]  Sonja A. Kotz,et al.  Multiple brain signatures of integration in the comprehension of degraded speech , 2011, NeuroImage.

[76]  Kara D. Federmeier,et al.  So that's what you meant! Event-related potentials reveal multiple aspects of context use during construction of message-level meaning , 2012, NeuroImage.

[77]  C. Van Petten,et al.  Prediction during language comprehension: benefits, costs, and ERP components. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[78]  G. Hickok The cortical organization of speech processing: feedback control and predictive coding the context of a dual-stream model. , 2012, Journal of communication disorders.

[79]  Ricarda I. Schubotz,et al.  Surprised at All the Entropy: Hippocampal, Caudate and Midbrain Contributions to Learning from Prediction Errors , 2012, PloS one.

[80]  Matthew H. Davis,et al.  Temporal Predictive Codes for Spoken Words in Auditory Cortex , 2012, Current Biology.

[81]  Matthew H. Davis,et al.  Predictive Top-Down Integration of Prior Knowledge during Speech Perception , 2012, The Journal of Neuroscience.

[82]  Sarah Brown-Schmidt,et al.  The hippocampus and the flexible use and processing of language , 2012, Front. Hum. Neurosci..

[83]  Marcel Bastiaansen,et al.  Integration or Predictability? A Further Specification of the Functional Role of Gamma Oscillations in Language Comprehension , 2012, Front. Psychology.

[84]  Ellen F. Lau,et al.  Dissociating N400 Effects of Prediction from Association in Single-word Contexts , 2013, Journal of Cognitive Neuroscience.

[85]  Ellen F. Lau,et al.  Automatic Semantic Facilitation in Anterior Temporal Cortex Revealed through Multimodal Neuroimaging , 2013, The Journal of Neuroscience.

[86]  Nathaniel J. Smith,et al.  The effect of word predictability on reading time is logarithmic , 2013, Cognition.

[87]  Sophie Dufour,et al.  Tracking the Time Course of Word-Frequency Effects in Auditory Word Recognition With Event-Related Potentials , 2013, Cogn. Sci..

[88]  Martin Luessi,et al.  MEG and EEG data analysis with MNE-Python , 2013, Front. Neuroinform..

[89]  Sonja A. Kotz,et al.  Narrowed Expectancies under Degraded Speech: Revisiting the N400 , 2013, Journal of Cognitive Neuroscience.

[90]  Anna S. Hasting,et al.  Generating predictions: Lesion evidence on the role of left inferior frontal cortex in rapid syntactic analysis , 2013, Cortex.

[91]  Suzanne Dikker,et al.  Predicting language: MEG evidence for lexical preactivation , 2013, Brain and Language.

[92]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[93]  M. Bastiaansen,et al.  A predictive coding framework for rapid neural dynamics during sentence-level language comprehension , 2015, Cortex.

[94]  Corinna E. Bonhage,et al.  Combined eye tracking and fMRI reveals neural basis of linguistic predictions during sentence comprehension , 2015, Cortex.

[95]  Robin A. A. Ince,et al.  Frontal Top-Down Signals Increase Coupling of Auditory Low-Frequency Oscillations to Continuous Speech in Human Listeners , 2015, Current Biology.

[96]  Alec Marantz,et al.  Lexical Preactivation in Basic Linguistic Phrases , 2015, Journal of Cognitive Neuroscience.

[97]  S. Thompson-Schill,et al.  Creating Concepts from Converging Features in Human Cortex. , 2015, Cerebral cortex.

[98]  Anne Christophe,et al.  Listeners Exploit Syntactic Structure On-Line to Restrict Their Lexical Search to a Subclass of Verbs , 2015, Front. Psychol..

[99]  Jan-Mathijs Schoffelen,et al.  A Predictive Coding Perspective on Beta Oscillations during Sentence-Level Language Comprehension , 2016, Front. Hum. Neurosci..

[100]  Ellen F. Lau,et al.  Spatiotemporal Signatures of Lexical-Semantic Prediction. , 2016, Cerebral cortex.

[101]  Craig S. Miller Predicting the future. , 2016, Oral surgery, oral medicine, oral pathology and oral radiology.