Localization of electrophysiological responses to semantic and syntactic anomalies in language comprehension with MEG

Syntactically and semantically anomalous words encountered during sentence comprehension are known to elicit dissociable electrophysiological responses, which are thought to reflect distinct aspects of language processing. However, the sources of these responses have not been well characterized. We used beamforming analysis of magnetoencephalography (MEG) data to map generators of electrophysiological responses to linguistic anomalies. Anomalous words occurred in the context of a sentence acceptability judgement task conducted in both visual and auditory modalities. Time-frequency analysis revealed that both kinds of violations elicited event-related synchronization (ERS) in the delta-theta frequency range (1-5 Hz), and desynchronization (ERD) in the alpha-beta range (8-30 Hz). In addition, these responses were differentially modulated by violation type and presentation modality. 1-5 Hz responses were consistently localized within medial prefrontal cortex and did not vary significantly across violation types, but were stronger for visual presentation. In contrast, 8-30 Hz ERD occurred in different regions for different violation types. For semantic violations the distribution was predominantly in the bilateral occipital cortex and left temporal and inferior frontal regions, and these effects did not differ for visual and auditory presentation. In contrast, syntactic responses were strongly affected by presentation modality. Under visual presentation, syntactic violations elicited bilateral 8-30 Hz ERD extending into dorsal parietal and frontal regions, whereas effects were much weaker and mostly statistically insignificant in the auditory modality. These results suggest that delta-theta ERS reflects generalized increases in working memory demands related to linguistic anomaly detection, while alpha-beta ERD reflects specific activation of cortical regions involved in distinct aspects of linguistic processing, such as semantic vs. phonological short-term memory. Beamforming analysis of time-domain average signals (ERFs) revealed an N400m effect for semantic anomalies in both modalities, localized to left superior temporal and posterior frontal regions, and a later P600-like effect for syntactic anomalies in both modalities, widespread over bilateral frontal, posterior temporal, and parietal regions. These results indicate that time-domain averaged responses and induced oscillatory responses have distinct properties, including localization and modality dependence, and likely reflect dissociable and complementary aspects of neural activity related to language comprehension and additional task-related processes.

[1]  H. Asada,et al.  Frontal midline theta rhythms reflect alternative activation of prefrontal cortex and anterior cingulate cortex in humans , 1999, Neuroscience Letters.

[2]  Lee Osterhout,et al.  Event-related brain potentials and human language , 1997, Trends in Cognitive Sciences.

[3]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[4]  Aya Meltzer-Asscher,et al.  Electrophysiological responses to argument structure violations in healthy adults and individuals with agrammatic aphasia , 2012, Neuropsychologia.

[5]  E. Gibson,et al.  The P600 as an index of syntactic integration difficulty , 2000 .

[6]  Jed A. Meltzer,et al.  Individual differences in EEG theta and alpha dynamics during working memory correlate with fMRI responses across subjects , 2007, Clinical Neurophysiology.

[7]  Lee Osterhout,et al.  On the Brain Response to Syntactic Anomalies: Manipulations of Word Position and Word Class Reveal Individual Differences , 1997, Brain and Language.

[8]  Daphne N. Yu,et al.  High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. , 1997, Cerebral cortex.

[9]  Matthias Schlesewsky,et al.  Fractionating language comprehension via frequency characteristics of the human EEG , 2004, Neuroreport.

[10]  A. Friederici,et al.  Localization of early syntactic processes in frontal and temporal cortical areas: A magnetoencephalographic study , 2000, Human brain mapping.

[11]  P. Hagoort,et al.  Event-related theta power increases in the human EEG during online sentence processing , 2002, Neuroscience Letters.

[12]  S. Hanslmayr,et al.  Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis , 2012, Front. Hum. Neurosci..

[13]  M. Kutas,et al.  Expect the Unexpected: Event-related Brain Response to Morphosyntactic Violations , 1998 .

[14]  J. Debruille,et al.  Semantics and N400: insights for schizophrenia. , 2004, Journal of psychiatry & neuroscience : JPN.

[15]  A D Friederici,et al.  The relative timing of syntactic and semantic processes in sentence comprehension , 2004, Neuroreport.

[16]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[17]  Matthias Schlesewsky,et al.  Detection of early cognitive processing by event-related phase synchronization analysis , 2005, Neuroreport.

[18]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[19]  Elizabeth W. Pang,et al.  Event-related beamforming: A robust method for presurgical functional mapping using MEG , 2007, Clinical Neurophysiology.

[20]  D. Cheyne,et al.  Spatiotemporal mapping of cortical activity accompanying voluntary movements using an event‐related beamforming approach , 2006, Human brain mapping.

[21]  T. Inouye,et al.  Medial prefrontal cortex generates frontal midline theta rhythm. , 1999, Neuroreport.

[22]  Matthias Schlesewsky,et al.  The P600 as an indicator of syntactic ambiguity , 2002, Cognition.

[23]  Peter Hagoort,et al.  Syntactic Processing Modulates the θ Rhythm of the Human EEG , 2002, NeuroImage.

[24]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[25]  Volkmar Glauche,et al.  Ventral and dorsal pathways for language , 2008, Proceedings of the National Academy of Sciences.

[26]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[27]  S. Thompson-Schill,et al.  Reduced short-term memory span in aphasia and susceptibility to interference: Contribution of material-specific maintenance deficits , 2010, Neuropsychologia.

[28]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[29]  B. Balas,et al.  Personal Familiarity Influences the Processing of Upright and Inverted Faces in Infants , 2009, Front. Hum. Neurosci..

[30]  R M Leahy,et al.  A sensor-weighted overlapping-sphere head model and exhaustive head model comparison for MEG. , 1999, Physics in medicine and biology.

[31]  Hans-Jochen Heinze,et al.  Dissociation of Brain Activity Related to Syntactic and Semantic Aspects of Language , 1993, Journal of Cognitive Neuroscience.

[32]  A. de Rugy,et al.  Different mechanisms contributing to savings and anterograde interference are impaired in Parkinson's disease , 2013, Front. Hum. Neurosci..

[33]  A. Friederici.  Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[34]  W. Singer.  Synchronization of cortical activity and its putative role in information processing and learning. , 1993, Annual review of physiology.

[35]  Allen R. Braun,et al.  An EEG–MEG Dissociation between Online Syntactic Comprehension and Post Hoc Reanalysis , 2011, Front. Hum. Neurosci..

[36]  Matthew J. Brookes,et al.  GLM-beamformer method demonstrates stationary field, alpha ERD and gamma ERS co-localisation with fMRI BOLD response in visual cortex , 2005, NeuroImage.

[37]  A. Friederici,et al.  Hierarchical functional connectivity between the core language system and the working memory system , 2013, Cortex.

[38]  Matthew F Glasser,et al.  DTI tractography of the human brain's language pathways. , 2008, Cerebral cortex.

[39]  W. Klimesch,et al.  The role of theta and alpha oscillations for language comprehension in the human electroencephalogram , 2001, Neuroscience Letters.

[40]  Michael T. Jurkiewicz,et al.  Post-movement beta rebound is generated in motor cortex: Evidence from neuromagnetic recordings , 2006, NeuroImage.

[41]  Randi C. Martin,et al.  Short-term retention of lexical-semantic representations: Implications for speech production , 2001, Memory.

[42]  A. Anwander,et al.  The brain differentiates human and non-human grammars: Functional localization and structural connectivity , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Peter Hagoort,et al.  Syntactic Unification Operations Are Reflected in Oscillatory Dynamics during On-line Sentence Comprehension , 2010, Journal of Cognitive Neuroscience.

[44]  Steve Majerus,et al.  Language repetition and short-term memory: an integrative framework , 2013, Front. Hum. Neurosci..

[45]  A. Dale,et al.  Distinct Patterns of Neural Modulation during the Processing of Conceptual and Syntactic Anomalies , 2003, Journal of Cognitive Neuroscience.

[46]  Emmanuel A Stamatakis,et al.  Functional organization of the neural language system: dorsal and ventral pathways are critical for syntax. , 2013, Cerebral cortex.

[47]  Stefan Klöppel,et al.  Combining Functional and Anatomical Connectivity Reveals Brain Networks for Auditory Language Comprehension , 2022 .

[48]  Matthew J. Brookes,et al.  Optimising experimental design for MEG beamformer imaging , 2008, NeuroImage.

[49]  A Mouraux,et al.  Across-trial averaging of event-related EEG responses and beyond. , 2008, Magnetic resonance imaging.

[50]  D. Davidson,et al.  An inverse relation between event-related and time–frequency violation responses in sentence processing , 2007, Brain Research.

[51]  Ton Dijkstra,et al.  Theta Responses Are Involved in LexicalSemantic Retrieval during Language Processing , 2005, Journal of Cognitive Neuroscience.

[52]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[53]  Heikki Lyytinen,et al.  Cortical Activation during Spoken-Word Segmentation in Nonreading-Impaired and Dyslexic Adults , 2002, The Journal of Neuroscience.

[54]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[55]  Peter Hagoort,et al.  Syntactic processing modulates the theta rhythm of the human EEG. , 2002, NeuroImage.

[56]  A. Friederici,et al.  First-Pass versus Second-Pass Parsing Processes in a Wernicke's and a Broca's Aphasic: Electrophysiological Evidence for a Double Dissociation , 1998, Brain and Language.

[57]  Kayoko Okada,et al.  Conduction aphasia, sensory-motor integration, and phonological short-term memory – An aggregate analysis of lesion and fMRI data , 2011, Brain and Language.

[58]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[59]  L. Osterhout,et al.  Event-Related Brain Potentials Elicited by Failure to Agree , 1995 .

[60]  Masataka Watanabe,et al.  Human Neuroscience Original Research Article Awareness of Central Luminance Edge Is Crucial for the Craik-o'brien-cornsweet Effect , 2022 .

[61]  Mark S. Cohen,et al.  Simultaneous EEG and fMRI of the alpha rhythm , 2002, Neuroreport.

[62]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[63]  Adrian L. Williams,et al.  Task-Related Changes in Cortical Synchronization Are Spatially Coincident with the Hemodynamic Response , 2002, NeuroImage.

[64]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[65]  Claude Alain,et al.  Oscillatory Responses to Semantic and Syntactic Violations , 2014, Journal of Cognitive Neuroscience.

[66]  J. Vrba,et al.  Signal processing in magnetoencephalography. , 2001, Methods.

[67]  Roel M. Willems,et al.  Early decreases in alpha and gamma band power distinguish linguistic from visual information during spoken sentence comprehension , 2008, Brain Research.

[68]  C. Davis.  N-Watch: A program for deriving neighborhood size and other psycholinguistic statistics , 2005, Behavior research methods.

[69]  Riitta Salmelin,et al.  Localization of Syntactic and Semantic Brain Responses using Magnetoencephalography , 2007, Journal of Cognitive Neuroscience.

[70]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[71]  Matthew A. Lambon Ralph,et al.  Arcuate fasciculus variability and repetition: The left sometimes can be right , 2012, Cortex.

[72]  S E Robinson,et al.  Localization of event-related activity by SAM(erf). , 2004, Neurology & clinical neurophysiology : NCN.

[73]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[74]  J. Nicol,et al.  On the Distinctiveness, Independence, and Time Course of the Brain Responses to Syntactic and Semantic Anomalies. , 1999 .

[75]  P. Hagoort,et al.  EEG theta and gamma responses to semantic violations in online sentence processing , 2006, Brain and Language.

[76]  Yoko Yamaguchi,et al.  A long-range cortical network emerging with theta oscillation in a mental task , 2004, Neuroreport.

[77]  Colin M. Brown,et al.  ERP effects of listening to speech compared to reading: the P600/SPS to syntactic violations in spoken sentences and rapid serial visual presentation , 2000, Neuropsychologia.

[78]  A. Friederici,et al.  Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. , 1993, Brain research. Cognitive brain research.

[79]  Derek K. Jones,et al.  Symmetries in human brain language pathways correlate with verbal recall , 2007, Proceedings of the National Academy of Sciences.

[80]  T. Picton,et al.  Correlates of eye blinking as determined by synthetic aperture magnetometry , 2006, Clinical Neurophysiology.

[81]  Georgios A. Keliris,et al.  Introduction to Research Topic – Binocular Rivalry: A Gateway to Studying Consciousness , 2012, Front. Hum. Neurosci..

[82]  Krish D. Singh,et al.  A new approach to neuroimaging with magnetoencephalography , 2005, Human brain mapping.

[83]  Sabine Weiss,et al.  Increased neuronal communication accompanying sentence comprehension. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[84]  Gina R. Kuperberg,et al.  Neural mechanisms of language comprehension: Challenges to syntax , 2007, Brain Research.

[85]  H. Buchner,et al.  Semantic Event-Related Potential Components Reflect Severity of Comprehension Deficits in Aphasia , 2010, Neurorehabilitation and neural repair.

[86]  Derek K. Jones,et al.  Perisylvian language networks of the human brain , 2005, Annals of neurology.

[87]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[88]  M. Kutas,et al.  Event-related brain potentials (ERPs) elicited during rapid serial visual presentation of congruous and incongruous sentences. , 1987, Electroencephalography and clinical neurophysiology. Supplement.

[89]  Markus Kiefer,et al.  Semantic and syntactic processes during sentence comprehension in patients with schizophrenia: evidence from event-related potentials , 2003, Schizophrenia Research.

[90]  Robinson Se,et al.  Localization of event-related activity by SAM(erf). , 2004 .

[91]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[92]  S. Makeig.  Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones. , 1993, Electroencephalography and clinical neurophysiology.

[93]  W. Klimesch,et al.  Event-related desynchronization in the alpha band and the processing of semantic information. , 1997, Brain research. Cognitive brain research.

[94]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[95]  Max Coltheart,et al.  Access to the internal lexicon , 1977 .

[96]  Claude Alain,et al.  Conflict resolution in sentence processing by bilinguals , 2010, Journal of Neurolinguistics.

[97]  June Sic Kim,et al.  Language lateralization using MEG beta frequency desynchronization during auditory oddball stimulation with one-syllable words , 2008, NeuroImage.

[98]  Robert Oostenveld,et al.  Trial-by-trial coupling between EEG and BOLD identifies networks related to alpha and theta EEG power increases during working memory maintenance , 2009, NeuroImage.

[99]  J A Yesavage,et al.  N400 evidence of abnormal responses to speech in Alzheimer's disease. , 1996, Electroencephalography and clinical neurophysiology.

[100]  J. Schoffelen,et al.  Beta oscillations relate to the N400m during language comprehension , 2012, Human brain mapping.

[101]  Carryl L. Baldwin,et al.  Cloze probability and completion norms for 498 sentences: Behavioral and neural validation using event-related potentials , 2010, Behavior research methods.

[102]  W. Klimesch,et al.  The functional significance of theta and upper alpha oscillations. , 2005, Experimental psychology.

[103]  J. Vrba.  Magnetoencephalography: the art of finding a needle in a haystack , 2002 .