A Large N400 but No BOLD Effect – Comparing Source Activations of Semantic Priming in Simultaneous EEG-fMRI

Numerous studies have reported neurophysiological effects of semantic priming in electroencephalography (EEG) and in functional magnetic resonance imaging (fMRI). Because of differing methodological constraints, the comparability of the observed effects remains unclear. To directly compare EEG and fMRI effects and neural sources of semantic priming, we conducted a semantic word-picture priming experiment while measuring EEG and fMRI simultaneously. The visually presented primes were pseudowords, words unrelated to the target, semantically related words and the identical names of the target. Distributed source analysis of the event-related potentials (ERPs) successfully revealed a large effect of semantic prime-target relatedness (the N400 effect), which was driven by activations in a left-temporal source region. However, no significantly differing activations between priming conditions were found in the fMRI data. Our results support the notion that, for joint interpretations of existing EEG and fMRI studies of semantic priming, we need to fully appreciate the respective methodological limitations. Second, they show that simultaneous EEG-fMRI, including ERP source localization, is a feasible and promising methodological advancement for the investigation of higher-cognitive processes. Third, they substantiate the finding that, compared to fMRI, ERPs are often more sensitive to subtle cognitive effects.

[1]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[2]  H. Renvall,et al.  Functional Magnetic Resonance Imaging Blood Oxygenation Level-Dependent Signal and Magnetoencephalography Evoked Responses Yield Different Neural Functionality in Reading , 2011, The Journal of Neuroscience.

[3]  Caterina Breitenstein,et al.  Development and validation of a language learning model for behavioral and functional-imaging studies , 2002, Journal of Neuroscience Methods.

[4]  Sonja A. Kotz,et al.  Modulation of the Lexical–Semantic Network by Auditory Semantic Priming: An Event-Related Functional MRI Study , 2002, NeuroImage.

[5]  Anders M. Dale,et al.  N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences , 2002, NeuroImage.

[6]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[7]  C. Dobel,et al.  Processing of existing, synonymous, and anomalous German derived adjectives: An MEG study , 2010, Neuroscience Letters.

[8]  J. H. Neely Semantic priming effects in visual word recognition: A selective review of current findings and theories. , 1991 .

[9]  M. Pratarelli,et al.  Semantic Processing of Pictures and Spoken Words: Evidence from Event-Related Brain Potentials , 1994, Brain and Cognition.

[10]  Ferath Kherif,et al.  Automatic Top-Down Processing Explains Common Left Occipito-Temporal Responses to Visual Words and Objects , 2010, Cerebral cortex.

[11]  Till R. Schneider,et al.  Using ICA for the Analysis of Multi-Channel EEG Data , 2010 .

[12]  Wilma Koutstaal,et al.  Neural mechanisms of visual object priming: evidence for perceptual and semantic distinctions in fusiform cortex , 2003, NeuroImage.

[13]  T. McNamara Semantic Priming: Perspectives from Memory and Word Recognition , 2005 .

[14]  Blake W. Johnson,et al.  Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts , 2002, Clinical Neurophysiology.

[15]  Tom M. Mitchell,et al.  From the SelectedWorks of Marcel Adam Just 2011 Commonality of neural representations of words and pictures , 2016 .

[16]  A. Villringer,et al.  Simultaneous EEG–fMRI , 2006, Neuroscience & Biobehavioral Reviews.

[17]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[18]  F. Rösler,et al.  Individual cortical current density reconstructions of the semantic N400 effect: Using a generalized minimum norm model with different constraints (L1 and L2 norm) , 2000, Human brain mapping.

[19]  Asaid Khateb,et al.  On the Origin of the N400 Effects: An ERP Waveform and Source Localization Analysis in Three Matching Tasks , 2010, Brain Topography.

[20]  Louis Renoult,et al.  N400-like Potentials and Reaction Times Index Semantic Relations between Highly Repeated Individual Words , 2011, Journal of Cognitive Neuroscience.

[21]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  Colin M. Brown,et al.  Lexical-semantic event-related potential effects in patients with left hemisphere lesions and aphasia, and patients with right hemisphere lesions without aphasia. , 1996, Brain : a journal of neurology.

[23]  Charles D. Smith,et al.  Dissociation of Automatic and Strategic Lexical-Semantics: Functional Magnetic Resonance Imaging Evidence for Differing Roles of Multiple Frontotemporal Regions , 2006, The Journal of Neuroscience.

[24]  A. Nakamura,et al.  Localizing the distributed language network responsible for the N400 measured by MEG during auditory sentence processing , 2006, Brain Research.

[25]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[26]  A. Nobre,et al.  The anatomy and time course of semantic priming investigated by fMRI and ERPs , 2003, Neuropsychologia.

[27]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: I. Intracranial distribution and neural generators , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[29]  M. Kubicki,et al.  Connectivity among semantic associates: An fMRI study of semantic priming , 2006, Brain and Language.

[30]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[31]  Katie L. McMahon,et al.  Brain activity during automatic semantic priming revealed by event-related functional magnetic resonance imaging , 2003, NeuroImage.

[32]  F. Pulvermüller,et al.  Task modulation of brain responses in visual word recognition as studied using EEG/MEG and fMRI , 2013, Front. Hum. Neurosci..

[33]  Atsushi Matsumoto,et al.  Linking semantic priming effect in functional MRI and event-related potentials , 2005, NeuroImage.

[34]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[35]  Olaf Hauk,et al.  Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data , 2004, NeuroImage.

[36]  Barry Giesbrecht,et al.  Separable effects of semantic priming and imageability on word processing in human cortex. , 2004, Cerebral cortex.

[37]  Markus Junghöfer,et al.  ElectroMagnetoEncephalography Software: Overview and Integration with Other EEG/MEG Toolboxes , 2011, Comput. Intell. Neurosci..

[38]  C. Dobel,et al.  Effects of language comprehension on visual processing – MEG dissociates early perceptual and late N400 effects , 2011, Brain and Language.

[39]  A. Engel,et al.  Single-trial EEG–fMRI reveals the dynamics of cognitive function , 2006, Trends in Cognitive Sciences.

[40]  M. Rugg,et al.  Event-related potentials and the semantic matching of pictures , 1990, Brain and Cognition.

[41]  Pienie Zwitserlood,et al.  Five days versus a lifetime: intense associative vocabulary training generates lexically integrated words. , 2007, Restorative neurology and neuroscience.

[42]  R. Henson,et al.  Neural response suppression, haemodynamic repetition effects, and behavioural priming , 2003, Neuropsychologia.

[43]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[44]  P. Holcomb,et al.  Event-Related Brain Potentials Reflect Semantic Priming in an Object Decision Task , 1994, Brain and Cognition.

[45]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[46]  Katie L. McMahon,et al.  Auditory context effects in picture naming investigated with event-related fMRI , 2009, Cognitive, affective & behavioral neuroscience.

[47]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[48]  G I de Zubicaray,et al.  The semantic interference effect in the picture‐word paradigm: An event‐related fMRI study employing overt responses , 2001, Human brain mapping.

[49]  René J. Huster,et al.  Methods for Simultaneous EEG-fMRI: An Introductory Review , 2012, The Journal of Neuroscience.

[50]  Stefan Knecht,et al.  New Names for Known Things: On the Association of Novel Word Forms with Existing Semantic Information , 2010, Journal of Cognitive Neuroscience.

[51]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[52]  Louis Lemieux,et al.  Identification of EEG Events in the MR Scanner: The Problem of Pulse Artifact and a Method for Its Subtraction , 1998, NeuroImage.

[53]  C. Petten,et al.  Neural localization of semantic context effects in electromagnetic and hemodynamic studies , 2006, Brain and Language.

[54]  M. Rugg The effects of semantic priming and work repetition on event-related potentials. , 1985, Psychophysiology.

[55]  J. Fell,et al.  Phase/amplitude reset and theta–gamma interaction in the human medial temporal lobe during a continuous word recognition memory task , 2005, Hippocampus.

[56]  Pienie Zwitserlood,et al.  Non-native phonemes in adult word learning: evidence from the N400m , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  R. Schvaneveldt,et al.  Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. , 1971, Journal of experimental psychology.

[58]  E. Halgren,et al.  Spatiotemporal mapping of brain activity by integration of multiple imaging modalities , 2001, Current Opinion in Neurobiology.