EEG–fMRI Information Fusion: Biophysics and Data Analysis

Cerebral activity has many attributes: bioelectrical, metabolic, haemodynamic, hormonal, endogenous, exogenous, specialised, integrated, pathological, stable, dynamic, to mention but a few. The diverse nature of biological processes has been recognised for centuries. It seems obvious that moving from unimodal recordings to multimodal measurements will allow neuroscientists to better understand the nature and structure of cerebral activity. This means that fusing electrophysiological data and BOLD-related measurements represents an important methodological challenge. The realisation of any cognitive, motor or sensory process rests on cerebral dynamics and creates order in the bioelectric and haemodynamic signals measured with EEG and fMRI, respectively. To detect and interpret the relevant features of these signals, one typically describes processes at their own temporal and spatial scales. The main sources of scalp EEG signals are postsynaptic cortical currents associated with large pyramidal neurons, which are oriented perpendicular to the cortical surface (Nunez 1981). However, the scalp topology of measured electrical potentials does not, without additional (prior) information, uniquely specify the location of underlying bioelectric activity. This issue is referred to as the ill-posed nature of the EEG/MEG inverse problem. Conversely, even though fMRI discloses complementary features of neuronal activity (Nunez and Silberstein 2000; Mukamel et al. 2005), it is only an indirect measure, through metabolism, oxygenation and blood flow, where these slow mechanisms provide temporally smoothed correlates of neuronal activity.

[1]  A. Aubert,et al.  Interaction between Astrocytes and Neurons Studied using a Mathematical Model of Compartmentalized Energy Metabolism , 2005, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[2]  Olivier D. Faugeras,et al.  EEG-fMRI fusion of non-triggered data using Kalman filtering , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[3]  Norihiro Sadato,et al.  Visual detection of motion speed in humans: spatiotemporal analysis by fMRI and MEG , 2002, Human brain mapping.

[4]  A M Dale,et al.  Event-related functional MRI: past, present, and future. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[5]  O. Arthurs,et al.  What aspect of the fMRI BOLD signal best reflects the underlying electrophysiology in human somatosensory cortex? , 2003, Clinical Neurophysiology.

[6]  Karl J. Friston,et al.  Nonlinear Responses in fMRI: The Balloon Model, Volterra Kernels, and Other Hemodynamics , 2000, NeuroImage.

[7]  Randy L. Buckner,et al.  Unrest at rest: Default activity and spontaneous network correlations , 2007, NeuroImage.

[8]  C. Iadecola Neurovascular regulation in the normal brain and in Alzheimer's disease , 2004, Nature Reviews Neuroscience.

[9]  Mark Hallett,et al.  Multimodality brain imaging , 2002 .

[10]  David Poeppel,et al.  How can EEG/MEG and fMRI/PET data be combined? , 2002, Human brain mapping.

[11]  Karl J. Friston,et al.  Variational Bayesian inversion of the equivalent current dipole model in EEG/MEG , 2008, NeuroImage.

[12]  J. Gotman,et al.  fMRI Activation in Continuous and Spike‐triggered EEG–fMRI Studies of Epileptic Spikes , 2003, Epilepsia.

[13]  Iwao Kanno,et al.  Stimulus frequency dependence of the linear relationship between local cerebral blood flow and field potential evoked by activation of rat somatosensory cortex , 2004, Neuroscience Research.

[14]  Karl J. Friston,et al.  Functional magnetic resonance imaging of human absence seizures , 2003, Annals of neurology.

[15]  Jean Gotman,et al.  Concordance between distributed EEG source localization and simultaneous EEG-fMRI studies of epileptic spikes , 2008, NeuroImage.

[16]  S Warach,et al.  Monitoring the patient's EEG during echo planar MRI. , 1993, Electroencephalography and clinical neurophysiology.

[17]  Karl J. Friston,et al.  Dynamic causal modelling of evoked responses: The role of intrinsic connections , 2007, NeuroImage.

[18]  C. Mathiesen,et al.  Modification of activity‐dependent increases of cerebral blood flow by excitatory synaptic activity and spikes in rat cerebellar cortex , 1998, The Journal of physiology.

[19]  A. Kleinschmidt,et al.  Electroencephalographic signatures of attentional and cognitive default modes in spontaneous brain activity fluctuations at rest , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[20]  W. van Drongelen,et al.  EEG Source Imaging: Correlating Source Locations and Extents With Electrocorticography and Surgical Resections in Epilepsy Patients , 2007, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[21]  Louis Lemieux,et al.  Comparison of Spike-Triggered Functional MRI BOLD Activation and EEG Dipole Model Localization , 2001, NeuroImage.

[22]  Hamid Soltanian-Zadeh,et al.  Integrated MEG/EEG and fMRI model based on neural masses , 2006, IEEE Transactions on Biomedical Engineering.

[23]  Karl J. Friston,et al.  MEG source localization under multiple constraints: An extended Bayesian framework , 2006, NeuroImage.

[24]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[25]  J R Ives,et al.  EEG-triggered echo-planar functional MRI in epilepsy , 1996, Neurology.

[26]  G. Glover,et al.  Physiological noise in oxygenation‐sensitive magnetic resonance imaging , 2001, Magnetic resonance in medicine.

[27]  R G Shulman,et al.  Cerebral energetics and the glycogen shunt: Neurochemical basis of functional imaging , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Seppo P. Ahlfors,et al.  Geometrical interpretation of fMRI-guided MEG/EEG inverse estimates , 2004, NeuroImage.

[29]  J. C. Jimenez,et al.  Nonlinear local electrovascular coupling. I: A theoretical model , 2006, Human brain mapping.

[30]  Kristina M. Ropella,et al.  Ballistocardiogram artifact reduction in the simultaneous acquisition of auditory ERPS and fMRI , 2004, NeuroImage.

[31]  Andrzej Cichocki,et al.  Removal of ballistocardiogram artifacts from simultaneously recorded EEG and fMRI data using independent component analysis , 2006, IEEE Transactions on Biomedical Engineering.

[32]  Helmut Laufs,et al.  Where the BOLD signal goes when alpha EEG leaves , 2006, NeuroImage.

[33]  Fumikazu Miwakeichi,et al.  Concurrent EEG/fMRI analysis by multiway Partial Least Squares , 2004, NeuroImage.

[34]  Peter Stoeter,et al.  EEG‐related Functional MRI in Benign Childhood Epilepsy with Centrotemporal Spikes , 2003, Epilepsia.

[35]  F. Hyder,et al.  Inhibition of Voltage-Dependent Sodium Channels Suppresses the Functional Magnetic Resonance Imaging Response to Forepaw Somatosensory Activation in the Rodent , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[36]  O. Josephs,et al.  EEG recording during fMRI experiments: Image quality , 2000, Human brain mapping.

[37]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[38]  Febo Cincotti,et al.  Multimodal integration of high-resolution EEG and functional magnetic resonance imaging data: a simulation study , 2003, NeuroImage.

[39]  A K Liu,et al.  Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography data: Monte Carlo simulations. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Peter Redgrave,et al.  Nonlinear coupling of neural activity and CBF in rodent barrel cortex , 2004, NeuroImage.

[41]  P. Magistretti,et al.  Glutamate uptake into astrocytes stimulates aerobic glycolysis: a mechanism coupling neuronal activity to glucose utilization. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[42]  E. Halgren,et al.  Spatiotemporal mapping of brain activity by integration of multiple imaging modalities , 2001, Current Opinion in Neurobiology.

[43]  G. Mangun,et al.  ERP and fMRI measures of visual spatial selective attention , 1998, Human brain mapping.

[44]  Jean Gotman,et al.  The BOLD Response to Interictal Epileptiform Discharges , 2002, NeuroImage.

[45]  Jorge J. Riera,et al.  Nonlinear Local Electro-Vascular Coupling. Part I: A Theoretical Model , 2006 .

[46]  R. Shulman,et al.  Glutamatergic Neurotransmission and Neuronal Glucose Oxidation are Coupled during Intense Neuronal Activation , 2004, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[47]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[48]  P. Nunez,et al.  Electric fields of the brain , 1981 .

[49]  G. Curio,et al.  Dipole source localization and fMRI of simultaneously recorded data applied to somatosensory categorization , 2003, NeuroImage.

[50]  T. Allison,et al.  Comparison of cortical activation evoked by faces measured by intracranial field potentials and functional MRI: Two case studies , 1997, Human brain mapping.

[51]  Karl J. Friston,et al.  Modelling cardiac signal as a confound in EEG-fMRI and its application in focal epilepsy studies , 2006, NeuroImage.

[52]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[53]  Bruno Rossion,et al.  Parametric design and correlational analyses help integrating fMRI and electrophysiological data during face processing , 2004, NeuroImage.

[54]  R. Shulman,et al.  The contribution of GABA to glutamate/glutamine cycling and energy metabolism in the rat cortex in vivo. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[55]  Lei Ding,et al.  Integration of EEG/MEG with MRI and fMRI , 2006, IEEE Engineering in Medicine and Biology Magazine.

[56]  M. Lauritzen Reading vascular changes in brain imaging: is dendritic calcium the key? , 2005, Nature Reviews Neuroscience.

[57]  S J Luck,et al.  Direct and indirect integration of event‐related potentials, functional magnetic resonance images, and single‐unit recordings , 1999, Human brain mapping.

[58]  T. Goldberg,et al.  Isolating the Mnemonic Component in Spatial Delayed Response: A Controlled PET15O-Labeled Water Regional Cerebral Blood Flow Study in Normal Humans , 1996, NeuroImage.

[59]  Anders M. Dale,et al.  Spectral spatiotemporal imaging of cortical oscillations and interactions in the human brain , 2004, NeuroImage.

[60]  J. Pekar,et al.  Sustained Poststimulus Elevation in Cerebral Oxygen Utilization after Vascular Recovery , 2004, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[61]  E. Moser,et al.  Magnetoencephalography May Help to Improve Functional MRI Brain Mapping , 1997, The European journal of neuroscience.

[62]  N. Logothetis,et al.  Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1 , 2006, Nature Neuroscience.

[63]  Karl J. Friston,et al.  Statistical parametric mapping for event-related potentials: I. Generic considerations , 2004, NeuroImage.

[64]  Soo Yeol Lee,et al.  A technique to consider mismatches between fMRI and EEG/MEG sources for fMRI-constrained EEG/MEG source imaging: a preliminary simulation study , 2006, Physics in medicine and biology.

[65]  Ying Zheng,et al.  The Hemodynamic Impulse Response to a Single Neural Event , 2003, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[66]  M R Symms,et al.  Methodology: EEG-correlated fMRI. , 2000, Advances in neurology.

[67]  Nelson J. Trujillo-Barreto,et al.  Biophysical model for integrating neuronal activity, EEG, fMRI and metabolism , 2008, NeuroImage.

[68]  Andreas Kleinschmidt,et al.  Recent advances in recording electrophysiological data simultaneously with magnetic resonance imaging , 2008, NeuroImage.

[69]  Masaki Fukunaga,et al.  Metabolic Origin of Bold Signal Fluctuations in the Absence of Stimuli , 2008, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[70]  Vince D. Calhoun,et al.  Corrigendum to “Joint independent component analysis for simultaneous EEG-fMRI: Principle and simulation" [Int. J. Psychophysiol. 67 (2008) 212–221] , 2008 .

[71]  Jean Gotman,et al.  EEG‐fMRI of focal epileptic spikes: Analysis with multiple haemodynamic functions and comparison with gadolinium‐enhanced MR angiograms , 2004, Human brain mapping.

[72]  J. Gotman,et al.  Generalized epileptic discharges show thalamocortical activation and suspension of the default state of the brain. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Karl J. Friston Models of brain function in neuroimaging. , 2005, Annual review of psychology.

[74]  I. Fried,et al.  Coupling Between Neuronal Firing, Field Potentials, and fMRI in Human Auditory Cortex , 2005, Science.

[75]  R. Buxton,et al.  Dynamics of blood flow and oxygenation changes during brain activation: The balloon model , 1998, Magnetic resonance in medicine.

[76]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[77]  P. Nunez,et al.  On the Relationship of Synaptic Activity to Macroscopic Measurements: Does Co-Registration of EEG with fMRI Make Sense? , 2004, Brain Topography.

[78]  Karl J. Friston,et al.  Hemodynamic correlates of EEG: A heuristic , 2005, NeuroImage.

[79]  J.-M. Lina,et al.  Assessing the relevance of fMRI-based prior in the EEG inverse problem: a bayesian model comparison approach , 2005, IEEE Transactions on Signal Processing.

[80]  Nelson J. Trujillo-Barreto,et al.  Modelling the role of excitatory and inhibitory neuronal activity in the generation of the BOLD signal , 2007, NeuroImage.

[81]  K Scheffler,et al.  Motor, somatosensory and auditory cortex localization by fMRI and MEG , 1998, Neuroreport.

[82]  E. Halgren,et al.  Application of Magnetoencephalography in Epilepsy Patients with Widespread Spike or Slow‐wave Activity , 2005, Epilepsia.

[83]  Robert Schmitt,et al.  Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection , 2004, NeuroImage.

[84]  O. Blanke,et al.  The use of functional constraints for the neuroelectromagnetic inverse problem: alternatives and caveats. , 2001 .

[85]  Karl J. Friston,et al.  The Trouble with Cognitive Subtraction , 1996, NeuroImage.

[86]  Jean Gotman,et al.  Analysis of the EEG–fMRI response to prolonged bursts of interictal epileptiform activity , 2005, NeuroImage.

[87]  V. Calhoun,et al.  Joint independent component analysis for simultaneous EEG-fMRI: principle and simulation. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[88]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[89]  F Kruggel,et al.  Recording of the event‐related potentials during functional MRI at 3.0 Tesla field strength , 2000, Magnetic resonance in medicine.

[90]  Makoto Takahashi,et al.  The neural basis of the hemodynamic response nonlinearity in human primary visual cortex: Implications for neurovascular coupling mechanism , 2006, NeuroImage.

[91]  Pierre J Magistretti,et al.  GABA uptake into astrocytes is not associated with significant metabolic cost: Implications for brain imaging of inhibitory transmission , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[92]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[93]  Karl J. Friston,et al.  Multiple sparse priors for the M/EEG inverse problem , 2008, NeuroImage.

[94]  R Kawashima,et al.  Nonlinear local electrovascular coupling. II: From data to neuronal masses , 2007, Human brain mapping.

[95]  Jérémie Mattout,et al.  Symmetrical event-related EEG/fMRI information fusion in a variational Bayesian framework , 2007, NeuroImage.

[96]  L Bozzao,et al.  Real-time MR artifacts filtering during continuous EEG/fMRI acquisition. , 2003, Magnetic resonance imaging.

[97]  D. Attwell,et al.  The neural basis of functional brain imaging signals , 2002, Trends in Neurosciences.

[98]  G. Jackson,et al.  Spike-triggered fMRI in reading epilepsy , 2003, Neurology.

[99]  Karl J. Friston,et al.  Biophysical models of fMRI responses , 2004, Current Opinion in Neurobiology.

[100]  J. Gotman,et al.  fMRI activation during spike and wave discharges in idiopathic generalized epilepsy. , 2004, Brain : a journal of neurology.

[101]  C M Michel,et al.  EEG‐Triggered Functional MRI in Patients With Pharmacoresistant Epilepsy , 2000, Journal of magnetic resonance imaging : JMRI.