Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship.

[1]  Barry Horwitz,et al.  Interpreting PET and fMRI measures of functional neural activity: the effects of synaptic inhibition on cortical activation in human imaging studies , 2001, Brain Research Bulletin.

[2]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[3]  V. Calhoun,et al.  Joint independent component analysis for simultaneous EEG-fMRI: principle and simulation. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  Mark S. Cohen,et al.  Simultaneous EEG and fMRI of the alpha rhythm , 2002, Neuroreport.

[5]  A. Engel,et al.  Single-trial EEG–fMRI reveals the dynamics of cognitive function , 2006, Trends in Cognitive Sciences.

[6]  D. Mantini,et al.  High-resolution spatio-temporal neuronal activation in the visual oddball task: a simultaneous EEG/fMRI study , 2007, 2007 Joint Meeting of the 6th International Symposium on Noninvasive Functional Source Imaging of the Brain and Heart and the International Conference on Functional Biomedical Imaging.

[7]  F. Babiloni,et al.  Estimation of the cortical functional connectivity with the multimodal integration of high-resolution EEG and fMRI data by directed transfer function , 2005, NeuroImage.

[8]  Afraim Salek-Haddadi,et al.  Event-Related fMRI with Simultaneous and Continuous EEG: Description of the Method and Initial Case Report , 2001, NeuroImage.

[9]  Bin He,et al.  fMRI–EEG integrated cortical source imaging by use of time-variant spatial constraints , 2008, NeuroImage.

[10]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[11]  Karl J. Friston,et al.  Nonlinear event‐related responses in fMRI , 1998, Magnetic resonance in medicine.

[12]  Ari Syngeniotis,et al.  Benign Epilepsy with Centro‐temporal Spikes: Spike Triggered fMRI Shows Somato‐sensory Cortex Activity , 2003, Epilepsia.

[13]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[14]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[15]  P. Nunez,et al.  Electric fields of the brain , 1981 .

[16]  P. Manganotti,et al.  EEG and fMRI Coregistration to Investigate the Cortical Oscillatory Activities During Finger Movement , 2008, Brain Topography.

[17]  J. Mcculloch,et al.  The effect of diazepam upon local cerebral glucose use in the conscious rat , 1986, Neuroscience.

[18]  P. Rossini,et al.  High-resolution electro-encephalogram: source estimates of Laplacian-transformed somatosensory-evoked potentials using a realistic subject head model constructed from magnetic resonance images , 2000, Medical and Biological Engineering and Computing.

[19]  T. Carpenter,et al.  Linear coupling between functional magnetic resonance imaging and evoked potential amplitude in human somatosensory cortex , 2000, Neuroscience.

[20]  P. Brugger,et al.  What disconnection tells about motor imagery: evidence from paraplegic patients. , 2005, Cerebral cortex.

[21]  O. Arthurs,et al.  How well do we understand the neural origins of the fMRI BOLD signal? , 2002, Trends in Neurosciences.

[22]  G. Pfurtscheller,et al.  Brain motor system function in a patient with complete spinal cord injury following extensive brain–computer interface training , 2008, Experimental Brain Research.

[23]  F. Babiloni,et al.  Assessing cortical functional connectivity by linear inverse estimation and directed transfer function: simulations and application to real data , 2005, Clinical Neurophysiology.

[24]  Febo Cincotti,et al.  Multimodal integration of high-resolution EEG and functional magnetic resonance imaging data: a simulation study , 2003, NeuroImage.

[25]  Bin He,et al.  Functional cortical source imaging from simultaneously recorded ERP and fMRI , 2006, Journal of Neuroscience Methods.

[26]  M R Symms,et al.  Spatio-temporal imaging of focal interictal epileptiform activity using EEG-triggered functional MRI. , 2001, Epileptic disorders : international epilepsy journal with videotape.

[27]  John S. Duncan,et al.  Analysis of EEG–fMRI data in focal epilepsy based on automated spike classification and Signal Space Projection , 2006, NeuroImage.

[28]  C M Michel,et al.  EEG‐Triggered Functional MRI in Patients With Pharmacoresistant Epilepsy , 2000, Journal of magnetic resonance imaging : JMRI.

[29]  R. Buxton,et al.  A Model for the Coupling between Cerebral Blood Flow and Oxygen Metabolism during Neural Stimulation , 1997, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[30]  L. Lemieux,et al.  Recording of EEG during fMRI experiments: Patient safety , 1997, Magnetic resonance in medicine.

[31]  N. Logothetis,et al.  Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1 , 2006, Nature Neuroscience.

[32]  Karl J. Friston,et al.  A direct quantitative relationship between the functional properties of human and macaque V5 , 2000, Nature Neuroscience.

[33]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[34]  F Cincotti,et al.  Imaging functional brain connectivity patterns from high-resolution EEG and fMRI via graph theory. , 2007, Psychophysiology.

[35]  G. A. Miller,et al.  Comparison of different cortical connectivity estimators for high‐resolution EEG recordings , 2007, Human brain mapping.

[36]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[37]  R. Quiroga,et al.  Unmixing concurrent EEG-fMRI with parallel independent component analysis. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[38]  Hannu J. Aronen,et al.  Effects of noise from functional magnetic resonance imaging on auditory event-related potentials in working memory task , 2003, NeuroImage.

[39]  Risto N t nen Attention and brain function , 1992 .

[40]  Hermann Ludwig Ferdinand von Helmholtz Some laws concerning the distribution of electric currents in volume conductors with applications to experiments on animal electricity , 2004, Proc. IEEE.

[41]  Karl J. Friston,et al.  Nonlinear Responses in fMRI: The Balloon Model, Volterra Kernels, and Other Hemodynamics , 2000, NeuroImage.

[42]  J Gotman,et al.  Widespread and intense BOLD changes during brief focal electrographic seizures , 2006, Neurology.

[43]  Afraim Salek-Haddadi,et al.  Simultaneous EEG-Correlated Ictal fMRI , 2002, NeuroImage.

[44]  J R Ives,et al.  EEG-triggered echo-planar functional MRI in epilepsy , 1996, Neurology.

[45]  S Warach,et al.  Monitoring the patient's EEG during echo planar MRI. , 1993, Electroencephalography and clinical neurophysiology.

[46]  M R Symms,et al.  Reproducible localization of interictal epileptiform discharges using EEG-triggered fMRI. , 1999, Physics in medicine and biology.

[47]  J. R. Baker,et al.  Simultaneous functional magnetic resonance imaging and electrophysiological recording , 1995 .

[48]  A Urbano,et al.  Responses of human primary sensorimotor and supplementary motor areas to internally triggered unilateral and simultaneous bilateral one-digit movements. A high-resolution EEG study. , 1997, The European journal of neuroscience.

[49]  S. Debener,et al.  Effects of simultaneous EEG recording on MRI data quality at 1.5, 3 and 7 tesla. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[50]  C. Mathiesen,et al.  Modification of activity‐dependent increases of cerebral blood flow by excitatory synaptic activity and spikes in rat cerebellar cortex , 1998, The Journal of physiology.

[51]  G. Pfurtscheller,et al.  Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients , 2007, Brain Research.

[52]  Robert Turner,et al.  How Much Cortex Can a Vein Drain? Downstream Dilution of Activation-Related Cerebral Blood Oxygenation Changes , 2002, NeuroImage.

[53]  M R Symms,et al.  EEG-triggered functional MRI of interictal epileptiform activity in patients with partial seizures. , 1999, Brain : a journal of neurology.

[54]  T Landis,et al.  Non-invasive epileptic focus localization using EEG-triggered functional MRI and electromagnetic tomography. , 1998, Electroencephalography and clinical neurophysiology.

[55]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[56]  J W Belliveau,et al.  Visual evoked potential (VEP) measured by simultaneous 64-channel EEG and 3T fMRI. , 1999, Neuroreport.

[57]  E. London,et al.  Effects of gamma-aminobutyric acid agonist and antagonist drugs on local cerebral glucose utilization , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  Pietro Badia,et al.  Time of day, repeated testing, and interblock interval effects on P300 amplitude , 1990, Physiology & Behavior.

[59]  F. Babiloni,et al.  Estimation of Effective and Functional Cortical Connectivity From Neuroelectric and Hemodynamic Recordings , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  Karl J. Friston,et al.  Hemodynamic correlates of epileptiform discharges: An EEG-fMRI study of 63 patients with focal epilepsy , 2006, Brain Research.

[61]  N. Logothetis,et al.  Very slow activity fluctuations in monkey visual cortex: implications for functional brain imaging. , 2003, Cerebral cortex.

[62]  Karl J. Friston,et al.  Nonlinear Coupling between Evoked rCBF and BOLD Signals: A Simulation Study of Hemodynamic Responses , 2001, NeuroImage.

[63]  Karl J. Friston,et al.  Functional magnetic resonance imaging of human absence seizures , 2003, Annals of neurology.

[64]  M. Roth,et al.  Single‐trial analysis of oddball event‐related potentials in simultaneous EEG‐fMRI , 2007, Human brain mapping.

[65]  Andreas Kleinschmidt,et al.  EEG-correlated fMRI of human alpha activity , 2003, NeuroImage.

[66]  Fumikazu Miwakeichi,et al.  Concurrent EEG/fMRI analysis by multiway Partial Least Squares , 2004, NeuroImage.

[67]  Laura Astolfi,et al.  Estimation of the effective and functional human cortical connectivity with structural equation modeling and directed transfer function applied to high-resolution EEG. , 2004, Magnetic resonance imaging.

[68]  Karl J. Friston,et al.  Hemodynamic correlates of EEG: A heuristic , 2005, NeuroImage.

[69]  Kenneth Hugdahl,et al.  Assessing the spatiotemporal evolution of neuronal activation with single-trial event-related potentials and functional MRI. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[70]  David B. Geselowitz,et al.  Introduction to "some laws concerning the distribution of electric currents in volume conductors with applications to experiments on animal electricity" , 2004, Proceedings of the IEEE.