Signal Processing and Machine Learning for Single-trial Analysis of Simultaneously Acquired EEG and fMRI

Publisher Summary The simultaneous acquisition of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a potentially powerful multimodal imaging technique for measuring the functional activity of the human brain. Given that EEG measures the electrical activity of neural populations while fMRI measures hemodynamics via a blood oxygenation-level-dependent (BOLD) signal related to neuronal activity, simultaneous EEG/fMRI (hereafter referred to as EEG/fMRI) offers a modality to investigate the relationship between these two phenomena within the context of noninvasive neuroimaging. Though fMRI is widely used to study cognitive and perceptual function, there is still substantial debate regarding the relation- ship between local neuronal activity and hemodynamic changes. Another rationale for EEG/fMRI is that, despite the fact that the individual modalities measure markedly different physiological phenomena, in terms of spatial and temporal resolution they are quite complementary. EEG offers millisecond temporal resolution; however, the spatial sampling density and ill-posed nature of the inverse model problem limit its spatial resolution. On the other hand, fMRI provides millimeter spatial resolution, but because of scanning rates and the low-pass nature of the BOLD response, the temporal resolution is limited. One approach that has been adopted to take advantage of this complementarity is to use fMRI activations to seed EEG source localization.