Multimodal data analysis of epileptic EEG and rs-fMRI via deep learning and edge computing

BACKGROUND AND OBJECTIVE Multimodal data analysis and large-scale computational capability is entering medicine in an accelerative fashion and has begun to influence investigational work in a variety of disciplines. It is also informing us of therapeutic interventions that will come about with such development. Epilepsy is a chronic brain disorder in which functional changes may precede structural ones and which may be detectable using existing modalities. METHODS Functional connectivity analysis using electroencephalography (EEG) and resting state-functional magnetic resonance imaging (rs-fMRI) has provided such meaningful input in cases of epilepsy. By leveraging the potential of autonomic edge computing in epilepsy, we develop and deploy both noninvasive and invasive methods for monitoring, evaluation, and regulation of the epileptic brain. First, an autonomic edge computing framework is proposed for the processing of big data as part of a decision support system for surgical candidacy. Second, a multimodal data analysis using independently acquired EEG and rs-fMRI is presented for estimation and prediction of the epileptogenic network. Third, an unsupervised feature extraction model is developed for EEG analysis and seizure prediction based on a Convolutional deep learning (CNN) structure for distinguishing preictal (pre-seizure) state from non-preictal periods by support vector machine (SVM) classifier. RESULTS Experimental and simulation results from actual patient data validate the effectiveness of the proposed methods. CONCLUSIONS The combination of rs-fMRI and EEG/iEEG can reveal more information about dynamic functional connectivity. However, simultaneous fMRI and EEG data acquisition present challenges. We have proposed system models for leveraging and processing independently acquired fMRI and EEG data.