Electromagnetic Source Imaging via a Data-Synthesis-Based Denoising Autoencoder

Electromagnetic source imaging (ESI) is a highly ill-posed inverse problem. To find a unique solution, traditional ESI methods impose a variety of priors that may not reflect the actual source properties. Such limitations of traditional ESI methods hinder their further applications. Inspired by deep learning approaches, a novel data-synthesized spatio-temporal denoising autoencoder method (DST-DAE) method was proposed to solve the ESI inverse problem. Unlike the traditional methods, we utilize a neural network to directly seek generalized mapping from the measured E/MEG signals to the cortical sources. A novel data synthesis strategy is employed by introducing the prior information of sources to the generated large-scale samples using the forward model of ESI. All the generated data are used to drive the neural network to automatically learn inverse mapping. To achieve better estimation performance, a denoising autoencoder (DAE) architecture with spatio-temporal feature extraction blocks is designed. Compared with the traditional methods, we show (1) that the novel deep learning approach provides an effective and easy-to-apply way to solve the ESI problem, that (2) compared to traditional methods, DST-DAE with the data synthesis strategy can better consider the characteristics of real sources than the mathematical formulation of prior assumptions, and that (3) the specifically designed architecture of DAE can not only provide a better estimation of source signals but also be robust to noise pollution. Extensive numerical experiments show that the proposed method is superior to the traditional knowledge-driven ESI methods.

[1]  Jean Gotman,et al.  Evaluation of EEG localization methods using realistic simulations of interictal spikes , 2006, NeuroImage.

[2]  Wei Wu,et al.  STRAPS: A Fully Data-Driven Spatio-Temporally Regularized Algorithm for M/EEG Patch Source Imaging , 2015, Int. J. Neural Syst..

[3]  Simon R. Arridge,et al.  Solving inverse problems using data-driven models , 2019, Acta Numerica.

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[7]  Udantha R. Abeyratne,et al.  Artificial neural networks for source localization in the human brain , 2005, Brain Topography.

[8]  Shuicheng Yan,et al.  Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  J. Ebersole,et al.  Intracranial EEG Substrates of Scalp EEG Interictal Spikes , 2005, Epilepsia.

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  J.C. Mosher,et al.  Multiple dipole modeling and localization from spatio-temporal MEG data , 1992, IEEE Transactions on Biomedical Engineering.

[12]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[13]  I F Gorodnitsky,et al.  Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm. , 1995, Electroencephalography and clinical neurophysiology.

[14]  David A. Winkler,et al.  Beware of R2: Simple, Unambiguous Assessment of the Prediction Accuracy of QSAR and QSPR Models , 2015, J. Chem. Inf. Model..

[15]  Rémi Gribonval,et al.  Brain-Source Imaging: From sparse to tensor models , 2015, IEEE Signal Processing Magazine.

[16]  M. Hämäläinen,et al.  Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data , 1989, IEEE Transactions on Biomedical Engineering.

[17]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[18]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[19]  Bart Vanrumste,et al.  Journal of Neuroengineering and Rehabilitation Open Access Review on Solving the Inverse Problem in Eeg Source Analysis , 2022 .

[20]  Younes Zerouali,et al.  MEG–EEG Information Fusion and Electromagnetic Source Imaging: From Theory to Clinical Application in Epilepsy , 2015, Brain Topography.

[21]  Fahim Gohar Awan,et al.  Recent trends and advances in solving the inverse problem for EEG source localization , 2018, Inverse Problems in Science and Engineering.

[22]  D. Contreras,et al.  Spatiotemporal Analysis of Local Field Potentials and Unit Discharges in Cat Cerebral Cortex during Natural Wake and Sleep States , 1999, The Journal of Neuroscience.

[23]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[24]  Lei Ding,et al.  Sparse source imaging in electroencephalography with accurate field modeling , 2008, Human brain mapping.

[25]  Julia P. Owen,et al.  Performance evaluation of the Champagne source reconstruction algorithm on simulated and real M/EEG data , 2012, NeuroImage.

[26]  G Van Hoey,et al.  EEG dipole source localization using artificial neural networks. , 2000, Physics in medicine and biology.

[27]  Eduardo Martínez-Montes,et al.  EEG source imaging with spatio‐temporal tomographic nonnegative independent component analysis , 2009, Human brain mapping.

[28]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Richard Socher,et al.  A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation , 2018, ICLR.

[32]  Dezhong Yao,et al.  Lp Norm Iterative Sparse Solution for EEG Source Localization , 2007, IEEE Transactions on Biomedical Engineering.

[33]  Polina Golland,et al.  A Distributed Spatio-temporal EEG/MEG Inverse Solver , 2008, MICCAI.

[34]  Bin He,et al.  Electrophysiological Imaging of Brain Activity and Connectivity—Challenges and Opportunities , 2011, IEEE Transactions on Biomedical Engineering.

[35]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[36]  Thomas R. Knösche,et al.  Prior knowledge on cortex organization in the reconstruction of source current densities from EEG , 2013, NeuroImage.

[37]  Paramasivan Saratchandran,et al.  Eeg Source Localization: A Compartive Study of Classical and Neural Network Methods , 2001, Int. J. Neural Syst..

[38]  Théodore Papadopoulo,et al.  OpenMEEG: opensource software for quasistatic bioelectromagnetics , 2010, Biomedical engineering online.

[39]  Wei Wu,et al.  Bayesian Machine Learning: EEG\/MEG signal processing measurements , 2016, IEEE Signal Processing Magazine.

[40]  Lei Ding,et al.  Reconstructing spatially extended brain sources via enforcing multiple transform sparseness , 2014, NeuroImage.

[41]  Toshimitsu Musha,et al.  Electric Dipole Tracing in the Brain by Means of the Boundary Element Method and Its Accuracy , 1987, IEEE Transactions on Biomedical Engineering.

[42]  Kensuke Sekihara,et al.  A probabilistic algorithm for robust interference suppression in bioelectromagnetic sensor data , 2007, Statistics in medicine.

[43]  David P. Wipf,et al.  A unified Bayesian framework for MEG/EEG source imaging , 2009, NeuroImage.

[44]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for brain mapping and decoding of movement-related information from the human EEG , 2017, ArXiv.

[45]  R. Hari,et al.  Magnetoencephalography in the study of human somatosensory cortical processing. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[46]  Seong-Whan Lee,et al.  Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Vincent Dumoulin,et al.  Deconvolution and Checkerboard Artifacts , 2016 .

[48]  Jen-Chuen Hsieh,et al.  Author's Personal Copy Spatially Sparse Source Cluster Modeling by Compressive Neuromagnetic Tomography , 2022 .

[49]  Rui Sun,et al.  SIFNet: Electromagnetic Source Imaging Framework Using Deep Neural Networks , 2020, bioRxiv.

[50]  Julia P. Owen,et al.  Robust Bayesian estimation of the location, orientation, and time course of multiple correlated neural sources using MEG , 2010, NeuroImage.

[51]  Nelson J. Trujillo-Barreto,et al.  Bayesian M/EEG source reconstruction with spatio-temporal priors , 2008, NeuroImage.

[52]  Hagai Attias,et al.  Probabilistic algorithms for MEG/EEG source reconstruction using temporal basis functions learned from data , 2008, NeuroImage.

[53]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[54]  Christophe Grova,et al.  MEG Source Localization of Spatially Extended Generators of Epileptic Activity: Comparing Entropic and Hierarchical Bayesian Approaches , 2013, PloS one.

[55]  R M Leahy,et al.  A sensor-weighted overlapping-sphere head model and exhaustive head model comparison for MEG. , 1999, Physics in medicine and biology.

[56]  Qinyu Zhang,et al.  EEG source localization for two dipoles by neural networks , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[57]  Chang Cai,et al.  Robust estimation of noise for electromagnetic brain imaging with the champagne algorithm , 2021, NeuroImage.