Deep Convolutional Neural Networks for Feature-Less Automatic Classification of Independent Components in Multi-Channel Electrophysiological Brain Recordings

Objective: Interpretation of the electroencephalographic (EEG) and magnetoencephalographic (MEG) signals requires off-line artifacts removal. Since artifacts share frequencies with brain activity, filtering is insufficient. Blind source separation, mainly through independent component analysis (ICA), is the gold-standard procedure for the identification of artifacts in multi-dimensional recordings. However, a classification of brain and artifactual independent components (ICs) is still required. Since ICs exhibit recognizable patterns, classification is usually performed by experts’ visual inspection. This procedure is time consuming and prone to errors. Automatic ICs classification has been explored, often through complex ICs features extraction prior to classification. Relying on deep-learning ability of self-extracting the features of interest, we investigated the capabilities of convolutional neural networks (CNNs) for off-line, automatic artifact identification through ICs without feature selection. Methods: A CNN was applied to spectrum and topography of a large dataset of few thousand samples of ICs obtained from multi-channel EEG and MEG recordings acquired during heterogeneous experimental settings and on different subjects. CNN performances, when applied to EEG, MEG, and combined EEG and MEG ICs, were explored and compared with state-of-the-art feature-based automatic classification. Results: Beyond state-of-the-art automatic classification accuracies were demonstrated through cross validation (92.4% EEG, 95.4% MEG, 95.6% EEG+MEG). Conclusion: High CNN classification performances were achieved through heuristical selection of machinery hyperparameters and through the CNN self-selection of the features of interest. Significance: Considering the large data availability of multi-channel EEG and MEG recordings, CNNs may be suited for classification of ICs of multi-channel brain electrophysiological recordings.

[1]  Tomás Ward,et al.  Artifact Removal in Physiological Signals—Practices and Possibilities , 2012, IEEE Transactions on Information Technology in Biomedicine.

[2]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[3]  David J. C. MacKay,et al.  Bayesian Methods for Backpropagation Networks , 1996 .

[4]  D. J. Doyle,et al.  Some comments on the use of Wiener filtering for the estimation of evoked potentials. , 1975, Electroencephalography and clinical neurophysiology.

[5]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[6]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[7]  P. Rossini,et al.  Optimization of an independent component analysis approach for artifact identification and removal in magnetoencephalographic signals , 2004, Clinical Neurophysiology.

[8]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Gian Luca Romani,et al.  Complete artifact removal for EEG recorded during continuous fMRI using independent component analysis , 2007, NeuroImage.

[12]  Franco Scarselli,et al.  On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Mark W. Woolrich,et al.  Adding dynamics to the Human Connectome Project with MEG , 2013, NeuroImage.

[14]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[15]  M. Tangermann,et al.  Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals , 2011, Behavioral and Brain Functions.

[16]  Gian Luca Romani,et al.  Improving MEG source localizations: An automated method for complete artifact removal based on independent component analysis , 2008, NeuroImage.

[17]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Yoshua Bengio,et al.  Gradient-Based Optimization of Hyperparameters , 2000, Neural Computation.

[20]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[23]  Aina Puce,et al.  A Review of Issues Related to Data Acquisition and Analysis in EEG/MEG Studies , 2017, Brain sciences.

[24]  Michael Unser,et al.  A review of wavelets in biomedical applications , 1996, Proc. IEEE.

[25]  Chin-Teng Lin,et al.  Automatic identification of useful independent components with a view to removing artifacts from eeg signal , 2009, 2009 International Joint Conference on Neural Networks.

[26]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[27]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[28]  Joyanta Basu,et al.  Blind source separation: A review and analysis , 2013, 2013 International Conference Oriental COCOSDA held jointly with 2013 Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE).

[29]  Amir Rastegarnia,et al.  Methods for artifact detection and removal from scalp EEG: A review , 2016, Neurophysiologie Clinique/Clinical Neurophysiology.

[30]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[31]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[32]  Jiang Li,et al.  EOG artifact removal using a wavelet neural network , 2012, Neurocomputing.

[33]  Prabhat,et al.  Scalable Bayesian Optimization Using Deep Neural Networks , 2015, ICML.

[34]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[38]  Donald J Bolger,et al.  The neurophysiological bases of EEG and EEG measurement: a review for the rest of us. , 2014, Psychophysiology.

[39]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[40]  S. N. Erné,et al.  Biomagnetic systems for clinical use , 2000 .

[41]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[42]  Fernando Mendes de Azevedo,et al.  Binary Neural Classifier of Raw EEG Data to Separate Spike and Sharp Wave of the Eye Blink Artifact , 2009, 2009 Fifth International Conference on Natural Computation.

[43]  Thea Radüntz,et al.  Automated EEG artifact elimination by applying machine learning algorithms to ICA-based features , 2017, Journal of neural engineering.

[44]  Robert Hecht-Nielsen III.3 – Theory of the Backpropagation Neural Network* , 1992 .

[45]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[46]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[47]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[48]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[49]  Aneta Stefanovska,et al.  Nonlinear mode decomposition: a noise-robust, adaptive decomposition method. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[51]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[52]  Filippo Zappasodi,et al.  Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification , 2018, Journal of neural engineering.

[53]  Max E. Valentinuzzi,et al.  Artifact removal from EEG signals using adaptive filters in cascade , 2007 .

[54]  Christopher J James,et al.  Independent component analysis for biomedical signals , 2005, Physiological measurement.

[55]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[56]  Christian P. Robert,et al.  Machine Learning, a Probabilistic Perspective , 2014 .