A novel end-to-end 1D-ResCNN model to remove artifact from EEG signals

Abstract Electroencephalography (EEG) signals are an important tool in the field of clinical medicine, brain research and the study of neurological diseases. EEG is very susceptible to a variety of physiological signals, which brings great difficulties to the research and analysis of EEG signals. Therefore, removing noise from EEG signals is a key prerequisite for analyzing EEG signals. In this paper, a one-dimensional residual Convolutional Neural Networks (1D-ResCNN) model for raw waveform-based EEG denoising is proposed to solve the above problem. An end-to-end (i.e. waveform in and waveform out) manner is used to map a noisy EEG signal to a clean EEG signal. In the training stage, an objective function is often adopted to optimize the model parameters and in the test stage, the trained 1D-ResCNN model is used as a filter to automatically remove noise from the contaminated EEG signal. The proposed model is evaluated on the EEG signal from the CHB-MIT Scalp EEG Database, and the added noise signals are obtained from the database. We compared the proposed model with the independent of the composite analysis (ICA), the fast independent composite analysis (FICA),Recursive least squares(RLS) filter,Wavelet Transform (WT) and Deep neural network(DNN) models. Experimental Results show that the proposed model can yield cleaner waveforms and achieve significant improvement in SNR and RMSE.Meanwhile, the proposed model can also preserve the nonlinear characteristics of EEG signals.

[1]  Arjon Turnip,et al.  Removal artifacts from EEG signal using independent component analysis and principal component analysis , 2014, 2014 2nd International Conference on Technology, Informatics, Management, Engineering & Environment.

[2]  Christopher K. Kovach,et al.  Manifestation of ocular-muscle EMG contamination in human intracranial recordings , 2011, NeuroImage.

[3]  Max E. Valentinuzzi,et al.  Artifact removal from EEG signals using adaptive filters in cascade , 2007 .

[4]  Hai Su,et al.  Recent Advances in the Applications of Convolutional Neural Networks to Medical Image Contour Detection , 2017, ArXiv.

[5]  Seán F. McLoone,et al.  The Use of Ensemble Empirical Mode Decomposition With Canonical Correlation Analysis as a Novel Artifact Removal Technique , 2013, IEEE Transactions on Biomedical Engineering.

[6]  G. Birch,et al.  Time-frequency Analysis of Eye Blinks and Saccades in EOG for EEG Artifact Removal , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[7]  Siew-Cheok Ng,et al.  Enhanced ${\mu }$ Rhythm Extraction Using Blind Source Separation and Wavelet Transform , 2009, IEEE Transactions on Biomedical Engineering.

[8]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[9]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic and Event-Related Potential Data , 1998 .

[10]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[11]  L. Shoker,et al.  Removal of eye blinking artifacts from EEG incorporating a new constrained BSS algorithm , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Stanly Johnson Jeyaraj,et al.  Artifacts Removal in EEG Signal using Adaptive Neuro Fuzzy Inference System , 2007, 2007 International Conference on Signal Processing, Communications and Networking.

[13]  Mohammad Ali Badamchizadeh,et al.  Artifacts removal in EEG signal using a new neural network enhanced adaptive filter , 2013, Neurocomputing.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  R. Kass,et al.  Automatic correction of ocular artifacts in the EEG: a comparison of regression-based and component-based methods , 2004 .

[16]  Amir Rastegarnia,et al.  Methods for artifact detection and removal from scalp EEG: A review , 2016, Neurophysiologie Clinique/Clinical Neurophysiology.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Nitish V. Thakor,et al.  A new perspective of noise removal from EEG , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[19]  Liu Fan,et al.  Learning algorithm for constructing fuzzy neural networks with application to regression problems , 2011, International Conference on Information Science and Technology.

[20]  Banghua Yang,et al.  Automatic ocular artifacts removal in EEG using deep learning , 2018, Biomed. Signal Process. Control..

[21]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[22]  Geoffrey E. Hinton,et al.  Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures , 2018, NeurIPS.

[23]  Tingxi Wen,et al.  Deep Convolution Neural Network and Autoencoders-Based Unsupervised Feature Learning of EEG Signals , 2018, IEEE Access.

[24]  Richard P. Brenner,et al.  Atlas of EEG in critical care , 2010 .

[25]  Bin Hu,et al.  A method of removing Ocular Artifacts from EEG using Discrete Wavelet Transform and Kalman Filtering , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[26]  Jing Hu,et al.  Removal of EOG and EMG artifacts from EEG using combination of functional link neural network and adaptive neural fuzzy inference system , 2015, Neurocomputing.

[27]  Xuelong Li,et al.  Convolution in Convolution for Network in Network , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Rui Rodrigues,et al.  A Neural Network Approach to ECG Denoising , 2012, ArXiv.

[29]  Christiaan Burger,et al.  Removal of EOG artefacts by combining wavelet neural network and independent component analysis , 2015, Biomed. Signal Process. Control..

[30]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  G. Wilson,et al.  Removal of ocular artifacts from electro-encephalogram by adaptive filtering , 2004, Medical and Biological Engineering and Computing.

[32]  Jun Du,et al.  An Experimental Study on Speech Enhancement Based on Deep Neural Networks , 2014, IEEE Signal Processing Letters.

[33]  Meng Joo Er,et al.  An adaptive RBFN-based filter for adaptive noise cancellation , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[34]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[35]  Yang Yu,et al.  Toward brain-actuated car applications: Self-paced control with a motor imagery-based brain-computer interface , 2016, Comput. Biol. Medicine.

[36]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[37]  Anil Kumar,et al.  Adaptive filtering of EEG/ERP through noise cancellers using an improved PSO algorithm , 2014, Swarm Evol. Comput..

[38]  Ming Liu,et al.  ECG signal enhancement based on improved denoising auto-encoder , 2016, Eng. Appl. Artif. Intell..

[39]  Yanda Li,et al.  Automatic removal of the eye blink artifact from EEG using an ICA-based template matching approach , 2006, Physiological measurement.

[40]  Toshihisa Tanaka,et al.  Artifact suppression from EEG signals using data adaptive time domain filtering , 2012, Neurocomputing.

[41]  Tao Jiang,et al.  Single Image Super Resolution via a Refined Densely Connected Inception Network , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[42]  K H Ting,et al.  Automatic correction of artifact from single-trial event-related potentials by blind source separation using second order statistics only. , 2006, Medical engineering & physics.

[43]  Pablo Laguna,et al.  Bioelectrical Signal Processing in Cardiac and Neurological Applications , 2005 .

[44]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Ihsan Ullah,et al.  An Automated System for Epilepsy Detection using EEG Brain Signals based on Deep Learning Approach , 2018, Expert Syst. Appl..

[46]  T. Begum,et al.  Comparison of envelope interpolation techniques in Empirical Mode Decomposition (EMD) for eyeblink artifact removal from EEG , 2016, 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[47]  V. Krishnaveni,et al.  Removal of ocular artifacts from EEG using adaptive thresholding of wavelet coefficients , 2006, Journal of neural engineering.

[48]  Jiang Li,et al.  EOG artifact removal using a wavelet neural network , 2012, Neurocomputing.

[49]  M. Cook,et al.  The utility of ambulatory electroencephalography in routine clinical practice: A critical review , 2013, Epilepsy Research.

[50]  Panagiotis D. Bamidis,et al.  REG-ICA: A hybrid methodology combining Blind Source Separation and regression techniques for the rejection of ocular artifacts , 2011, Biomed. Signal Process. Control..

[51]  G. Pfurtscheller,et al.  A fully automated correction method of EOG artifacts in EEG recordings , 2007, Clinical Neurophysiology.

[52]  R. Arumuganathan,et al.  Removal of artifacts from EEG signals using adaptive filter through wavelet transform , 2008, 2008 9th International Conference on Signal Processing.

[53]  M. Fay,et al.  Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules. , 2010, Statistics surveys.