Classification of Error Related Potentials using Convolutional Neural Networks

A class of Electroencephalogram (EEG) generated when a person is present with a stimuli are Error-related potentials (ErrP). Classification of ErrP revolutionized the domain of Brain-Computer Interface (BCI), however, due to its poor classification accuracy, it is difficult to use it in practical applications. The use of deep learning techniques such as Convolutional neural networks (ConvNets) has been growing because of its end-to-end learning capabilities and classification performance in other fields such as computer vision, speech processing and text synthesis. Very little work has been published towards classification of EEG or its classes using deep learning approaches because of its unexplored benefits in BCI applications. In this paper we propose a novel deep ConvNet architecture to accurately classify Error-related potentials. Using the very recent advances from the field of machine learning, such as batch normalization and dropout layers, we designed a new deep ConvNet architecture. We evaluate and compare the performance of two proposed deep ConvNets by finding its classification accuracy for EEG recordings from same and cross sessions as well as cross subjects for different trials of individual subjects. We see that the net proposed later with newer layers performs very well by improving the mean performance by 4%.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Παντελής Α. Ασβεστάς,et al.  Classification of error-related negativity (ERN) and positivity (PE) potentials using kNN and support vector machines , 2015 .

[3]  Martin Spüler,et al.  Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity , 2015, Front. Hum. Neurosci..

[4]  Shuicheng Yan,et al.  Parallel convolutional-linear neural network for motor imagery classification , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[5]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[6]  Klas Ihme,et al.  Error-related EEG patterns during tactile human-machine interaction , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[7]  V. Sinha,et al.  Event-related potential: An overview , 2009, Industrial psychiatry journal.

[8]  G. Hajcak,et al.  The error-related negativity (ERN) and psychopathology: toward an endophenotype. , 2008, Clinical psychology review.

[9]  Iñaki Iturrate,et al.  EEG single-trial classification of visual, auditive and vibratory feedback potentials in Brain-Computer Interfaces , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Tonio Ball,et al.  Deep learning with convolutional neural networks for decoding and visualization of EEG pathology , 2017, 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[11]  James M. Conrad,et al.  A survey of brain computer interfaces and their applications , 2014, IEEE SOUTHEASTCON 2014.

[12]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  R Chavarriaga,et al.  Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  James M. Conrad,et al.  The effects of pre-filtering and individualizing components for electroencephalography neural network classification , 2017, SoutheastCon 2017.

[16]  Ricardo Chavarriaga,et al.  Errare machinale est: the use of error-related potentials in brain-machine interfaces , 2014, Front. Neurosci..

[17]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[18]  Ricardo Chavarriaga,et al.  Decoding fast-paced error-related potentials in monitoring protocols , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Leonardo S. Mattos,et al.  Does tactile feedback enhance single-trial detection of error-related eeg potentials? , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[20]  Ricardo Chavarriaga,et al.  EEG error-related potentials detection with a Bayesian filter , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[21]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[22]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[24]  J. Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[25]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[26]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[27]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[28]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.