Ensemble Learning to EEG-Based Brain Computer Interfaces with Applications on P300-Spellers

Brain-Computer Interfaces (BCI) are systems in which the electrical activity of an animal brain becomes the main controller of an external electronic device capable of reading and processing electroencephalographic (EEG) signals. One early application of such systems is the attention-based spellers utilizing the P300 visually evoked potential in a framework known as the oddball paradigm. In this paper, we propose novel variants of machine learning model ensembles in addressing the task of P300 detection and attended target recognition in attention-based speller systems. Proposed ensembles adopted Bootstrap aggregation (Bagging) of calibrated Support Vector Machines (SVM) as well as data-driven learners. The latter is dominantly represented by Convolutional Neural Networks (CNN) with several variants, including what is referred to as Inception, Xception, and Interleaved Group Convolutions (IGC) modules. The proposed models are evaluated on a publicly available EEG dataset developed specifically for BCI applications and published in public contests, namely the 2nd dataset of the 3rd BCI competitions. The proposed models consistently outperform all previous works on the same dataset and show the highest 5- and 15-trial recognition rates of 76.5% and 98.5%, respectively, for both subjects in the dataset jointly. Additionally, we introduce in this work the first study on inter-subject evaluation under similar training protocols, reaching between 30%-40% recognition rates for either subject. We further investigate the effect of reducing the training data on the performance of the proposed models showing possibilities of reduced training time for a target recognition rate.

[1]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[2]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jingdong Wang,et al.  Interleaved Group Convolutions for Deep Neural Networks , 2017, ArXiv.

[4]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[5]  Sheng-Fu Liang,et al.  A closed-loop brain computer interface for real-time seizure detection and control , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[6]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[7]  Yuanqing Li,et al.  Grouped Automatic Relevance Determination and Its Application in Channel Selection for P300 BCIs , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Feng Li,et al.  Semi-supervised joint spatio-temporal feature selection for P300-based BCI speller , 2011, Cognitive Neurodynamics.

[9]  Sebastiaan Mathôt,et al.  The Mind-Writing Pupil: A Human-Computer Interface Based on Decoding of Covert Attention through Pupillometry , 2016, PloS one.

[10]  S. Hochreiter,et al.  EXPONENTIAL LINEAR UNITS (ELUS) , 2016 .

[11]  Y. Yao,et al.  On Early Stopping in Gradient Descent Learning , 2007 .

[12]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[13]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[14]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[16]  Rajesh P. N. Rao Brain-Computer Interfacing: An Introduction , 2010 .

[17]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[18]  Mohamed Taher,et al.  A principal component analysis ensemble classifier for P300 speller applications , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[19]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[20]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Samit Ari,et al.  P300 Detection with Brain–Computer Interface Application Using PCA and Ensemble of Weighted SVMs , 2018 .

[22]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[23]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[24]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[25]  Charu C. Aggarwal,et al.  Feature Selection for Classification: A Review , 2014, Data Classification: Algorithms and Applications.

[26]  Ivo Käthner,et al.  Rapid P300 brain-computer interface communication with a head-mounted display , 2015, Front. Neurosci..

[27]  Waleed Fakhr,et al.  Enhancements of the classification algorithms for the BCI P300 speller diagram , 2010, 2010 5th Cairo International Biomedical Engineering Conference.

[28]  Moritz Grosse-Wentrup,et al.  Using brain–computer interfaces to induce neural plasticity and restore function , 2011, Journal of neural engineering.

[29]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[31]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[32]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[33]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.