A Simple Convolutional Neural Network for Accurate P300 Detection and Character Spelling in Brain Computer Interface

A Brain Computer Interface (BCI) character speller allows human-beings to directly spell characters using eye-gazes, thereby building communication between the human brain and a computer. Convolutional Neural Networks (CNNs) have shown better performance than traditional machine learning methods for BCI signal recognition and its application to the character speller. However, current CNN architectures limit further accuracy improvements of signal detection and character spelling and also need high complexity to achieve competitive accuracy, thereby preventing the use of CNNs in portable BCIs. To address these issues, we propose a novel and simple CNN which effectively learns feature representations from both raw temporal information and raw spatial information. The complexity of the proposed CNN is significantly reduced compared with state-of-the-art CNNs for BCI signal detection. We perform experiments on three benchmark datasets and compare our results with those in previous research works which report the best results. The comparison shows that our proposed CNN can increase the signal detection accuracy by up to 15.61% and the character spelling accuracy by up to 19.35%.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Chin-Teng Lin,et al.  Brain Computer Interface-Based Smart Living Environmental Auto-Adjustment Control System in UPnP Home Networking , 2014, IEEE Systems Journal.

[3]  Wai-Chi Fang,et al.  Development of a reliable SSVEP-based BCI mobile dialing system , 2016, 2016 IEEE International Conference on Consumer Electronics (ICCE).

[4]  Bart Vanrumste,et al.  Validation of ICA as a tool to remove eye movement artifacts from EEG/ERP. , 2010, Psychophysiology.

[5]  Tzyy-Ping Jung,et al.  A Cell-Phone Based Brain-Computer Interface for Communication in Daily Life , 2010, AICI.

[6]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[7]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[10]  E R John,et al.  Information Delivery and the Sensory Evoked Potential , 1967, Science.

[11]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[12]  Vladimir Bostanov,et al.  BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram , 2004, IEEE Transactions on Biomedical Engineering.

[13]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[14]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[15]  Junfeng Gao,et al.  Online Removal of Muscle Artifact from Electroencephalogram Signals Based on Canonical Correlation Analysis , 2010, Clinical EEG and neuroscience.

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Guillaume Gibert,et al.  xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[19]  Daniel P. Ferris,et al.  Removal of movement artifact from high-density EEG recorded during walking and running. , 2010, Journal of neurophysiology.

[20]  Ran Manor,et al.  Convolutional Neural Network for Multi-Category Rapid Serial Visual Presentation BCI , 2015, Front. Comput. Neurosci..

[21]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[25]  Chin-Teng Lin,et al.  EEG-Based Learning System for Online Motion Sickness Level Estimation in a Dynamic Vehicle Environment , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[26]  O Bertrand,et al.  A robust sensor-selection method for P300 brain–computer interfaces , 2011, Journal of neural engineering.

[27]  Wei Wu,et al.  Deep learning based on Batch Normalization for P300 signal detection , 2018, Neurocomputing.

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.