A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm

OBJECTIVE Although extensive studies have shown improvement in spelling accuracy, the conventional P300 speller often exhibits errors, which occur in almost the same row or column relative to the target. To address this issue, we propose a novel hybrid brain-computer interface (BCI) approach by incorporating the steady-state visual evoked potential (SSVEP) into the conventional P300 paradigm. APPROACH We designed a periodic stimuli mechanism and superimposed it onto the P300 stimuli to increase the difference between the symbols in the same row or column. Furthermore, we integrated the random flashings and periodic flickers to simultaneously evoke the P300 and SSVEP, respectively. Finally, we developed a hybrid detection mechanism based on the P300 and SSVEP in which the target symbols are detected by the fusion of three-dimensional, time-frequency features. MAIN RESULTS The results obtained from 12 healthy subjects show that an online classification accuracy of 93.85% and information transfer rate of 56.44 bit/min were achieved using the proposed BCI speller in only a single trial. Specifically, 5 of the 12 subjects exhibited an information transfer rate of 63.56 bit/min with an accuracy of 100%. SIGNIFICANCE The pilot studies suggested that the proposed BCI speller could achieve a better and more stable system performance compared with the conventional P300 speller, and it is promising for achieving quick spelling in stimulus-driven BCI applications.

[1]  Fanglin Chen,et al.  Reconstructing Orientation Field From Fingerprint Minutiae to Improve Minutiae-Matching Accuracy , 2009, IEEE Transactions on Image Processing.

[2]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  R. Heuser Surprise, surprise , 2014, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[5]  G R Müller-Putz,et al.  Toward smarter BCIs: extending BCIs through hybridization and intelligent control , 2012, Journal of neural engineering.

[6]  Yanda Li,et al.  Automatic removal of the eye blink artifact from EEG using an ICA-based template matching approach , 2006, Physiological measurement.

[7]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[8]  J. Schmee An Introduction to Multivariate Statistical Analysis , 1986 .

[9]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[10]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Improving Human Performance , 2011, PloS one.

[11]  Ivan Volosyak,et al.  SSVEP-based Bremen–BCI interface—boosting information transfer rates , 2011, Journal of neural engineering.

[12]  Brendan Z. Allison,et al.  Improved signal processing approaches in an offline simulation of a hybrid brain–computer interface , 2010, Journal of Neuroscience Methods.

[13]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[14]  E W Sellers,et al.  Suppressing flashes of items surrounding targets during calibration of a P300-based brain–computer interface improves performance , 2011, Journal of neural engineering.

[15]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[16]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[17]  Junfeng Gao,et al.  Online Removal of Muscle Artifact from Electroencephalogram Signals Based on Canonical Correlation Analysis , 2010, Clinical EEG and neuroscience.

[18]  Yuanqing Li,et al.  Target Selection With Hybrid Feature for BCI-Based 2-D Cursor Control , 2012, IEEE Transactions on Biomedical Engineering.

[19]  Jonathan R Wolpaw,et al.  Special issue containing contributions from the Fourth International Brain-Computer Interface Meeting. , 2011, Journal of neural engineering.

[20]  Nader Pouratian,et al.  Natural language processing with dynamic classification improves P300 speller accuracy and bit rate , 2012, Journal of neural engineering.

[21]  Fusheng Yang,et al.  BCI competition 2003-data set IIb: enhancing P300 wave detection using ICA-based subspace projections for BCI applications , 2004, IEEE Transactions on Biomedical Engineering.

[22]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Francisco Sepulveda,et al.  Perceptual errors in the Farwell and Donchin matrix speller , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[24]  M. Castelo‐Branco,et al.  Comparison of a row-column speller vs. a novel lateral single-character speller: Assessment of BCI for severe motor disabled patients , 2012, Clinical Neurophysiology.

[25]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[26]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[27]  Yijun Wang,et al.  A high-speed BCI based on code modulation VEP , 2011, Journal of neural engineering.

[28]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[29]  Bart Vanrumste,et al.  Validation of ICA as a tool to remove eye movement artifacts from EEG/ERP. , 2010, Psychophysiology.

[30]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[31]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[32]  Tobias Kaufmann,et al.  Beyond maximum speed—a novel two-stimulus paradigm for brain–computer interfaces based on event-related potentials (P300-BCI) , 2014, Journal of neural engineering.

[33]  R. Fazel-Rezai,et al.  Human Error in P300 Speller Paradigm for Brain-Computer Interface , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[34]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[35]  Christa Neuper,et al.  Impact of auditory distraction on user performance in a brain–computer interface driven by different mental tasks , 2011, Clinical Neurophysiology.

[36]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[37]  N. Kanwisher Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[38]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[39]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[40]  Wolfgang Rosenstiel,et al.  Online Adaptation of a c-VEP Brain-Computer Interface(BCI) Based on Error-Related Potentials and Unsupervised Learning , 2012, PloS one.

[41]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[42]  Eric W. Sellers,et al.  A general P300 brain–computer interface presentation paradigm based on performance guided constraints , 2012, Neuroscience Letters.