Control or non-control state: that is the question! An asynchronous visual P300-based BCI approach

OBJECTIVE Brain-computer interfaces (BCI) based on event-related potentials (ERP) were proven to be a reliable synchronous communication method. For everyday life situations, however, this synchronous mode is impractical because the system will deliver a selection even if the user is not paying attention to the stimulation. So far, research into attention-aware visual ERP-BCIs (i.e., asynchronous ERP-BCIs) has led to variable success. In this study, we investigate new approaches for detection of user engagement. APPROACH Classifier output and frequency-domain features of electroencephalogram signals as well as the hybridization of them were used to detect the user's state. We tested their capabilities for state detection in different control scenarios on offline data from 21 healthy volunteers. MAIN RESULTS The hybridization of classifier output and frequency-domain features outperformed the results of the single methods, and allowed building an asynchronous P300-based BCI with an average correct state detection accuracy of more than 95%. SIGNIFICANCE Our results show that all introduced approaches for state detection in an asynchronous P300-based BCI can effectively avoid involuntary selections, and that the hybrid method is the most effective approach.

[1]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[2]  F Babiloni,et al.  P300-based brain–computer interface for environmental control: an asynchronous approach , 2011, Journal of neural engineering.

[3]  Xingyu Wang,et al.  A new P300 stimulus presentation pattern for EEG-based spelling systems , 2010, Biomedizinische Technik. Biomedical engineering.

[4]  Hasan Ayaz,et al.  EEG band powers for characterizing user engagement in P300-BCI , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[5]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Helge J. Ritter,et al.  An Augmented-Reality Based Brain-Computer Interface for Robot Control , 2010, ICONIP.

[7]  Cuntai Guan,et al.  Asynchronous P300-Based Brain--Computer Interfaces: A Computational Approach With Statistical Models , 2008, IEEE Transactions on Biomedical Engineering.

[8]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[9]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[10]  Cornelia Herbert,et al.  Brain Painting: Usability testing according to the user-centered design in end users with severe motor paralysis , 2013, Artif. Intell. Medicine.

[11]  W. Pritchard Psychophysiology of P300. , 1981, Psychological bulletin.

[12]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[13]  Brendan Z. Allison,et al.  Comparison of Dry and Gel Based Electrodes for P300 Brain–Computer Interfaces , 2012, Front. Neurosci..

[14]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[15]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[16]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[17]  A. Hudspeth,et al.  The physics of hearing: fluid mechanics and the active process of the inner ear , 2014, Reports on progress in physics. Physical Society.

[18]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[19]  L. Duartea,et al.  Development of a quasi-dry electrode for EEG recording , 2013 .

[20]  Brendan Z. Allison,et al.  Is It Significant? Guidelines for Reporting BCI Performance , 2012 .

[21]  Marcel Zeelenberg,et al.  Data analysis 2 , 2016 .

[22]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[23]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[24]  H. Ritter,et al.  Asynchronous, parallel on-line classification of P300 and ERD for an efficient hybrid BCI , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[25]  Vera Kaiser,et al.  Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEG , 2010, Medical & Biological Engineering & Computing.

[26]  William J Tyler,et al.  A quantitative overview of biophysical forces impinging on neural function , 2013, Physical biology.

[27]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[28]  Hasan Ayaz,et al.  Detection of attention shift for asynchronous P300-based BCI , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Christa Neuper,et al.  Autocalibration and Recurrent Adaptation: Towards a Plug and Play Online ERD-BCI , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  João M. Nóbrega,et al.  Development of a quasi-dry electrode for EEG recording , 2013 .

[31]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.