A combined brain–computer interface based on P300 potentials and motion-onset visual evoked potentials

Brain-computer interfaces (BCIs) allow users to communicate via brain activity alone. Many BCIs rely on the P300 and other event-related potentials (ERPs) that are elicited when target stimuli flash. Although there have been considerable research exploring ways to improve P300 BCIs, surprisingly little work has focused on new ways to change visual stimuli to elicit more recognizable ERPs. In this paper, we introduce a "combined" BCI based on P300 potentials and motion-onset visual evoked potentials (M-VEPs) and compare it with BCIs based on each simple approach (P300 and M-VEP). Offline data suggested that performance would be best in the combined paradigm. Online tests with adaptive BCIs confirmed that our combined approach is practical in an online BCI, and yielded better performance than the other two approaches (P<0.05) without annoying or overburdening the subject. The highest mean classification accuracy (96%) and practical bit rate (26.7bit/s) were obtained from the combined condition.

[1]  Emanuel Donchin,et al.  A P 300-based brain – computer interface : Initial tests by ALS patients Eric , 2006 .

[2]  H. Semlitsch,et al.  A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. , 1986, Psychophysiology.

[3]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[4]  Xingyu Wang,et al.  A new P300 stimulus presentation pattern for EEG-based spelling systems , 2010, Biomedizinische Technik. Biomedical engineering.

[5]  Hiroshi Doi,et al.  Modulation of event-related potentials in normal human subjects by visual divided attention to spatial and color factors , 2001, Neuroscience Letters.

[6]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[7]  F. A. Miles,et al.  Human ocular following: evidence that responses to large-field stimuli are limited by local and global inhibitory influences. , 2008, Progress in Brain Research.

[8]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[9]  Luca T. Mainardi,et al.  Online Detection of P300 and Error Potentials in a BCI Speller , 2010, Comput. Intell. Neurosci..

[10]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[11]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[12]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[13]  Fernando Lopes da Silva,et al.  Comprar Niedermeyer's Electroencephalography, 6/e (Basic Principles, Clinical Applications, and Related Fields ) | Fernando Lopes Da Silva | 9780781789424 | Lippincott Williams & Wilkins , 2010 .

[14]  Xingyu Wang,et al.  P300 Chinese input system based on Bayesian LDA , 2010, Biomedizinische Technik. Biomedical engineering.

[15]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[16]  B.Z. Allison,et al.  ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[18]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[19]  David B. Ryan,et al.  Improving Brain-Computer Interface Performance: Giving the P300 Speller Some Color. , 2011 .

[20]  Matthias M. Müller,et al.  Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention , 2000, Clinical Neurophysiology.

[21]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[22]  Ben H. Jansen,et al.  An exploratory study of factors affecting single trial P300 detection , 2004, IEEE Transactions on Biomedical Engineering.

[23]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[24]  Y. Nakajima,et al.  Visual stimuli for the P300 brain–computer interface: A comparison of white/gray and green/blue flicker matrices , 2009, Clinical Neurophysiology.

[25]  Clemens Brunner,et al.  An adaptive P 300-based control system , 2011 .

[26]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[27]  Benjamin Blankertz,et al.  A novel brain-computer interface based on the rapid serial visual presentation paradigm , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[28]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[29]  I. P. Ganin,et al.  Event-related potentials in a moving matrix modification of the P300 brain–computer interface paradigm , 2011, Neuroscience Letters.

[30]  Xiaorong Gao,et al.  A brain–computer interface using motion-onset visual evoked potential , 2008, Journal of neural engineering.

[31]  Mitchell Valdes-Sosa,et al.  Visual evoked potentials related to motion-onset are modulated by attention , 1999, Vision Research.

[32]  S M M Martens,et al.  Overlap and refractory effects in a brain–computer interface speller based on the visual P300 event-related potential , 2009, Journal of neural engineering.

[33]  Gastone G. Celesia,et al.  Visual evoked potentials and electroretinograms , 2012 .

[34]  Brendan Z. Allison,et al.  A hybrid ERD/SSVEP BCI for continuous simultaneous two dimensional cursor control , 2012, Journal of Neuroscience Methods.

[35]  Guillaume S. Masson,et al.  Dynamics of distributed 1D and 2D motion representations for short-latency ocular following , 2008, Vision Research.

[36]  A. Jedynak,et al.  Scalp distribution components of brain activity evoked by visual motion stimuli , 1998, Experimental Brain Research.

[37]  T. Demiralp,et al.  Time–frequency analysis reveals multiple functional components during oddball P300 , 1997, Neuroreport.

[38]  Ping Yang,et al.  An Empirical Bayesian Framework for Brain–Computer Interfaces , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[40]  F. Windmeijer,et al.  An R-squared measure of goodness of fit for some common nonlinear regression models , 1997 .

[41]  Shangkai Gao,et al.  An online brain–computer interface using non-flashing visual evoked potentials , 2010, Journal of neural engineering.

[42]  D. Regan.  Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[43]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[44]  Dennis J. McFarland,et al.  The P300-based brain–computer interface (BCI): Effects of stimulus rate , 2011, Clinical Neurophysiology.

[45]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[46]  R. Fazel-Rezai,et al.  Human Error in P300 Speller Paradigm for Brain-Computer Interface , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  J. Polich,et al.  P3a from Visual Stimuli: Typicality, Task, and Topography , 2004, Brain Topography.

[48]  A. Kübler,et al.  Training locked-in patients: a challenge for the use of brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  P.R. Kennedy,et al.  A decision tree for brain-computer interface devices , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[51]  E W Sellers,et al.  Suppressing flashes of items surrounding targets during calibration of a P300-based brain–computer interface improves performance , 2011, Journal of neural engineering.