A Novel Three-Dimensional P300 Speller Based on Stereo Visual Stimuli

Goal: P300 spellers are among the most popular types of brain–computer interfaces (BCIs) and are extremely useful assistive devices that enable severely disabled patients to communicate. However, P300 speller performances should be further improved to translate laboratory designs into practical applications. We aimed to design a new speller paradigm that could evoke higher event-related potentials (ERPs) than traditional P300 spellers, thus improving the performance of BCI systems. Methods: We proposed a new P300 speller paradigm based on three-dimensional (3-D) stereo visual stimuli. In this paradigm, flashing buttons are presented in 3-D stereo form. We designed two experiments, one that tested a traditional two-dimensional (2-D) speller and another that tested the proposed 3-D speller. Twelve healthy volunteers participated in our experiments. We compared the ERPs elicited by the 2-D speller and the 3-D speller, and we also compared the classification accuracy, information transfer rate (ITR), and user workload between the two paradigms. Results: The 3-D P300 speller elicited higher amplitudes of P300 waveforms than the traditional 2-D P300 speller. The online experimental results showed that the classification accuracy and the ITR were significantly improved with the 3-D P300 speller. We also found that the user workload of the 3-D P300 speller was significantly lower than that of the 2-D P300 speller. Conclusion : The proposed 3-D P300 speller based on stereo visual stimuli outperformed a traditional 2-D P300 speller. This finding indicates that our 3-D paradigm offers a new method that will improve the performance of P300 BCI systems.

[1]  Heba Lakany,et al.  Human Behavior Integration Improves Classification Rates in Real-Time BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  Yuanqing Li,et al.  A Novel Audiovisual Brain-Computer Interface and Its Application in Awareness Detection , 2015, Scientific Reports.

[4]  Chin-Teng Lin,et al.  Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[6]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[7]  Christian Jutten,et al.  Beyond 2D for Brain-Computer interfaces: Two 3D extensions of the P300-Speller , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Thierry Pun,et al.  Analysis of bit-rate definitions for Brain-Computer Interfaces , 2005, CSREA HCI.

[9]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  F Cincotti,et al.  Workload measurement in a communication application operated through a P300-based brain–computer interface , 2011, Journal of neural engineering.

[11]  Cuntai Guan,et al.  High performance P300 speller for brain-computer interface , 2004, IEEE International Workshop on Biomedical Circuits and Systems, 2004..

[12]  Vera Kaiser,et al.  Thinking Penguin: Multimodal Brain–Computer Interface Control of a VR Game , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[13]  Scott T. Grafton,et al.  Response to Comment on "Wandering Minds: The Default Network and Stimulus-Independent Thought" , 2007, Science.

[14]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[15]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[16]  Gert Pfurtscheller,et al.  Self-paced exploration of the Austrian National Library through thought , 2007 .

[17]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[18]  Rami Saab,et al.  A Hybrid Brain–Computer Interface Based on the Fusion of P300 and SSVEP Scores , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[20]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[21]  A. Cichocki,et al.  An optimized ERP brain–computer interface based on facial expression changes , 2014, Journal of neural engineering.

[22]  Yuanqing Li,et al.  Surfing the internet with a BCI mouse , 2012, Journal of neural engineering.

[23]  Xiaorong Gao,et al.  A brain–computer interface using motion-onset visual evoked potential , 2008, Journal of neural engineering.

[24]  Steven Laureys,et al.  Detecting number processing and mental calculation in patients with disorders of consciousness using a hybrid brain-computer interface system , 2015, BMC Neurology.

[25]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[26]  Rami Saab,et al.  An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface , 2016, Int. J. Neural Syst..

[27]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[28]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[29]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[30]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[31]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[32]  Reza Fazel-Rezai,et al.  A region-based P300 speller for brain-computer interface , 2009, Canadian Journal of Electrical and Computer Engineering.

[33]  Marc M. Van Hulle,et al.  Comparison of Classification Methods for P300 Brain-Computer Interface on Disabled Subjects , 2011, Comput. Intell. Neurosci..