An Improved Visual-Tactile P300 Brain Computer Interface

Recently, the bimodal BCI has attracted more and more attention. Previous studies have reported that the classification performance of bimodal system was better than that of unimodal system. Based on the fundamental visual-tactile P300 BCI, this paper made a change on the flash pattern of visual stimuli expecting to improve its performance by enhancing the link between visual and tactile modalities. Two patterns were tested in this paper, which respectively were picture-vibrate pattern (producing the visual effect of vibration) and color-change pattern (changing blue to green). The results showed that the picture-vibrate pattern achieved higher classification accuracy and information transfer rate than color-change pattern. The average online bit rate of picture-vibrate pattern including the breaking time between selections, reached 12.49 bits/min, while the color-change pattern’s online bit rate reached 8.87 bits/min on average.

[1]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[2]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[3]  Bernhard Schölkopf,et al.  An Auditory Paradigm for Brain-Computer Interfaces , 2004, NIPS.

[4]  F. Babiloni,et al.  Multimodal stimulation for a P300-based BCI , 2007 .

[5]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[6]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[7]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[8]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[9]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[10]  Febo Cincotti,et al.  Tactile, Visual, and Bimodal P300s: Could Bimodal P300s Boost BCI Performance? , 2010 .

[11]  Peter Desain,et al.  Introducing the tactile speller: an ERP-based brain–computer interface for communication , 2012, Journal of neural engineering.

[12]  Shoji Makino,et al.  Multi-command Chest Tactile Brain Computer Interface for Small Vehicle Robot Navigation , 2013, Brain and Health Informatics.

[13]  Tobias Kaufmann,et al.  Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state , 2013, Front. Neurosci..

[14]  Quentin Noirhomme,et al.  Performance of a tactile P300 speller for healthy people and severely disabled patients , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  A. Kübler,et al.  Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials , 2014, Journal of NeuroEngineering and Rehabilitation.

[16]  Marieke E. Thurlings,et al.  Gaze-independent ERP-BCIs: augmenting performance through location-congruent bimodal stimuli , 2014, Front. Syst. Neurosci..

[17]  Xingyu Wang,et al.  An ERP-Based BCI using an oddball Paradigm with Different Faces and Reduced errors in Critical Functions , 2014, Int. J. Neural Syst..

[18]  M. Taubert,et al.  A sound children's mind in a healthy children's body , 2014, Front. Neurosci..

[19]  Tomasz M. Rutkowski,et al.  Tactile and bone-conduction auditory brain computer interface for vision and hearing impaired users , 2014, Journal of Neuroscience Methods.

[20]  Xingyu Wang,et al.  A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm , 2015, Int. J. Neural Syst..

[21]  Andrea Kübler,et al.  Wheelchair control by elderly participants in a virtual environment with a brain-computer interface (BCI) and tactile stimulation , 2016, Biological Psychology.

[22]  Rami Saab,et al.  An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface , 2016, Int. J. Neural Syst..