Hybrid-BCI: Classification of auditory and visual related potentials

The brain computer interface (BCI) is a technology that utilizes neurophysiological signals recorded from brain to control external machines or computers, and has become widespread in the last decade due to technical and mechanical developments. A P300-based BCI, often called P300 speller, is one of the most successful paradigm, which has shown advantages in terms of high accuracy and short training time. However, the existing P300-based BCI employs single type of external stimuli, such as visual stimuli, which limits their application domains. In this paper, we propose a hybrid-BCI system based on multiple modality of P300 evoked by simultaneous auditory and visual stimuli. The experimental results show the significant difference in ERPs between visual stimuli and multiple types of stimuli. The classification results demonstrate the effectiveness of our new BCI paradigm, which outperforms the visual P300 in terms of higher accuracy.

[1]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[2]  G. Vanacker,et al.  Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[3]  Wolfgang Rosenstiel,et al.  Control of an Internet Browser Using the P300 Event- Related Potential , 2008 .

[4]  Urbano Nunes,et al.  A Wheelchair Steered through Voice Commands and Assisted by a Reactive Fuzzy-Logic Controller , 2002, J. Intell. Robotic Syst..

[5]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[7]  Christa Neuper,et al.  An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate , 2004, IEEE Transactions on Biomedical Engineering.

[8]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[10]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[11]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[13]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.