A hybrid BCI study: Temporal optimization for EEG single-trial classification by exploring hemodynamics from the simultaneously measured NIRS data

In this paper we introduced a new method to optimally select the time window for a single-trial classification problem in BCI system. As a hybrid-BCI, we combine EEG and NIRS signals to improve the performance of BCI system. Since there's a coupled relationship between EEG and NIRS, we try to define the activation state of subject's brain according to the changes of hemoglobin. We therefore defined the maximum point of HbO changes to be the time when the brain was fully activated. Then we chose the EEG data according to this critical time point with a 3 s window, which is almost within 6-9s according to the NIRS signal. With this selected time window, there is a significantly improvement of decoding accuracy from 69% to 79% compared to the original time window (1-12 s).

[1]  Andrzej Cichocki,et al.  Bimodal BCI Using Simultaneously NIRS and EEG , 2014, IEEE Transactions on Biomedical Engineering.

[2]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[3]  Hellmuth Obrig,et al.  A wearable multi-channel fNIRS system for brain imaging in freely moving subjects , 2014, NeuroImage.

[4]  A. Eke,et al.  The modified Beer–Lambert law revisited , 2006, Physics in medicine and biology.

[5]  Vera Kaiser,et al.  Cortical effects of user training in a motor imagery based brain–computer interface measured by fNIRS and EEG , 2014, NeuroImage.

[6]  Martin Wolf,et al.  Progress of near-infrared spectroscopy and topography for brain and muscle clinical applications. , 2007, Journal of biomedical optics.

[7]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[8]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[9]  Cuntai Guan,et al.  Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs , 2012, Pattern Recognit..

[10]  Robert Schmitt,et al.  Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection , 2004, NeuroImage.

[11]  Brendan Z. Allison,et al.  Journal of Neuroscience Methods , 2022 .

[12]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[13]  Jianjun Meng,et al.  Selective Sensation Based Brain-Computer Interface via Mechanical Vibrotactile Stimulation , 2013, PloS one.

[14]  M. Wolf,et al.  Wireless miniaturized in-vivo near infrared imaging. , 2008, Optics express.

[15]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[16]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[17]  Robert Riener,et al.  Detection of motor execution using a hybrid fNIRS-biosignal BCI: a feasibility study , 2013, Journal of NeuroEngineering and Rehabilitation.