Common spatial pattern and wavelet decomposition for motor imagery EEG- fTCD brain-computer interface

BACKGROUND Recently, hybrid brain-computer interfaces (BCIs) combining more than one modality have been investigated with the aim of boosting the performance of the existing single-modal BCIs in terms of accuracy and information transfer rate (ITR). Previously, we introduced a novel hybrid BCI in which EEG and fTCD modalities are used simultaneously to measure electrical brain activity and cerebral blood velocity during motor imagery (MI) tasks. NEW METHOD In this paper, we used multi-scale analysis and common spatial pattern algorithm to extract EEG and fTCD features. Moreover, we proposed probabilistic fusion of EEG and fTCD evidences instead of concatenating EEG and fTCD feature vectors corresponding to each trial. A Bayesian approach was proposed to fuse EEG and fTCD evidences under 3 different assumptions. RESULTS Experimental results showed that 93.85%, 93.71%, and 100% average accuracies and 19.89, 26.55, and 40.83 bits/min average ITRs were achieved for right MI vs baseline, left MI versus baseline, and right MI versus left MI respectively. COMPARISON WITH EXISTING METHODS These performance measures outperformed the results we obtained before in our preliminary study in which average accuracies of 88.33%, 89.48%, and 82.38% and average ITRs of 4.17, 5.45, and 10.57 bits/min were achieved for right MI versus baseline, left MI versus baseline, and right MI versus left MI respectively. Moreover, in terms of both accuracy and speed, the EEG- fTCD BCI with the proposed analysis techniques outperformed all EEG- fNIRS studies in comparison. CONCLUSIONS The proposed system is a more accurate and faster alternative to EEG-fNIRS systems.

[1]  Alexander A. Fingelkurts,et al.  Nonstationary nature of the brain activity as revealed by EEG/MEG: Methodological, practical and conceptual challenges , 2005, Signal Process..

[2]  Stephanie Brandl,et al.  Bringing BCI into everyday life: Motor imagery in a pseudo realistic environment , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[3]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  Manfred Kaps,et al.  Practice Standards for Transcranial Doppler Ultrasound: Part I—Test Performance , 2007, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[5]  Yuanqing Li,et al.  An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface , 2014, Cognitive Neurodynamics.

[6]  Stephan Waldert,et al.  Invasive vs. Non-Invasive Neuronal Signals for Brain-Machine Interfaces: Will One Prevail? , 2016, Front. Neurosci..

[7]  Sung Chan Jun,et al.  A Review of Brain-Computer Interface Games and an Opinion Survey from Researchers, Developers and Users , 2014, Sensors.

[8]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[9]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[10]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[11]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[12]  Hasan Onur Keles,et al.  Hybrid EEG-fNIRS Asynchronous Brain-Computer Interface for Multiple Motor Tasks , 2016, PloS one.

[13]  Keum Shik Hong,et al.  Hybrid Brain–Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review , 2017, Front. Neurorobot..

[14]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[15]  Yunfa Fu,et al.  A hybrid BCI based on EEG and fNIRS signals improves the performance of decoding motor imagery of both force and speed of hand clenching , 2015, Journal of neural engineering.

[16]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[17]  Mohd Yamani Idna Idris,et al.  Using finite state machine and a hybrid of EEG signal and EOG artifacts for an asynchronous wheelchair navigation , 2015, Expert Syst. Appl..

[18]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[19]  Tanja Schultz,et al.  Hybrid fNIRS-EEG based classification of auditory and visual perception processes , 2014, Front. Neurosci..

[20]  Xiaogang Chen,et al.  An online hybrid BCI system based on SSVEP and EMG , 2016, Journal of neural engineering.

[21]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[22]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[23]  Murat Akcakaya,et al.  Towards optimal visual presentation design for hybrid EEG-fTCD brain-computer interfaces. , 2018, Journal of neural engineering.

[24]  T. Ward,et al.  Brain computer interfaces for neurorehabilitation – its current status as a rehabilitation strategy post-stroke. , 2015, Annals of physical and rehabilitation medicine.

[25]  Byoung-Kyong Min,et al.  Neuroimaging-based approaches in the brain-computer interface. , 2010, Trends in biotechnology.

[26]  J. J. Higgins,et al.  A Comparison of the Power of Wilcoxon's Rank-Sum Statistic to that of Student'st Statistic Under Various Nonnormal Distributions , 1980 .

[27]  Murat Akcakaya,et al.  A novel motor imagery hybrid brain computer interface using EEG and functional transcranial Doppler ultrasound , 2019, Journal of Neuroscience Methods.

[28]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[29]  Moritz Grosse-Wentrup,et al.  Beamforming in Noninvasive Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[30]  Keum-Shik Hong,et al.  Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface , 2014, Front. Hum. Neurosci..

[31]  Anatole Lécuyer,et al.  How to Build a Hybrid Neurofeedback Platform Combining EEG and fMRI , 2017, Front. Neurosci..

[32]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[33]  Murat Akcakaya,et al.  A brain-computer interface based on functional transcranial doppler ultrasound using wavelet transform and support vector machines , 2018, Journal of Neuroscience Methods.

[34]  Yijun Wang,et al.  Common Spatial Pattern Method for Channel Selelction in Motor Imagery Based Brain-computer Interface , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[35]  D F Hanley,et al.  Validation of transcranial Doppler ultrasound with a stereotactic neurosurgical technique. , 1995, Journal of neurosurgery.

[36]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[37]  A. Kübler,et al.  Training locked-in patients: a challenge for the use of brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  Bin He,et al.  Brain-Computer Interface Control in a Virtual Reality Environment and Applications for the Internet of Things , 2018, IEEE Access.

[39]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[40]  Jae Gwan Kim,et al.  Recent functional near infrared spectroscopy based brain computer interface systems: Developments, applications and challenges , 2014 .

[41]  R. Vlek,et al.  Combined EEG-fNIRS Decoding of Motor Attempt and Imagery for Brain Switch Control: An Offline Study in Patients With Tetraplegia , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[43]  G. Pfurtscheller,et al.  Information transfer rate in a five-classes brain-computer interface , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  M. Tsolaki,et al.  EEG-Based Brain–Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A Novel Approach of the 21st Century , 2018, Front. Hum. Neurosci..

[45]  Klaus-Robert Müller,et al.  Evaluation of a Compact Hybrid Brain-Computer Interface System , 2017, BioMed research international.

[46]  Seungjin Choi,et al.  A hybrid NIRS-EEG system for self-paced brain computer interface with online motor imagery , 2015, Journal of Neuroscience Methods.