A multimodal fNIRS and EEG-based BCI study on motor imagery and passive movement

In EEG-based motor imagery Brain-Computer interface (BCI), EEG data collected in the calibration phase is used as a subject-specific model to classify the EEG data in the evaluation phase. Previous study has shown the feasibility of calibrating EEG-based BCI from passive movement. This paper investigates the primary sensorimotor area activation from fNIRS on 4 subjects using multimodal NIRS and EEG-based BCI system while performing motor imagery and passive movement of the hand by a Haptic Knob robot. NIRS_SPM is used to compute the changes in hemoglobin response and to generate brain activation map based on the contrasts of motor imagery versus idle and passive movement versus idle. The results on the contrasts showed that passive movement versus idle yielded significant differences compared to motor imagery versus idle. In addition, the results of classifying the NIRS and EEG data separately also showed that the accuracies on classifying passive movement versus idle are better than that of motor imagery versus idle. The results suggest a potential of using passive movement data to calibrate motor imagery in a multimodal NIRS and EEG-based BCI.

[1]  Ryuta Kawashima,et al.  A NIRS-based brain-computer interface system during motor imagery: System development and online feedback training , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Cuntai Guan,et al.  Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs , 2012, Pattern Recognit..

[3]  Cuntai Guan,et al.  Extracting effective features from high density nirs-based BCI for assessing numerical cognition , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[5]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[6]  J. Palva,et al.  Phase Synchrony among Neuronal Oscillations in the Human Cortex , 2005, The Journal of Neuroscience.

[7]  J.P. Donoghue,et al.  BCI meeting 2005-workshop on clinical issues and applications , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  M. Arvaneh,et al.  Optimizing Spatial Filters by Minimizing Within-class Dissimilarities in EEG-based BCI , 2012 .

[9]  Cuntai Guan,et al.  Clinical study of neurorehabilitation in stroke using EEG-based motor imagery brain-computer interface with robotic feedback , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[10]  Cuntai Guan,et al.  Filter Bank Feature Combination (FBFC) approach for brain-computer interface , 2011, The 2011 International Joint Conference on Neural Networks.

[11]  Cuntai Guan,et al.  Calibrating EEG-based motor imagery brain-computer interface from passive movement , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[13]  Sungho Tak,et al.  NIRS-SPM: Statistical parametric mapping for near-infrared spectroscopy , 2009, NeuroImage.

[14]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[15]  Sungho Tak,et al.  Quantification of CMRO2 without hypercapnia using simultaneous near-infrared spectroscopy and fMRI measurements , 2010, Physics in medicine and biology.

[16]  Sungho Tak,et al.  Lipschitz-Killing curvature based expected Euler characteristics for p-value correction in fNIRS , 2012, Journal of Neuroscience Methods.

[17]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[18]  Sungho Tak,et al.  Quantitative Analysis of Hemodynamic and Metabolic Changes in Subcortical Vascular Dementia Using Simultaneous Near-infrared Spectroscopy and Fmri Measurements , 2022 .

[19]  Sungho Tak,et al.  Wavelet minimum description length detrending for near-infrared spectroscopy. , 2009, Journal of biomedical optics.

[20]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[21]  M. Herrmann,et al.  Cerebral oxygenation changes in the prefrontal cortex: Effects of age and gender , 2006, Neurobiology of Aging.

[22]  Cuntai Guan,et al.  Iterative clustering and support vectors-based high-confidence query selection for motor imagery EEG signals classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[23]  S R Arridge,et al.  The effect of optode positioning on optical pathlength in near infrared spectroscopy of brain. , 1990, Advances in experimental medicine and biology.

[24]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.