Near-infrared spectroscopy (NIRS)-based eyes-closed brain-computer interface (BCI) using prefrontal cortex activation due to mental arithmetic

We propose a near-infrared spectroscopy (NIRS)-based brain-computer interface (BCI) that can be operated in eyes-closed (EC) state. To evaluate the feasibility of NIRS-based EC BCIs, we compared the performance of an eye-open (EO) BCI paradigm and an EC BCI paradigm with respect to hemodynamic response and classification accuracy. To this end, subjects performed either mental arithmetic or imagined vocalization of the English alphabet as a baseline task with very low cognitive loading. The performances of two linear classifiers were compared; resulting in an advantage of shrinkage linear discriminant analysis (LDA). The classification accuracy of EC paradigm (75.6 ± 7.3%) was observed to be lower than that of EO paradigm (77.0 ± 9.2%), which was statistically insignificant (p = 0.5698). Subjects reported they felt it more comfortable (p = 0.057) and easier (p < 0.05) to perform the EC BCI tasks. The different task difficulty may become a cause of the slightly lower classification accuracy of EC data. From the analysis results, we could confirm the feasibility of NIRS-based EC BCIs, which can be a BCI option that may ultimately be of use for patients who cannot keep their eyes open consistently.

[1]  Stefan Haufe,et al.  Multivariate Machine Learning Methods for Fusing Multimodal Functional Neuroimaging Data , 2015, Proceedings of the IEEE.

[2]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[3]  Tanja Schultz,et al.  Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS , 2014, Front. Hum. Neurosci..

[4]  J. Wolpaw,et al.  A practical, intuitive brain–computer interface for communicating ‘yes’ or ‘no’ by listening , 2014, Journal of neural engineering.

[5]  Mohamad Sawan,et al.  Functional near-infrared spectroscopy caps for brain activity monitoring: a review , 2015 .

[6]  J. Friedman.  Regularized Discriminant Analysis , 1989 .

[7]  C Neuper,et al.  Spatio-temporal differences in brain oxygenation between movement execution and imagery: a multichannel near-infrared spectroscopy study. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[9]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[10]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[11]  S. Gielen,et al.  The brain–computer interface cycle , 2009, Journal of neural engineering.

[12]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[13]  Duane F. Bruley,et al.  Oxygen transport to tissue , 1973 .

[14]  Y. Istefanopulos,et al.  IEEE Engineering in Medicine and Biology Society , 2019, IEEE Transactions on Biomedical Engineering.

[15]  Christa Neuper,et al.  Focal frontal (de)oxyhemoglobin responses during simple arithmetic. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[17]  Tomohiro Ishizu,et al.  Effects of motor imagery on intermanual transfer: A near-infrared spectroscopy and behavioural study , 2010, Brain Research.

[18]  Keum-Shik Hong,et al.  Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface , 2013, Neuroscience Letters.

[19]  T. Chau,et al.  Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy , 2012, Journal of neural engineering.

[20]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[21]  C. A. Ruf,et al.  Brain communication in a completely locked-in patient using bedside near-infrared spectroscopy , 2014, Neurology.

[22]  B. Blankertz,et al.  A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue , 2010, PloS one.

[23]  T. Chau,et al.  Towards a system-paced near-infrared spectroscopy brain–computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state , 2011, Journal of neural engineering.

[24]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[25]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[26]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[27]  Cathy J. Price,et al.  Sensory-to-motor integration during auditory repetition: a combined fMRI and lesion study , 2014, Front. Hum. Neurosci..

[28]  A. Kübler,et al.  Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials , 2014, Journal of NeuroEngineering and Rehabilitation.

[29]  Martin Wolf,et al.  Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study , 2011, Journal of NeuroEngineering and Rehabilitation.

[30]  Mike E. Davies,et al.  IEEE International Conference on Acoustics Speech and Signal Processing , 2008 .

[31]  T. Falk,et al.  Taking NIRS-BCIs Outside the Lab: Towards Achieving Robustness Against Environment Noise , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Chang-Hwan Im,et al.  Classification of selective attention to auditory stimuli: Toward vision-free brain–computer interfacing , 2011, Journal of Neuroscience Methods.

[33]  Marco Ferrari,et al.  A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application , 2012, NeuroImage.

[34]  K. Jellinger.  Toward Brain-Computer Interfacing , 2009 .

[35]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[36]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[37]  K. Kubota,et al.  Neurofeedback Using Real-Time Near-Infrared Spectroscopy Enhances Motor Imagery Related Cortical Activation , 2012, PloS one.

[38]  Chang-Hwan Im,et al.  Classification of binary intentions for individuals with impaired oculomotor function: 'eyes-closed' SSVEP-based brain-computer interface (BCI). , 2013, Journal of neural engineering.

[39]  Y. Kim,et al.  Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI , 2015, Neuroscience Letters.

[40]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[41]  Klaus-Robert Müller,et al.  Machine-Learning-Based Coadaptive Calibration for Brain-Computer Interfaces , 2011, Neural Computation.

[42]  F. Jöbsis.  Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. , 1977, Science.

[43]  Sarah D Power,et al.  Automatic single-trial discrimination of mental arithmetic, mental singing and the no-control state from prefrontal activity: toward a three-state NIRS-BCI , 2012, BMC Research Notes.

[44]  Klaus-Robert Müller,et al.  Ensembles of adaptive spatial filters increase BCI performance: an online evaluation , 2016, Journal of neural engineering.

[45]  M. Tamura,et al.  Dynamic multichannel near-infrared optical imaging of human brain activity. , 1993, Journal of applied physiology.

[46]  I. Miyai,et al.  Near-infrared Spectroscopy–mediated Neurofeedback Enhances Efficacy of Motor Imagery–based Training in Poststroke Victims: A Pilot Study , 2013, Stroke.

[47]  Michael Tangermann,et al.  Towards User-Friendly Spelling with an Auditory Brain-Computer Interface: The CharStreamer Paradigm , 2014, PloS one.

[48]  Febo Cincotti,et al.  Towards Noninvasive Hybrid Brain–Computer Interfaces: Framework, Practice, Clinical Application, and Beyond , 2015, Proceedings of the IEEE.

[49]  Peter Desain,et al.  Introducing the tactile speller: an ERP-based brain–computer interface for communication , 2012, Journal of neural engineering.

[50]  D. Ulrich,et al.  A Gaze Independent Brain-Computer Interface Based on Visual Stimulation through Closed Eyelids , 2015, Scientific Reports.

[51]  Mark S. Cohen,et al.  Simultaneous EEG and fMRI of the alpha rhythm , 2002, Neuroreport.

[52]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[53]  Keum-Shik Hong,et al.  Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface , 2014, Front. Hum. Neurosci..

[54]  Ivo Käthner,et al.  An auditory multiclass brain-computer interface with natural stimuli: Usability evaluation with healthy participants and a motor impaired end user , 2015, Front. Hum. Neurosci..

[55]  T. Chau,et al.  Intersession Consistency of Single-Trial Classification of the Prefrontal Response to Mental Arithmetic and the No-Control State by NIRS , 2012, PloS one.

[56]  Seungjin Choi,et al.  A hybrid NIRS-EEG system for self-paced brain computer interface with online motor imagery , 2015, Journal of Neuroscience Methods.