Toward more intuitive brain–computer interfacing: classification of binary covert intentions using functional near-infrared spectroscopy

Abstract. In traditional brain–computer interface (BCI) studies, binary communication systems have generally been implemented using two mental tasks arbitrarily assigned to “yes” or “no” intentions (e.g., mental arithmetic calculation for “yes”). A recent pilot study performed with one paralyzed patient showed the possibility of a more intuitive paradigm for binary BCI communications, in which the patient’s internal yes/no intentions were directly decoded from functional near-infrared spectroscopy (fNIRS). We investigated whether such an “fNIRS-based direct intention decoding” paradigm can be reliably used for practical BCI communications. Eight healthy subjects participated in this study, and each participant was administered 70 disjunctive questions. Brain hemodynamic responses were recorded using a multichannel fNIRS device, while the participants were internally expressing “yes” or “no” intentions to each question. Different feature types, feature numbers, and time window sizes were tested to investigate optimal conditions for classifying the internal binary intentions. About 75% of the answers were correctly classified when the individual best feature set was employed (75.89% ±1.39 and 74.08% ±2.87 for oxygenated and deoxygenated hemoglobin responses, respectively), which was significantly higher than a random chance level (68.57% for p<0.001). The kurtosis feature showed the highest mean classification accuracy among all feature types. The grand-averaged hemodynamic responses showed that wide brain regions are associated with the processing of binary implicit intentions. Our experimental results demonstrated that direct decoding of internal binary intention has the potential to be used for implementing more intuitive and user-friendly communication systems for patients with motor disabilities.

[1]  Gert Pfurtscheller,et al.  Development, set-up and first results for a one-channel near-infrared spectroscopy system / Entwicklung, Aufbau und vorläufige Ergebnisse eines Einkanal- Nahinfrarot-Spektroskopie-Systems , 2008, Biomedizinische Technik. Biomedical engineering.

[2]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[3]  J. Decety The neurophysiological basis of motor imagery , 1996, Behavioural Brain Research.

[4]  B. Hjorth An on-line transformation of EEG scalp potentials into orthogonal source derivations. , 1975, Electroencephalography and clinical neurophysiology.

[5]  N Birbaumer,et al.  A binary spelling interface with random errors. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[7]  Jae Gwan Kim,et al.  Recent functional near infrared spectroscopy based brain computer interface systems: Developments, applications and challenges , 2014 .

[8]  Jinung An,et al.  Classification of frontal cortex haemodynamic responses during cognitive tasks using wavelet transforms and machine learning algorithms. , 2012, Medical engineering & physics.

[9]  Limsoon Wong,et al.  Using feature generation and feature selection for accurate prediction of translation initiation sites. , 2002, Genome informatics. International Conference on Genome Informatics.

[10]  T. Chau,et al.  Intersession Consistency of Single-Trial Classification of the Prefrontal Response to Mental Arithmetic and the No-Control State by NIRS , 2012, PloS one.

[11]  Martin Wolf,et al.  Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study , 2011, Journal of NeuroEngineering and Rehabilitation.

[12]  J. Pineda,et al.  Learning to control brain rhythms: making a brain-computer interface possible , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Chang-Hwan Im,et al.  Evaluation of various mental task combinations for near-infrared spectroscopy-based brain-computer interfaces , 2014, Journal of biomedical optics.

[14]  Cuntai Guan,et al.  Extracting effective features from high density nirs-based BCI for assessing numerical cognition , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[16]  Christa Neuper,et al.  Single-trial classification of antagonistic oxyhemoglobin responses during mental arithmetic , 2011, Medical & Biological Engineering & Computing.

[17]  C. A. Ruf,et al.  Brain communication in a completely locked-in patient using bedside near-infrared spectroscopy , 2014, Neurology.

[18]  Eiji Okada,et al.  Arranging optical fibres for the spatial resolution improvement of topographical images. , 2002, Physics in medicine and biology.

[19]  Chang-Hwan Im,et al.  EEG-Based Brain-Computer Interfaces: A Thorough Literature Survey , 2013, Int. J. Hum. Comput. Interact..

[20]  K. Müller,et al.  Predicting BCI performance to study BCI illiteracy , 2009, BMC Neuroscience.

[21]  T. Chau,et al.  Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface , 2009, Journal of NeuroEngineering and Rehabilitation.

[22]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[23]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[24]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[25]  Tom Chau,et al.  Automatic single-trial classification of prefrontal hemodynamic activity in an individual with Duchenne muscular dystrophy , 2013, Developmental neurorehabilitation.

[26]  R. Dolan,et al.  The role of the prefrontal cortex in higher cognitive functions. , 1996, Brain research. Cognitive brain research.

[27]  T. Chau,et al.  Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy , 2012, Journal of neural engineering.

[28]  P. Haggard Conscious intention and motor cognition , 2005, Trends in Cognitive Sciences.

[29]  Tom Chau,et al.  Decoding subjective preference from single-trial near-infrared spectroscopy signals , 2009, Journal of neural engineering.

[30]  J. Ushiba,et al.  Daily training with realistic visual feedback improves reproducibility of event-related desynchronisation following hand motor imagery , 2013, Clinical Neurophysiology.

[31]  Han-Jeong Hwang,et al.  Neurofeedback-based motor imagery training for brain–computer interface (BCI) , 2009, Journal of Neuroscience Methods.

[32]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[33]  Christa Neuper,et al.  Focal frontal (de)oxyhemoglobin responses during simple arithmetic. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  Cuntai Guan,et al.  A multimodal fNIRS and EEG-based BCI study on motor imagery and passive movement , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[35]  S. Arridge,et al.  Estimation of optical pathlength through tissue from direct time of flight measurement , 1988 .

[36]  T. Chau,et al.  Towards a system-paced near-infrared spectroscopy brain–computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state , 2011, Journal of neural engineering.

[37]  A. Kleinschmidt,et al.  Noninvasive Functional Imaging of Human Brain Using Light , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[38]  Keum-Shik Hong,et al.  Online binary decision decoding using functional near-infrared spectroscopy for the development of brain–computer interface , 2014, Experimental Brain Research.

[39]  Keum-Shik Hong,et al.  Improving classification accuracy of covert yes/no response decoding using support vector machines: An fNIRS study , 2014, 2014 International Conference on Robotics and Emerging Allied Technologies in Engineering (iCREATE).