Evaluation of various mental task combinations for near-infrared spectroscopy-based brain-computer interfaces

Abstract. A number of recent studies have demonstrated that near-infrared spectroscopy (NIRS) is a promising neuroimaging modality for brain-computer interfaces (BCIs). So far, most NIRS-based BCI studies have focused on enhancing the accuracy of the classification of different mental tasks. In the present study, we evaluated the performances of a variety of mental task combinations in order to determine the mental task pairs that are best suited for customized NIRS-based BCIs. To this end, we recorded event-related hemodynamic responses while seven participants performed eight different mental tasks. Classification accuracies were then estimated for all possible pairs of the eight mental tasks (C82=28). Based on this analysis, mental task combinations with relatively high classification accuracies frequently included the following three mental tasks: “mental multiplication,” “mental rotation,” and “right-hand motor imagery.” Specifically, mental task combinations consisting of two of these three mental tasks showed the highest mean classification accuracies. It is expected that our results will be a useful reference to reduce the time needed for preliminary tests when discovering individual-specific mental task combinations.

[1]  Andrei V. Medvedev,et al.  Does the resting state connectivity have hemispheric asymmetry? A near-infrared spectroscopy study , 2014, NeuroImage.

[2]  A. Kleinschmidt,et al.  Noninvasive Functional Imaging of Human Brain Using Light , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[3]  Klaus-Robert Müller,et al.  Estimating Noise and Dimensionality in BCI Data Sets : Towards Illiteracy Comprehension , 2008 .

[4]  Kaoru Sakatani,et al.  Near-infrared spectroscopy studies on cerebral blood oxygenation changes during brain activation: possible limitations of blood oxygenation level dependent functional magnetic resonance imaging , 2001 .

[5]  T. Chau,et al.  Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface , 2009, Journal of NeuroEngineering and Rehabilitation.

[6]  Gea Drost,et al.  Clinical applications of high-density surface EMG: a systematic review. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[7]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[8]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[9]  Akihiro Ishikawa,et al.  Fast (100–175 ms) components elicited bilaterally by language production as measured by three-wavelength optical imaging , 2008, Brain Research.

[10]  Niels Birbaumer,et al.  Reorganization of functional and effective connectivity during real-time fMRI-BCI modulation of prosody processing , 2011, Brain and Language.

[11]  S. Gielen,et al.  The brain–computer interface cycle , 2009, Journal of neural engineering.

[12]  M. Mazo,et al.  System for assisted mobility using eye movements based on electrooculography , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  B A Wester,et al.  Development and characterization of in vivo flexible electrodes compatible with large tissue displacements , 2009, Journal of neural engineering.

[14]  Jinung An,et al.  Classification of frontal cortex haemodynamic responses during cognitive tasks using wavelet transforms and machine learning algorithms. , 2012, Medical engineering & physics.

[15]  Konstantin I Maslov,et al.  Living Brain Optical Imaging: Technology, Methods and Applications. , 2012, Journal of neuroscience and neuroengineering.

[16]  Martin Wolf,et al.  Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study , 2011, Journal of NeuroEngineering and Rehabilitation.

[17]  Christa Neuper,et al.  Focal frontal (de)oxyhemoglobin responses during simple arithmetic. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  Maysam Ghovanloo,et al.  Using Unconstrained Tongue Motion as an Alternative Control Mechanism for Wheeled Mobility , 2009, IEEE Transactions on Biomedical Engineering.

[19]  Arthur F. Kramer,et al.  Neurovascular coupling in normal aging: A combined optical, ERP and fMRI study , 2014, NeuroImage.

[20]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[21]  Chang-Hwan Im,et al.  Development of an SSVEP-based BCI spelling system adopting a QWERTY-style LED keyboard , 2012, Journal of Neuroscience Methods.

[22]  Brian Litt,et al.  Flexible, Foldable, Actively Multiplexed, High-Density Electrode Array for Mapping Brain Activity in vivo , 2011, Nature Neuroscience.

[23]  Christa Neuper,et al.  134 ERD/ERS based brain computer interface (BCI): Effects of motor imagery on sensorimotor rhythms , 1998 .

[24]  Justin C. Williams,et al.  A Micro-Electrocorticography Platform and Deployment Strategies for Chronic BCI Applications , 2011, Clinical EEG and neuroscience.

[25]  S. Ge,et al.  fNIRS-based online deception decoding , 2012, Journal of neural engineering.

[26]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[27]  T. Chau,et al.  Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy , 2012, Journal of neural engineering.

[28]  T. Chau,et al.  Towards a system-paced near-infrared spectroscopy brain–computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state , 2011, Journal of neural engineering.

[29]  M Adjouadi,et al.  A practical EMG-based human-computer interface for users with motor disabilities. , 2000, Journal of rehabilitation research and development.

[30]  Klaus-Robert Müller,et al.  Machine-Learning Based Co-adaptive Calibration: A Perspective to Fight BCI Illiteracy , 2010, HAIS.

[31]  Bülent Sankur,et al.  Spectral Analysis of Event-Related Hemodynamic Responses in Functional Near Infrared Spectroscopy , 2005, Journal of Computational Neuroscience.

[32]  Eiji Okada,et al.  Arranging optical fibres for the spatial resolution improvement of topographical images. , 2002, Physics in medicine and biology.

[33]  Chang-Hwan Im,et al.  EEG-Based Brain-Computer Interfaces: A Thorough Literature Survey , 2013, Int. J. Hum. Comput. Interact..

[34]  K. Müller,et al.  Predicting BCI performance to study BCI illiteracy , 2009, BMC Neuroscience.

[35]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[36]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[37]  Tom Chau,et al.  Automatic single-trial classification of prefrontal hemodynamic activity in an individual with Duchenne muscular dystrophy , 2013, Developmental neurorehabilitation.

[38]  Shoko Nioka,et al.  A Brain-Computer Interface for Mental Arithmetic Task from Single-Trial Near-Infrared Spectroscopy Brain Signals , 2010, 2010 20th International Conference on Pattern Recognition.

[39]  Tom Chau,et al.  Decoding subjective preference from single-trial near-infrared spectroscopy signals , 2009, Journal of neural engineering.

[40]  Christa Neuper,et al.  Single-trial classification of antagonistic oxyhemoglobin responses during mental arithmetic , 2011, Medical & Biological Engineering & Computing.

[41]  Alessandro Torricelli,et al.  Bilateral prefrontal cortex oxygenation responses to a verbal fluency task: a multichannel time-resolved near-infrared topography study. , 2005, Journal of biomedical optics.

[42]  A. Cichocki,et al.  The Changing Face of P300 BCIs: A Comparison of Stimulus Changes in a P300 BCI Involving Faces, Emotion, and Movement , 2012, PloS one.

[43]  Gert Pfurtscheller,et al.  Development, set-up and first results for a one-channel near-infrared spectroscopy system / Entwicklung, Aufbau und vorläufige Ergebnisse eines Einkanal- Nahinfrarot-Spektroskopie-Systems , 2008, Biomedizinische Technik. Biomedical engineering.

[44]  N Birbaumer,et al.  A binary spelling interface with random errors. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[45]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[46]  Naoto Takahashi,et al.  Functional connectivity of the cortex of term and preterm infants and infants with Down's syndrome , 2014, NeuroImage.

[47]  Eun Yi Kim,et al.  Vision based interface system for hands free control of an intelligent wheelchair , 2009, Journal of NeuroEngineering and Rehabilitation.

[48]  Michael Jones,et al.  A Sip-and-Puff Wireless Remote Control for the Apple iPod , 2008, Assistive technology : the official journal of RESNA.

[49]  L. Lathauwer,et al.  Detection of fast neuronal signals in the motor cortex from functional near infrared spectroscopy measurements using independent component analysis , 2006, Medical and Biological Engineering and Computing.

[50]  Vera Kaiser,et al.  Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEG , 2010, Medical & Biological Engineering & Computing.