Exploring methodological frameworks for a mental task-based near-infrared spectroscopy brain–computer interface

BACKGROUND Near-infrared spectroscopy (NIRS) brain-computer interfaces (BCIs) enable users to interact with their environment using only cognitive activities. This paper presents the results of a comparison of four methodological frameworks used to select a pair of tasks to control a binary NIRS-BCI; specifically, three novel personalized task paradigms and the state-of-the-art prescribed task framework were explored. NEW METHODS Three types of personalized task selection approaches were compared, including: user-selected mental tasks using weighted slope scores (WS-scores), user-selected mental tasks using pair-wise accuracy rankings (PWAR), and researcher-selected mental tasks using PWAR. These paradigms, along with the state-of-the-art prescribed mental task framework, where mental tasks are selected based on the most commonly used tasks in literature, were tested by ten able-bodied participants who took part in five NIRS-BCI sessions. RESULTS The frameworks were compared in terms of their accuracy, perceived ease-of-use, computational time, user preference, and length of training. Most notably, researcher-selected personalized tasks resulted in significantly higher accuracies, while user-selected personalized tasks resulted in significantly higher perceived ease-of-use. It was also concluded that PWAR minimized the amount of data that needed to be collected; while, WS-scores maximized user satisfaction and minimized computational time. COMPARISON WITH EXISTING METHOD In comparison to the state-of-the-art prescribed mental tasks, our findings show that overall, personalized tasks appear to be superior to prescribed tasks with respect to accuracy and perceived ease-of-use. CONCLUSIONS The deployment of personalized rather than prescribed mental tasks ought to be considered and further investigated in future NIRS-BCI studies.

[1]  Hasan Ayaz,et al.  Assessment of Cognitive Neural Correlates for a Functional Near Infrared-Based Brain Computer Interface System , 2009, HCI.

[2]  Mohammad Soleymani,et al.  Single Trial Classification of EEG and Peripheral Physiological Signals for Recognition of Emotions Induced by Music Videos , 2010, Brain Informatics.

[3]  Keum-Shik Hong,et al.  Online binary decision decoding using functional near-infrared spectroscopy for the development of brain–computer interface , 2014, Experimental Brain Research.

[4]  Larissa C Schudlo,et al.  Dynamic topographical pattern classification of multichannel prefrontal NIRS signals: II. Online differentiation of mental arithmetic and rest , 2014, Journal of neural engineering.

[5]  Gert Pfurtscheller,et al.  Development, set-up and first results for a one-channel near-infrared spectroscopy system / Entwicklung, Aufbau und vorläufige Ergebnisse eines Einkanal- Nahinfrarot-Spektroskopie-Systems , 2008, Biomedizinische Technik. Biomedical engineering.

[6]  Tom Chau,et al.  Correlates of Near-Infrared Spectroscopy Brain–Computer Interface Accuracy in a Multi-Class Personalization Framework , 2015, Front. Hum. Neurosci..

[7]  H. Koizumi,et al.  Development of an Optical Brain-machine Interface , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Sarah D Power,et al.  Dynamic topographical pattern classification of multichannel prefrontal NIRS signals , 2013, Journal of neural engineering.

[9]  Sharlene D. Newman,et al.  From the Selectedworks of Marcel Adam Just Volitional Control of Attention and Brain Activation in Dual Task Performance Volitional Control of Attention and Brain Activation in Dual Task Performance , 2022 .

[10]  S. Bunce,et al.  Functional brain imaging using near-infrared technology , 2007, IEEE Engineering in Medicine and Biology Magazine.

[11]  Wenjun Gao,et al.  The Unique Properties of the Prefrontal Cortex and Mental Illness , 2012 .

[12]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[13]  Huan Liu,et al.  Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution , 2003, ICML.

[14]  Tanja Schultz,et al.  Classification of mental tasks in the prefrontal cortex using fNIRS , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  T. Chau,et al.  Intersession Consistency of Single-Trial Classification of the Prefrontal Response to Mental Arithmetic and the No-Control State by NIRS , 2012, PloS one.

[16]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[17]  T. Chau,et al.  Weaning Off Mental Tasks to Achieve Voluntary Self-Regulatory Control of a Near-Infrared Spectroscopy Brain-Computer Interface , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  C. Neuper,et al.  The effect of distinct mental strategies on classification performance for brain-computer interfaces. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  Thierry Pun,et al.  Valence-arousal evaluation using physiological signals in an emotion recall paradigm , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[20]  D. Delpy,et al.  Optical pathlength measurements on adult head, calf and forearm and the head of the newborn infant using phase resolved optical spectroscopy. , 1995, Physics in medicine and biology.

[21]  H. Shu,et al.  General form for obtaining discrete orthogonal moments , 2010 .

[22]  Hasan Ayaz,et al.  Tangram solved? Prefrontal cortex activation analysis during geometric problem solving , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Monica-Claudia Dobrea,et al.  The selection of proper discriminative cognitive tasks — A necessary prerequisite in high-quality BCI applications , 2009, 2009 2nd International Symposium on Applied Sciences in Biomedical and Communication Technologies.

[24]  D. Mehta,et al.  Peripheral blood gene expression: it all boils down to the RNA collection tubes , 2012, BMC Research Notes.

[25]  Y. Hoshi,et al.  Recognition of Human Emotions from Cerebral Blood Flow Changes in the Frontal Region: A Study with Event‐Related Near‐Infrared Spectroscopy , 2011, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[26]  Tom Chau,et al.  Automatic single-trial classification of prefrontal hemodynamic activity in an individual with Duchenne muscular dystrophy , 2013, Developmental neurorehabilitation.

[27]  Anton Nijholt,et al.  A Study in User-Centered Design and Evaluation of Mental Tasks for BCI , 2011, MMM.

[28]  Hung T. Nguyen,et al.  Mental non-motor imagery tasks classifications of brain computer interface for wheelchair commands using genetic algorithm-based neural network , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[29]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[30]  Tanja Schultz,et al.  Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS , 2014, Front. Hum. Neurosci..

[31]  Michael Tangermann,et al.  Brain-computer interface controlled gaming: Evaluation of usability by severely motor restricted end-users , 2013, Artif. Intell. Medicine.

[32]  Bettina Sorger,et al.  Another kind of 'BOLD Response': answering multiple-choice questions via online decoded single-trial brain signals. , 2009, Progress in brain research.

[33]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[34]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[35]  Keum Shik Hong,et al.  Functional near-infrared spectroscopy based discrimination of mental counting and no-control state for development of a brain-computer interface , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  T. Chau,et al.  Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface , 2009, Journal of NeuroEngineering and Rehabilitation.

[37]  Trevor Hastie,et al.  Overview of Supervised Learning , 2001 .

[38]  Joseph S. Dumas,et al.  Comparison of three one-question, post-task usability questionnaires , 2009, CHI.

[39]  Arye Rosen,et al.  THE EVOLUTION OF FIELD DEPLOYABLE fNIR SPECTROSCOPY FROM BENCH TO CLINICAL SETTINGS , 2011 .

[40]  R. Palaniappan,et al.  Utilizing Gamma Band to Improve Mental Task Based Brain-Computer Interface Design , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[42]  Tom Chau,et al.  Usability and performance-informed selection of personalized mental tasks for an online near-infrared spectroscopy brain-computer interface , 2015, Neurophotonics.

[43]  S. Bunce,et al.  Detecting cognitive activity related hemodynamic signal for brain computer interface using functional near infrared spectroscopy , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[44]  R. Bogacz,et al.  The neural basis of the speed–accuracy tradeoff , 2010, Trends in Neurosciences.

[45]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[46]  Jürgen Gross,et al.  Linear Regression , 2003 .

[47]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[48]  Mariko Osaka,et al.  Anterior Medial Prefrontal Cortex Exhibits Activation during Task Preparation but Deactivation during Task Execution , 2011, PloS one.

[49]  T. Chau,et al.  Towards a system-paced near-infrared spectroscopy brain–computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state , 2011, Journal of neural engineering.

[50]  Sarah D Power,et al.  Automatic single-trial discrimination of mental arithmetic, mental singing and the no-control state from prefrontal activity: toward a three-state NIRS-BCI , 2012, BMC Research Notes.

[51]  M. Schweiger,et al.  Theoretical and experimental investigation of near-infrared light propagation in a model of the adult head. , 1997, Applied optics.

[52]  Desney S. Tan,et al.  Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction , 2010 .

[53]  M. Lepper,et al.  Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. , 1996 .

[54]  T. Yagi,et al.  A Study on the Frontal Cortex in Cognitive Tasks using Near-Infrared Spectroscopy , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  M. Stokes,et al.  Cognitive tasks for driving a brain-computer interfacing system: a pilot study , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[56]  Keum-Shik Hong,et al.  Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface , 2013, Neuroscience Letters.

[57]  A. Ehlis,et al.  Simulation of Near-Infrared Light Absorption Considering Individual Head and Prefrontal Cortex Anatomy: Implications for Optical Neuroimaging , 2011, PloS one.

[58]  Cuntai Guan,et al.  Extracting and selecting discriminative features from high density NIRS-based BCI for numerical cognition , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[59]  A. Timmermans,et al.  Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design , 2009, Journal of NeuroEngineering and Rehabilitation.

[60]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[61]  Tom Chau,et al.  Towards a multimodal brain–computer interface: Combining fNIRS and fTCD measurements to enable higher classification accuracy , 2013, NeuroImage.