Automatic single-trial discrimination of mental arithmetic, mental singing and the no-control state from prefrontal activity: toward a three-state NIRS-BCI

BackgroundNear-infrared spectroscopy (NIRS) is an optical imaging technology that has recently been investigated for use in a safe, non-invasive brain-computer interface (BCI) for individuals with severe motor impairments. To date, most NIRS-BCI studies have attempted to discriminate two mental states (e.g., a mental task and rest), which could potentially lead to a two-choice BCI system. In this study, we attempted to automatically differentiate three mental states - specifically, intentional activity due to 1) a mental arithmetic (MA) task and 2) a mental singing (MS) task, and 3) an unconstrained, "no-control (NC)" state - to investigate the feasibility of a three-choice system-paced NIRS-BCI.ResultsDeploying a dual-wavelength frequency domain near-infrared spectrometer, we interrogated nine sites around the frontopolar locations while 7 able-bodied adults performed mental arithmetic and mental singing to answer multiple-choice questions within a system-paced paradigm. With a linear classifier trained on a ten-dimensional feature set, an overall classification accuracy of 56.2% was achieved for the MA vs. MS vs. NC classification problem and all individual participant accuracies significantly exceeded chance (i.e., 33%). However, as anticipated based on results of previous work, the three-class discrimination was unsuccessful for three participants due to the ineffectiveness of the mental singing task. Excluding these three participants increases the accuracy rate to 62.5%. Even without training, three of the remaining four participants achieved accuracies approaching 70%, the value often cited as being necessary for effective BCI communication.ConclusionsThese results are encouraging and demonstrate the potential of a three-state system-paced NIRS-BCI with two intentional control states corresponding to mental arithmetic and mental singing.

[1]  T. Chau,et al.  Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface , 2009, Journal of NeuroEngineering and Rehabilitation.

[2]  N Birbaumer,et al.  A binary spelling interface with random errors. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  A. Ehlis,et al.  Simulation of Near-Infrared Light Absorption Considering Individual Head and Prefrontal Cortex Anatomy: Implications for Optical Neuroimaging , 2011, PloS one.

[4]  E. Altenmüller,et al.  Hits to the left, flops to the right: different emotions during listening to music are reflected in cortical lateralisation patterns , 2002, Neuropsychologia.

[5]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[6]  R. Zatorre,et al.  Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[7]  F. Barale,et al.  Neurophysiology and neurobiology of the musical experience. , 2006, Functional neurology.

[8]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[9]  Yanqing Zhang,et al.  A genetic algorithm-based method for feature subset selection , 2008, Soft Comput..

[10]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[11]  Christa Neuper,et al.  Single-trial classification of antagonistic oxyhemoglobin responses during mental arithmetic , 2011, Medical & Biological Engineering & Computing.

[12]  T. Falk,et al.  Taking NIRS-BCIs Outside the Lab: Towards Achieving Robustness Against Environment Noise , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Christa Neuper,et al.  Focal frontal (de)oxyhemoglobin responses during simple arithmetic. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[15]  Eiji Okada,et al.  Arranging optical fibres for the spatial resolution improvement of topographical images. , 2002, Physics in medicine and biology.

[16]  A. Kleinschmidt,et al.  Dissociating neural correlates of cognitive components in mental calculation. , 2001, Cerebral cortex.

[17]  Mehrdad Fatourechi,et al.  Evaluating the Performance of Self-Paced Brain-Computer Interface Technology , 2006 .

[18]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[19]  Niels Birbaumer,et al.  Hemodynamic brain-computer interfaces for communication and rehabilitation , 2009, Neural Networks.

[20]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[21]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[22]  Wei Wang,et al.  The deactivation network in brain during acute stress , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[23]  Sergio Fantini,et al.  Cerebral Hemodynamics Measured by Near-Infrared Spectroscopy at Rest and During Motor Activation , 1999, Proceedings of Inter-Institute Workshop on In Vivo Optical Imaging at the NIH.

[24]  Kaoru Sakatani,et al.  Effects of fragrance administration on stress-induced prefrontal cortex activity and sebum secretion in the facial skin , 2008, Neuroscience Letters.

[25]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[26]  Limsoon Wong,et al.  Using feature generation and feature selection for accurate prediction of translation initiation sites. , 2002, Genome informatics. International Conference on Genome Informatics.

[27]  John J. Grefenstette,et al.  How Genetic Algorithms Work: A Critical Look at Implicit Parallelism , 1989, ICGA.

[28]  Gert Pfurtscheller,et al.  Development, set-up and first results for a one-channel near-infrared spectroscopy system / Entwicklung, Aufbau und vorläufige Ergebnisse eines Einkanal- Nahinfrarot-Spektroskopie-Systems , 2008, Biomedizinische Technik. Biomedical engineering.

[29]  M. Herrmann,et al.  Prefrontal activation through task requirements of emotional induction measured with NIRS , 2003, Biological Psychology.

[30]  B. Mazoyer,et al.  Neural Correlates of Simple and Complex Mental Calculation , 2001, NeuroImage.

[31]  C. Krumhansl.  An exploratory study of musical emotions and psychophysiology. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[32]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.

[33]  M. Tanida,et al.  Relation between mental stress-induced prefrontal cortex activity and skin conditions: A near-infrared spectroscopy study , 2007, Brain Research.

[34]  Robert J. K. Jacob,et al.  Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements , 2009, INTERACT.

[35]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[36]  Atsushi Maki,et al.  High cognitive function of an ALS patient in the totally locked-in state , 2008, Neuroscience Letters.

[37]  C. Markham,et al.  Hemodynamics for Brain-Computer Interfaces , 2008, IEEE Signal Processing Magazine.

[38]  Ann-Christine Ehlis,et al.  Changes in cortical blood oxygenation during arithmetical tasks measured by near-infrared spectroscopy , 2009, Journal of Neural Transmission.

[39]  T. Braver,et al.  Functional specializations in lateral prefrontal cortex associated with the integration and segregation of information in working memory. , 2006, Cerebral cortex.

[40]  Tom Chau,et al.  A Review of Emerging Access Technologies for Individuals With Severe Motor Impairments , 2008, Assistive technology : the official journal of RESNA.

[41]  A. Villringer,et al.  Non-invasive optical spectroscopy and imaging of human brain function , 1997, Trends in Neurosciences.

[42]  Niels Birbaumer,et al.  Overt and imagined singing of an Italian aria , 2007, NeuroImage.

[43]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[44]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[45]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[46]  H. Koizumi,et al.  Development of an Optical Brain-machine Interface , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  T. Yagi,et al.  A Study on the Frontal Cortex in Cognitive Tasks using Near-Infrared Spectroscopy , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.