Descriptor : Simultaneous acquisition of EEG and NIRS during cognitive tasks for an open access dataset

We provide an open access multimodal brain-imaging dataset of simultaneous electroencephalography (EEG) and near-infrared spectroscopy (NIRS) recordings. Twenty-six healthy participants performed three cognitive tasks: 1) n-back (0-, 2- and 3-back), 2) discrimination/selection response task (DSR) and 3) word generation (WG) tasks. The data provided includes: 1) measured data, 2) demographic data, and 3) basic analysis results. For n-back (dataset A) and DSR tasks (dataset B), event-related potential (ERP) analysis was performed, and spatiotemporal characteristics and classification results for ‘target’ versus ‘non-target’ (dataset A) and symbol ‘O’ versus symbol ‘X’ (dataset B) are provided. Time-frequency analysis was performed to show the EEG spectral power to differentiate the task-relevant activations. Spatiotemporal characteristics of hemodynamic responses are also shown. For the WG task (dataset C), the EEG spectral power and spatiotemporal characteristics of hemodynamic responses are analyzed, and the potential merit of hybrid EEG-NIRS BCIs was validated with respect to classification accuracy. We expect that the dataset provided will facilitate performance evaluation and comparison of many neuroimaging analysis techniques.

[1]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Machine Learning Based Detection of User Specific Brain States , 2006, J. Univers. Comput. Sci..

[2]  Krzysztof J. Gorgolewski,et al.  Making big data open: data sharing in neuroimaging , 2014, Nature Neuroscience.

[3]  Reza Fazel-Rezai,et al.  A Review of Hybrid Brain-Computer Interface Systems , 2013, Adv. Hum. Comput. Interact..

[4]  Arie Yeredor,et al.  A fast approximate joint diagonalization algorithm using a criterion with a block diagonal weight matrix , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[6]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[7]  Xu Cui,et al.  Speeded Near Infrared Spectroscopy (NIRS) Response Detection , 2010, PloS one.

[8]  Klaus-Robert Müller,et al.  Increase Information Transfer Rates in BCI by CSP Extension to Multi-class , 2003, NIPS.

[9]  Niels Birbaumer,et al.  Hemodynamic brain-computer interfaces for communication and rehabilitation , 2009, Neural Networks.

[10]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[11]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[12]  Tommi Noponen,et al.  Correlation of visual-evoked hemodynamic responses and potentials in human brain , 2010, Experimental Brain Research.

[13]  Klaus-Robert Müller,et al.  Decoding of top-down cognitive processing for SSVEP-controlled BMI , 2016, Scientific Reports.

[14]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[15]  Tania S. Douglas,et al.  Motion Artifact Removal for Functional Near Infrared Spectroscopy: A Comparison of Methods , 2010, IEEE Transactions on Biomedical Engineering.

[16]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[18]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[19]  Jichai Jeong,et al.  Dataset for EEG + NIRS Single-Trial Classification , 2022 .

[20]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[21]  Gernot R. Müller-Putz,et al.  "Virtual keyboard" controlled by spontaneous EEG activity , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Heidrun Wabnitz,et al.  M3BA: A Mobile, Modular, Multimodal Biosignal Acquisition Architecture for Miniaturized EEG-NIRS-Based Hybrid BCI and Monitoring , 2017, IEEE Transactions on Biomedical Engineering.

[23]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[24]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[25]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[26]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[27]  Quan Zhang,et al.  Adaptive filtering to reduce global interference in non-invasive NIRS measures of brain activation: How well and when does it work? , 2009, NeuroImage.

[28]  Han-Jeong Hwang,et al.  Near-infrared spectroscopy (NIRS)-based eyes-closed brain-computer interface (BCI) using prefrontal cortex activation due to mental arithmetic , 2016, Scientific Reports.

[29]  Siamac Fazli,et al.  Brain Computer Interfacing: A Multi-Modal Perspective , 2013, J. Comput. Sci. Eng..

[30]  T. Chau,et al.  Towards a system-paced near-infrared spectroscopy brain–computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state , 2011, Journal of neural engineering.

[31]  W. De Clercq,et al.  Automatic Removal of Ocular Artifacts in the EEG without an EOG Reference Channel , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[32]  P. Sajda,et al.  A data analysis competition to evaluate machine learning algorithms for use in brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[34]  Sangtae Ahn,et al.  Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data , 2016, Front. Hum. Neurosci..

[35]  Klaus-Robert Müller,et al.  Learning From More Than One Data Source: Data Fusion Techniques for Sensorimotor Rhythm-Based Brain–Computer Interfaces , 2015, Proceedings of the IEEE.

[36]  Tanja Schultz,et al.  Hybrid fNIRS-EEG based classification of auditory and visual perception processes , 2014, Front. Neurosci..

[37]  Ann-Christine Ehlis,et al.  Beyond the N400: Complementary access to early neural correlates of novel metaphor comprehension using combined electrophysiological and haemodynamic measurements , 2014, Cortex.

[38]  Chang-Hwan Im,et al.  Evaluation of various mental task combinations for near-infrared spectroscopy-based brain-computer interfaces , 2014, Journal of biomedical optics.

[39]  Andreas Ziehe,et al.  TDSEP { an e(cid:14)cient algorithm for blind separation using time structure , 1998 .

[40]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[41]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[42]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[43]  Febo Cincotti,et al.  Towards Noninvasive Hybrid Brain–Computer Interfaces: Framework, Practice, Clinical Application, and Beyond , 2015, Proceedings of the IEEE.

[44]  Klaus-Robert Müller,et al.  Open Access Dataset for EEG+NIRS Single-Trial Classification , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Sotaro Shimada,et al.  Simultaneous measurement of electroencephalography and near-infrared spectroscopy during voluntary motor preparation , 2015, Scientific Reports.

[47]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[48]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[49]  A. Kübler,et al.  Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials , 2014, Journal of NeuroEngineering and Rehabilitation.

[50]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[51]  R Grebe,et al.  Toward a fully integrated wireless wearable EEG-NIRS bimodal acquisition system , 2013, Journal of neural engineering.

[52]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  F. Wallois,et al.  Usefulness of simultaneous EEG–NIRS recording in language studies , 2012, Brain and Language.

[54]  Stefan Haufe,et al.  Multivariate Machine Learning Methods for Fusing Multimodal Functional Neuroimaging Data , 2015, Proceedings of the IEEE.

[55]  A. Eke,et al.  The modified Beer–Lambert law revisited , 2006, Physics in medicine and biology.

[56]  Christa Neuper,et al.  Motor imagery and EEG-based control of spelling devices and neuroprostheses. , 2006, Progress in brain research.

[57]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[58]  Stefan Haufe,et al.  The Berlin Brain-Computer Interface: Progress Beyond Communication and Control , 2016, Front. Neurosci..

[59]  Christa Neuper,et al.  Rehabilitation with Brain-Computer Interface Systems , 2008, Computer.

[60]  Hasan Onur Keles,et al.  Hybrid EEG-fNIRS Asynchronous Brain-Computer Interface for Multiple Motor Tasks , 2016, PloS one.