A Cross-Session Dataset for Collaborative Brain-Computer Interfaces Based on Rapid Serial Visual Presentation

Brain-computer interfaces (BCIs) based on rapid serial visual presentation (RSVP) have been widely used to categorize target and non-target images. However, it is still a challenge to detect single-trial event related potentials (ERPs) from electroencephalography (EEG) signals. Besides, the variability of EEG signal over time may cause difficulties of calibration in long-term system use. Recently, collaborative BCIs have been proposed to improve the overall BCI performance by fusing brain activities acquired from multiple subjects. For both individual and collaborative BCIs, feature extraction and classification algorithms that can be transferred across sessions can significantly facilitate system calibration. Although open datasets are highly efficient for developing algorithms, currently there is still a lack of datasets for a collaborative RSVP-based BCI. This paper presents a cross-session EEG dataset of a collaborative RSVP-based BCI system from 14 subjects, who were divided into seven groups. In collaborative BCI experiments, two subjects did the same target image detection tasks synchronously. All subjects participated in the same experiment twice with an average interval of ∼23 days. The results in data evaluation indicate that adequate signal processing algorithms can greatly enhance the cross-session BCI performance in both individual and collaborative conditions. Besides, compared with individual BCIs, the collaborative methods that fuse information from multiple subjects obtain significantly improved BCI performance. This dataset can be used for developing more efficient algorithms to enhance performance and practicality of a collaborative RSVP-based BCI system.

[1]  Guillaume Gibert,et al.  xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Yijun Wang,et al.  Obviating Session-to-Session Variability in a Rapid Serial Visual Presentation-Based Brain–Computer Interface , 2019, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[3]  Shih-Fu Chang,et al.  Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases , 2011, Journal of neural engineering.

[4]  G. Boriani,et al.  Corrigendum: Glomerular filtration rate in patients with atrial fibrillation and 1-year outcomes , 2017, Scientific reports.

[5]  Miguel P. Eckstein,et al.  Impact of target probability on single-trial EEG target detection in a difficult rapid serial visual presentation task , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[8]  Damien Coyle,et al.  A Review of Rapid Serial Visual Presentation-based Brain-1 Computer Interfaces 2 , 2017 .

[9]  Riccardo Poli,et al.  Towards the automated localisation of targets in rapid image-sifting by collaborative brain-computer interfaces , 2017, PloS one.

[10]  Peng Yuan,et al.  Study on an online collaborative BCI to accelerate response to visual targets , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Lucas C. Parra,et al.  High-throughput image search via single-trial event detection in a rapid serial visual presentation task , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[12]  Xiaogang Chen,et al.  A study on dynamic model of steady-state visual evoked potentials , 2018, Journal of neural engineering.

[13]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[14]  Tzyy-Ping Jung,et al.  A Collaborative Brain-Computer Interface for Improving Human Performance , 2011, PloS one.

[15]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[16]  Fernando De la Torre,et al.  Canonical Time Warping for Alignment of Human Behavior , 2009, NIPS.

[17]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[18]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[19]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[20]  Benjamin Blankertz,et al.  Gaze-independent BCI-spelling using rapid serial visual presentation (RSVP) , 2013, Clinical Neurophysiology.

[21]  Wei Wu,et al.  Learning event-related potentials (ERPs) from multichannel EEG recordings: A spatio-temporal modeling framework with a fast estimation algorithm , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Misha Pavel,et al.  Rapid image analysis using neural signals , 2008, CHI Extended Abstracts.

[23]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[24]  Riccardo Poli,et al.  Collaborative brain-computer interfaces for the automatic classification of images , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[25]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[26]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[27]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[28]  Riccardo Poli,et al.  Collaborative Brain-Computer Interface for Aiding Decision-Making , 2014, PloS one.

[29]  Abel G. Oliva,et al.  Gist of a scene , 2005 .

[30]  D. Lawrence.  Two studies of visual search for word targets with controlled rates of presentation* , 1971 .

[31]  Riccardo Poli,et al.  A collaborative Brain-Computer Interface to improve human performance in a visual search task , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[32]  D. Broadbent,et al.  From detection to identification: Response to multiple targets in rapid serial visual presentation , 1987, Perception & psychophysics.

[33]  Miguel P. Eckstein,et al.  Single-trial classification of neural responses evoked in rapid serial visual presentation: Effects of stimulus onset asynchrony and stimulus repetition , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[34]  Damien Coyle,et al.  Speed of Rapid Serial Visual Presentation of Pictures, Numbers and Words Affects Event-Related Potential-Based Detection Accuracy , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  H. Cecotti,et al.  Subject Combination and Electrode Selection in Cooperative Brain-Computer Interface Based on Event Related Potentials , 2014, Brain sciences.

[36]  Klaus-Robert Müller,et al.  Towards Zero Training for Brain-Computer Interfacing , 2008, PloS one.

[37]  Benjamin Blankertz,et al.  A novel brain-computer interface based on the rapid serial visual presentation paradigm , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[38]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[39]  Yijun Wang,et al.  Visual and Auditory Brain–Computer Interfaces , 2014, IEEE Transactions on Biomedical Engineering.

[40]  Hideaki Touyama.  A collaborative BCI system based on P300 signals as a new tool for life log indexing , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[41]  Lucas C. Parra,et al.  Cortical origins of response time variability during rapid discrimination of visual objects , 2005, NeuroImage.

[42]  J. Touryan,et al.  Real-Time Measurement of Face Recognition in Rapid Serial Visual Presentation , 2011, Front. Psychology.

[43]  S. Thorpe,et al.  How parallel is visual processing in the ventral pathway? , 2004, Trends in Cognitive Sciences.

[44]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[45]  Riccardo Poli,et al.  Group Augmentation in Realistic Visual-Search Decisions via a Hybrid Brain-Computer Interface , 2017, Scientific Reports.

[46]  Riccardo Poli,et al.  Enhancement of Group Perception via a Collaborative Brain–Computer Interface , 2017, IEEE Transactions on Biomedical Engineering.

[47]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[48]  Miguel P. Eckstein,et al.  Single-Trial Classification of Event-Related Potentials in Rapid Serial Visual Presentation Tasks Using Supervised Spatial Filtering , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[49]  Assaf B. Spanier,et al.  Spatiotemporal Representations of Rapid Visual Target Detection: A Single-Trial EEG Classification Algorithm , 2014, IEEE Transactions on Biomedical Engineering.

[50]  Tzyy-Ping Jung,et al.  A collaborative brain-computer interface , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[51]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[53]  P. Jolicoeur.  Modulation of the attentional blink by on-line response selection: Evidence from speeded and unspeeded Task1 decisions , 1998, Memory & cognition.

[54]  Luca Citi,et al.  Collaborative Brain-Computer Interfaces to Enhance Group Decisions in an Outpost Surveillance Task , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[55]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[56]  Misha Pavel,et al.  A framework for rapid visual image search using single-trial brain evoked responses , 2011, Neurocomputing.

[57]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.