Signal Processing Approaches to Minimize or Suppress Calibration Time in Oscillatory Activity-Based Brain–Computer Interfaces

One of the major limitations of brain-computer interfaces (BCI) is their long calibration time, which limits their use in practice, both by patients and healthy users alike. Such long calibration times are due to the large between-user variability and thus to the need to collect numerous training electroencephalography (EEG) trials for the machine learning algorithms used in BCI design. In this paper, we first survey existing approaches to reduce or suppress calibration time, these approaches being notably based on regularization, user-to-user transfer, semi-supervised learning and a priori physiological information. We then propose new tools to reduce BCI calibration time. In particular, we propose to generate artificial EEG trials from the few EEG trials initially available, in order to augment the training set size. These artificial EEG trials are obtained by relevant combinations and distortions of the original trials available. We propose three different methods to do so. We also propose a new, fast and simple approach to perform user-to-user transfer for BCI. Finally, we study and compare offline different approaches, both old and new ones, on the data of 50 users from three different BCI data sets. This enables us to identify guidelines about how to reduce or suppress calibration time for BCI.

[1]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[2]  Klaus-Robert Müller,et al.  Towards Zero Training for Brain-Computer Interfacing , 2008, PloS one.

[3]  A. Lécuyer.  Brain-computer interfaces and virtual reality , 2013 .

[4]  Moritz Grosse-Wentrup,et al.  Beamforming in Noninvasive Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[5]  Jason Farquhar,et al.  A subject-independent brain-computer interface based on smoothed, second-order baselining , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Shiliang Sun,et al.  Dynamical ensemble learning with model-friendly classifiers for domain adaptation , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  J. A. Elshout.  Review of Brain-Computer Interfaces based on the P300 evoked potential , 2009 .

[8]  Klaus-Robert Müller,et al.  Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller , 2014, Journal of neural engineering.

[9]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[10]  Motoaki Kawanabe,et al.  Divergence-Based Framework for Common Spatial Patterns Algorithms , 2014, IEEE Reviews in Biomedical Engineering.

[11]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[12]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[13]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[14]  Christian Mühl,et al.  Design and Validation of a Mental and Social Stress Induction Protocol - Towards Load-invariant Physiology-based Stress Detection , 2014, PhyCS.

[15]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[16]  Wei Wu,et al.  Classifying Single-Trial EEG During Motor Imagery by Iterative Spatio-Spectral Patterns Learning (ISSPL) , 2008, IEEE Transactions on Biomedical Engineering.

[17]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[18]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[19]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[20]  Shiliang Sun,et al.  A subject transfer framework for EEG classification , 2012, Neurocomputing.

[21]  Benjamin Schrauwen,et al.  A Bayesian Model for Exploiting Application Constraints to Enable Unsupervised Training of a P300-based BCI , 2012, PloS one.

[22]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[23]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[24]  Cuntai Guan,et al.  Comparison of designs towards a subject-independent brain-computer interface based on motor imagery , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[26]  Seungjin Choi,et al.  Bayesian common spatial patterns for multi-subject EEG classification , 2014, Neural Networks.

[27]  Heung-Il Suk,et al.  Subject and class specific frequency bands selection for multiclass motor imagery classification , 2011, Int. J. Imaging Syst. Technol..

[28]  Horst Bischof,et al.  The Self-Paced Graz Brain-Computer Interface: Methods and Applications , 2007, Comput. Intell. Neurosci..

[29]  Fabien Lotte,et al.  Impact of cognitive and personality profiles on mental-imagery based brain–computer interface-control performance , 2014 .

[30]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[31]  Hubert Cecotti,et al.  Spelling with non-invasive Brain–Computer Interfaces – Current and future trends , 2011, Journal of Physiology-Paris.

[32]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[33]  Gérard Dray,et al.  Knowledge Transfer for Reducing Calibration Time in Brain-Computer Interfacing , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[34]  Jianjun Meng,et al.  Improved Semisupervised Adaptation for a Small Training Dataset in the Brain–Computer Interface , 2014, IEEE Journal of Biomedical and Health Informatics.

[35]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[36]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[37]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[38]  Wolfgang Rosenstiel,et al.  Online Adaptation of a c-VEP Brain-Computer Interface(BCI) Based on Error-Related Potentials and Unsupervised Learning , 2012, PloS one.

[39]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[40]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[41]  G Pfurtscheller,et al.  Seperability of four-class motor imagery data using independent components analysis , 2006, Journal of neural engineering.

[42]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[43]  G. Pfurtscheller,et al.  Conversion of EEG activity into cursor movement by a brain-computer interface (BCI) , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  C. Neuper,et al.  Whatever Works: A Systematic User-Centered Training Protocol to Optimize Brain-Computer Interfacing Individually , 2013, PloS one.

[45]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[46]  Chiew Tong Lau,et al.  A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[47]  Harold Mouchère,et al.  Pattern rejection strategies for the design of self-paced EEG-based Brain-Computer Interfaces , 2008, 2008 19th International Conference on Pattern Recognition.

[48]  Mahnaz Arvaneh,et al.  Subject-to-subject adaptation to reduce calibration time in motor imagery-based brain-computer interface , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[50]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[51]  Cuntai Guan,et al.  Optimum Spatio-Spectral Filtering Network for Brain–Computer Interface , 2011, IEEE Transactions on Neural Networks.

[52]  Cuntai Guan,et al.  Brain-Computer Interface in Stroke Rehabilitation , 2013, J. Comput. Sci. Eng..

[53]  Alexandre Barachant,et al.  A New Generation of Brain-Computer Interface Based on Riemannian Geometry , 2013, ArXiv.

[54]  Moritz Grosse-Wentrup,et al.  Multitask Learning for Brain-Computer Interfaces , 2010, AISTATS.

[55]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[56]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[57]  Christian Mühl,et al.  Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction , 2013, PhyCS.

[58]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[59]  Utpal Garain,et al.  Role of Synthetically Generated Samples on Speech Recognition in a Resource-Scarce Language , 2010, 2010 20th International Conference on Pattern Recognition.

[60]  Klaus-Robert Müller,et al.  ℓ1-penalized linear mixed-effects models for high dimensional data with application to BCI , 2011, NeuroImage.

[61]  Elsa Andrea Kirchner,et al.  Minimizing Calibration Time for Brain Reading , 2011, DAGM-Symposium.

[62]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[63]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[64]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[65]  Fabien Lotte.  Generating Artificial EEG Signals To Reduce BCI Calibration Time , 2011 .

[66]  Harold Mouchère,et al.  Learning a Classifier with Very Few Examples: Analogy Based and Knowledge Based Generation of New Examples for Character Recognition , 2007, ECML.

[67]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..

[68]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Klaus-Robert Müller,et al.  CSP patches: an ensemble of optimized spatial filters. An evaluation study , 2011, Journal of neural engineering.

[70]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[71]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[72]  Xiaomu Song,et al.  Adaptive Common Spatial Pattern for single-trial EEG classification in multisubject BCI , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[73]  Jessica Cantillo-Negrete,et al.  An approach to improve the performance of subject-independent BCIs-based on motor imagery allocating subjects by gender , 2014, BioMedical Engineering OnLine.

[74]  Klaus-Robert Müller,et al.  Subject-independent mental state classification in single trials , 2009, Neural Networks.

[75]  Sung Chan Jun,et al.  Calibration Time Reduction through Source Imaging in Brain Computer Interface (BCI) , 2011, HCI.

[76]  Shiliang Sun,et al.  Semi-supervised feature extraction for EEG classification , 2012, Pattern Analysis and Applications.

[77]  Klaus-Robert Müller,et al.  Machine-Learning-Based Coadaptive Calibration for Brain-Computer Interfaces , 2011, Neural Computation.

[78]  Cuntai Guan,et al.  Unsupervised brain computer interface based on inter-subject information , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[79]  Christa Neuper,et al.  Rehabilitation with Brain-Computer Interface Systems , 2008, Computer.

[80]  Cuntai Guan,et al.  An Efficient P300-based Brain-Computer Interface with Minimal Calibration Time , 2009, NIPS 2009.

[81]  Laurent Miclet,et al.  Synthetic On-line Handwriting Generation by Distortions and Analogy , 2007 .

[82]  Motoaki Kawanabe,et al.  Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces , 2011, IEEE Transactions on Biomedical Engineering.

[83]  Tanja Schultz,et al.  Subject-to-subject transfer for CSP based BCIs: Feature space transformation and decision-level fusion , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[84]  Christian Mühl,et al.  EEG-based workload estimation across affective contexts , 2014, Front. Neurosci..

[85]  Moritz Grosse-Wentrup,et al.  Preprint Accepted for Publication in the Ieee Transactions on Biomedical Engineering Beamforming in Non-invasive Brain-computer Interfaces Abstract—spatial Filtering Constitutes an Integral Part of Build- Ing Eeg-based Brain-computer Interfaces (bcis). Algorithms Frequently Used for Spatial Filterin , 2008 .