Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller

OBJECTIVE Most BCIs have to undergo a calibration session in which data is recorded to train decoders with machine learning. Only recently zero-training methods have become a subject of study. This work proposes a probabilistic framework for BCI applications which exploit event-related potentials (ERPs). For the example of a visual P300 speller we show how the framework harvests the structure suitable to solve the decoding task by (a) transfer learning, (b) unsupervised adaptation, (c) language model and (d) dynamic stopping. APPROACH A simulation study compares the proposed probabilistic zero framework (using transfer learning and task structure) to a state-of-the-art supervised model on n = 22 subjects. The individual influence of the involved components (a)-(d) are investigated. MAIN RESULTS Without any need for a calibration session, the probabilistic zero-training framework with inter-subject transfer learning shows excellent performance--competitive to a state-of-the-art supervised method using calibration. Its decoding quality is carried mainly by the effect of transfer learning in combination with continuous unsupervised adaptation. SIGNIFICANCE A high-performing zero-training BCI is within reach for one of the most popular BCI paradigms: ERP spelling. Recording calibration data for a supervised BCI would require valuable time which is lost for spelling. The time spent on calibration would allow a novel user to spell 29 symbols with our unsupervised approach. It could be of use for various clinical and non-clinical ERP-applications of BCI.

[1]  Andrzej Cichocki,et al.  Whether generic model works for rapid ERP-based BCI calibration , 2013, Journal of Neuroscience Methods.

[2]  Klaus-Robert Müller,et al.  ℓ1-penalized linear mixed-effects models for high dimensional data with application to BCI , 2011, NeuroImage.

[3]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[4]  Klaus-Robert Müller,et al.  Subject-independent mental state classification in single trials , 2009, Neural Networks.

[5]  M. Matteucci,et al.  The Utility Metric: A Novel Method to Assess the Overall Performance of Discrete Brain–Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[7]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[8]  Stanley F. Chen,et al.  An empirical study of smoothing techniques for language modeling , 1999 .

[9]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[10]  Benjamin Schrauwen,et al.  A Unified Probabilistic Approach to Improve Spelling in an Event-Related Potential-Based Brain–Computer Interface , 2013, IEEE Transactions on Biomedical Engineering.

[11]  Eric W. Sellers,et al.  Predictive Spelling With a P300-Based Brain–Computer Interface: Increasing the Rate of Communication , 2010, Int. J. Hum. Comput. Interact..

[12]  Benjamin Schrauwen,et al.  A Bayesian Model for Exploiting Application Constraints to Enable Unsupervised Training of a P300-based BCI , 2012, PloS one.

[13]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[14]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[15]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[16]  Benjamin Blankertz,et al.  A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System , 2011, Front. Neurosci..

[17]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[18]  Roderick Murray-Smith,et al.  Optimized stimulation events for a visual ERP BCI , 2011 .

[19]  Michael Tangermann,et al.  Adaptive Classification Improves Control Performance in ERP-Based BCIs , 2011 .

[20]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[21]  Cuntai Guan,et al.  Unsupervised Brain Computer Interface Based on Intersubject Information and Online Adaptation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Michael Tangermann,et al.  No surprise - fixed sequence event-related potentials for brain-computer interfaces , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Nader Pouratian,et al.  Natural language processing with dynamic classification improves P300 speller accuracy and bit rate , 2012, Journal of neural engineering.

[24]  F ChenStanley,et al.  An Empirical Study of Smoothing Techniques for Language Modeling , 1996, ACL.

[25]  Benjamin Schrauwen,et al.  Dynamic Stopping Improves the Speed and Accuracy of a P300 Speller , 2012, ICANN.

[26]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[27]  Geoffrey E. Hinton,et al.  Generating Text with Recurrent Neural Networks , 2011, ICML.

[28]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[29]  Benjamin Schrauwen,et al.  How do you like your P300 speller: adaptive, accurate and simple? , 2011 .

[30]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[31]  Benjamin Schrauwen,et al.  A P300 BCI for the Masses: Prior Information Enables Instant Unsupervised Spelling , 2012, NIPS.

[32]  Jason Farquhar,et al.  Interactions Between Pre-Processing and Classification Methods for Event-Related-Potential Classification , 2012, Neuroinformatics.

[33]  Alexey N. Pavlov,et al.  Wavelet analysis in neurodynamics , 2012 .

[34]  Ying Sun,et al.  Adaptation in P300 Brain–Computer Interfaces: A Two-Classifier Cotraining Approach , 2010, IEEE Transactions on Biomedical Engineering.

[35]  PerlovskyLeonid 2009 Special Issue , 2009 .

[36]  Klaus-Robert Müller,et al.  Towards Zero Training for Brain-Computer Interfacing , 2008, PloS one.