Improving P300 Spelling Rate using Language Models and Predictive Spelling.

The P300 Speller Brain-Computer Interface (BCI) provides a means of communication for those suffering from advanced neuromuscular diseases such as amyotrophic lateral sclerosis (ALS). Recent literature has incorporated language-based modelling, which uses previously chosen characters and the structure of natural language to modify the interface and classifier. Two complementary methods of incorporating language models have previously been independently studied: predictive spelling uses language models to generate suggestions of complete words to allow for the selection of multiple characters simultaneously, and language model-based classifiers have used prior characters to create a prior probability distribution over the characters based on how likely they are to follow. In this study, we propose a combined method which extends a language-based classifier to generate prior probabilities for both individual characters and complete words. In order to gauge the efficiency of this new model, results across 12 healthy subjects were measured. Incorporating predictive spelling increased typing speed using the P300 speller, with an average increase of 15.5% in typing rate across subjects, demonstrating that language models can be effectively utilized to create full word suggestions for predictive spelling. When combining predictive spelling with language model classification, typing speed is significantly improved, resulting in better typing performance.

[1]  Benjamin Schrauwen,et al.  A Unified Probabilistic Approach to Improve Spelling in an Event-Related Potential-Based Brain–Computer Interface , 2013, IEEE Transactions on Biomedical Engineering.

[2]  Fusheng Yang,et al.  BCI competition 2003-data set IIb: enhancing P300 wave detection using ICA-based subspace projections for BCI applications , 2004, IEEE Transactions on Biomedical Engineering.

[3]  W Speier,et al.  Incorporating advanced language models into the P300 speller using particle filtering. , 2015, Journal of neural engineering.

[4]  Kee-Eung Kim,et al.  A POMDP Approach to Optimizing P300 Speller BCI Paradigm , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Nader Pouratian,et al.  Unsupervîsed training of brain-computer interface systems using exnectation maximization , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[6]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[7]  Brian Roark,et al.  Brain–Computer Interface With Language Model–Electroencephalography Fusion for Locked-In Syndrome , 2014, Neurorehabilitation and neural repair.

[8]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[9]  Nader Pouratian,et al.  Online BCI Typing using Language Model Classifiers by ALS Patients in their Homes. , 2017, Brain computer interfaces.

[10]  Tobias Kaufmann,et al.  Spelling is Just a Click Away – A User-Centered Brain–Computer Interface Including Auto-Calibration and Predictive Text Entry , 2012, Front. Neurosci..

[11]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[13]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[14]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[15]  W. A. Sarnacki,et al.  Brain–computer interface (BCI) operation: optimizing information transfer rates , 2003, Biological Psychology.

[16]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[17]  J. R. Wolpaw,et al.  ' s personal copy A novel P 300-based brain – computer interface stimulus presentation paradigm : Moving beyond rows and columns q , 2010 .

[18]  Dennis J. McFarland,et al.  The P300-based brain–computer interface (BCI): Effects of stimulus rate , 2011, Clinical Neurophysiology.

[19]  Nader Pouratian,et al.  Evaluating True BCI Communication Rate through Mutual Information and Language Models , 2013, PloS one.

[20]  Nader Pouratian,et al.  Natural language processing with dynamic classification improves P300 speller accuracy and bit rate , 2012, Journal of neural engineering.

[21]  I. Witten,et al.  The Reactive Keyboard: a predictive typing aid , 1990, Computer.

[22]  Nader Pouratian,et al.  Integrating Language Information With a Hidden Markov Model to Improve Communication Rate in the P300 Speller , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[24]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[25]  Benjamin Schrauwen,et al.  A P300 BCI for the Masses: Prior Information Enables Instant Unsupervised Spelling , 2012, NIPS.

[26]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[27]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[28]  Xingyu Wang,et al.  A new P300 stimulus presentation pattern for EEG-based spelling systems , 2010, Biomedizinische Technik. Biomedical engineering.

[29]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[30]  Xiao Hu,et al.  The effects of stimulus timing features on P300 speller performance , 2013, Clinical Neurophysiology.

[31]  Brian Roark,et al.  RSVP keyboard: An EEG based typing interface , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Mark D. Dunlop,et al.  Predictive text entry methods for mobile phones , 2000, Personal Technologies.

[33]  Eric W. Sellers,et al.  Predictive Spelling With a P300-Based Brain–Computer Interface: Increasing the Rate of Communication , 2010, Int. J. Hum. Comput. Interact..