Increasing BCI communication rates with dynamic stopping towards more practical use: an ALS study

OBJECTIVE The P300 speller is a brain-computer interface (BCI) that can possibly restore communication abilities to individuals with severe neuromuscular disabilities, such as amyotrophic lateral sclerosis (ALS), by exploiting elicited brain signals in electroencephalography (EEG) data. However, accurate spelling with BCIs is slow due to the need to average data over multiple trials to increase the signal-to-noise ratio (SNR) of the elicited brain signals. Probabilistic approaches to dynamically control data collection have shown improved performance in non-disabled populations; however, validation of these approaches in a target BCI user population has not occurred. APPROACH We have developed a data-driven algorithm for the P300 speller based on Bayesian inference that improves spelling time by adaptively selecting the number of trials based on the acute SNR of a user's EEG data. We further enhanced the algorithm by incorporating information about the user's language. In this current study, we test and validate the algorithms online in a target BCI user population, by comparing the performance of the dynamic stopping (DS) (or early stopping) algorithms against the current state-of-the-art method, static data collection, where the amount of data collected is fixed prior to online operation. MAIN RESULTS Results from online testing of the DS algorithms in participants with ALS demonstrate a significant increase in communication rate as measured in bits/min (100-300%), and theoretical bit rate (100-550%), while maintaining selection accuracy. Participants also overwhelmingly preferred the DS algorithms. SIGNIFICANCE We have developed a viable BCI algorithm that has been tested in a target BCI population which has the potential for translation to improve BCI speller performance towards more practical use for communication.

[1]  Eloy Opisso,et al.  Accuracy of a P300 Speller for People with Motor Impairments: A Comparison , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[2]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[3]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[4]  Tobias Kaufmann,et al.  Spelling is Just a Click Away – A User-Centered Brain–Computer Interface Including Auto-Calibration and Predictive Text Entry , 2012, Front. Neurosci..

[5]  Dennis J. McFarland,et al.  BCIs in the Laboratory and at Home: The Wadsworth Research Program , 2009 .

[6]  T. Chau,et al.  A Review of EEG-Based Brain-Computer Interfaces as Access Pathways for Individuals with Severe Disabilities , 2013, Assistive technology : the official journal of RESNA.

[7]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[8]  W. A. Sarnacki,et al.  Brain–computer interface (BCI) operation: optimizing information transfer rates , 2003, Biological Psychology.

[9]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[10]  F Cincotti,et al.  Current trends in hardware and software for brain–computer interfaces (BCIs) , 2011, Journal of neural engineering.

[11]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[12]  F. Cincotti,et al.  Attention and P300-based BCI performance in people with amyotrophic lateral sclerosis , 2013, Front. Hum. Neurosci..

[13]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[14]  Leslie M. Collins,et al.  Utilizing a Language Model to Improve Online Dynamic Data Collection in P300 Spellers , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Benjamin Blankertz,et al.  A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface , 2007, HCI.

[16]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[18]  William J Tyler,et al.  A quantitative overview of biophysical forces impinging on neural function , 2013, Physical biology.

[19]  Nader Pouratian,et al.  Integrating Language Information With a Hidden Markov Model to Improve Communication Rate in the P300 Speller , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[21]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[22]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[23]  J. Polich,et al.  P300 Habituation Patterns: Individual Differences from Ultradian Rhythms , 1999, Perceptual and motor skills.

[24]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[25]  Cuntai Guan,et al.  Towards Asynchronous Brain-computer Interfaces: A P300-based Approach with Statistical Models , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  K. A. Colwell,et al.  Bayesian Approach to Dynamically Controlling Data Collection in P300 Spellers , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[28]  Tobias Kaufmann,et al.  Bringing BCI Controlled Devices to End-Users: A User Centred Approach and Evaluation , 2013 .

[29]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Benjamin Blankertz,et al.  Performance optimization of ERP-based BCIs using dynamic stopping , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Wolfgang Rosenstiel,et al.  Online use of error-related potentials in healthy users and people with severe motor impairment increases performance of a P300-BCI , 2012, Clinical Neurophysiology.

[32]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[33]  Murat Akcakaya,et al.  Noninvasive Brain–Computer Interfaces for Augmentative and Alternative Communication , 2014, IEEE Reviews in Biomedical Engineering.

[34]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[35]  Eric W. Sellers,et al.  Noninvasive brain-computer interface enables communication after brainstem stroke , 2014, Science Translational Medicine.

[36]  Kee-Eung Kim,et al.  A POMDP approach to P300-based brain-computer interfaces , 2010, IUI '10.

[37]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[38]  Sven P. Heinrich,et al.  Signal and noise in P300 recordings to visual stimuli , 2008, Documenta Ophthalmologica.

[39]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[40]  C. Throckmorton,et al.  Extending Language Modeling to Improve Dynamic Data Collection in ERP-based Spellers , 2014 .

[41]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[42]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[43]  J. Wolpaw,et al.  Brain-computer interface (BCI) evaluation in people with amyotrophic lateral sclerosis , 2014, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[44]  Benjamin Blankertz,et al.  Two-dimensional auditory p300 speller with predictive text system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[45]  E. Thomas,et al.  Optimizing P300-speller sequences by RIP-ping groups apart , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[46]  Brian Roark,et al.  RSVP keyboard: An EEG based typing interface , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Eric W. Sellers,et al.  Predictive Spelling With a P300-Based Brain–Computer Interface: Increasing the Rate of Communication , 2010, Int. J. Hum. Comput. Interact..

[48]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[49]  F Babiloni,et al.  A comparison of classification techniques for a gaze-independent P300-based brain-computer interface. , 2012, Journal of neural engineering.

[50]  Shangkai Gao,et al.  An online brain–computer interface using non-flashing visual evoked potentials , 2010, Journal of neural engineering.