Pushing the Communication Speed Limit of a Noninvasive BCI Speller

Electroencephalogram (EEG) based brain-computer interfaces (BCI) may provide a means of communication for those affected by severe paralysis. However, the relatively low information transfer rates (ITR) of these systems, currently limited to 1 bit/sec, present a serious obstacle to their widespread adoption in both clinical and non-clinical applications. Here, we report on the development of a novel noninvasive BCI communication system that achieves ITRs that are severalfold higher than those previously reported with similar systems. Using only 8 EEG channels, 6 healthy subjects with little to no prior BCI experience selected characters from a virtual keyboard with sustained, error-free, online ITRs in excess of 3 bit/sec. By factoring in the time spent to notify the subjects of their selection, practical, error-free typing rates as high as 12.75 character/min were achieved, which allowed subjects to correctly type a 44-character sentence in less than 3.5 minutes. We hypothesize that ITRs can be further improved by optimizing the parameters of the interface, while practical typing rates can be significantly improved by shortening the selection notification time. These results provide compelling evidence that the ITR limit of noninvasive BCIs has not yet been reached and that further investigation into this matter is both justified and necessary.

[1]  J. Fermaglich.  Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[2]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[3]  Helge J. Ritter,et al.  Improving Transfer Rates in Brain Computer Interfacing: A Case Study , 2002, NIPS.

[4]  Worthy N. Martin,et al.  Human-computer interaction using eye-gaze input , 1989, IEEE Trans. Syst. Man Cybern..

[5]  M Salvaris,et al.  Visual modifications on the P300 speller BCI paradigm , 2009, Journal of neural engineering.

[6]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[7]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[8]  Cuntai Guan,et al.  High performance P300 speller for brain-computer interface , 2004, IEEE International Workshop on Biomedical Circuits and Systems, 2004..

[9]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Zoran Nenadic,et al.  Approximate information discriminant analysis: A computationally simple heteroscedastic feature extraction technique , 2008, Pattern Recognit..

[11]  Zoran Nenadic,et al.  Mental State Estimation for Brain--Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[12]  J. Pierce.  An introduction to information theory: symbols, signals & noise , 1980 .

[13]  Y. Nakajima,et al.  Visual stimuli for the P300 brain–computer interface: A comparison of white/gray and green/blue flicker matrices , 2009, Clinical Neurophysiology.

[14]  Christopher D. Wickens,et al.  The effects of stimulus sequence on event related potentials: A comparison of visual and auditory sequences , 1977 .

[15]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[16]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[17]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[19]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[20]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[21]  Zoran Nenadic,et al.  Information Discriminant Analysis: Feature Extraction with an Information-Theoretic Objective , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[23]  R. Lewand.  Cryptological Mathematics , 2000 .

[24]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[25]  Z. Nenadic,et al.  A Classwise PCA-based Recognition of Neural Data for Brain-Computer Interfaces , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  An H. Do,et al.  Brain-Computer Interface Controlled Functional Electrical Stimulation System for Ankle Movement , 2011, Journal of NeuroEngineering and Rehabilitation.

[27]  Joel W. Burdick,et al.  Spike detection using the continuous wavelet transform , 2005, IEEE Transactions on Biomedical Engineering.

[28]  Po T. Wang,et al.  BCI Controlled Walking Simulator For a BCI Driven FES Device , 2010 .

[29]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[30]  J. Polich,et al.  P300 amplitude is determined by target-to-target interval. , 2002, Psychophysiology.

[31]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[32]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[33]  Zoran Nenadic,et al.  An efficient discriminant-based solution for small sample size problem , 2009, Pattern Recognit..

[34]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[35]  Kari Torkkola,et al.  Feature Extraction by Non-Parametric Mutual Information Maximization , 2003, J. Mach. Learn. Res..

[36]  L. Devroye.  Non-Uniform Random Variate Generation , 1986 .

[37]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[38]  E. Harth,et al.  Electric Fields of the Brain: The Neurophysics of Eeg , 2005 .

[39]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[40]  David J. Reinkensmeyer,et al.  Noninvasive brain-computer interface driven hand orthosis , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[42]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[43]  Steven L. Johnson,et al.  Evaluation of P300-Based Brain-Computer Interface in Real-World Contexts , 2010, Int. J. Hum. Comput. Interact..

[44]  Martin E. Hellman,et al.  Probability of error, equivocation, and the Chernoff bound , 1970, IEEE Trans. Inf. Theory.

[45]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[46]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .