A Chinese Text Input Brain–Computer Interface Based on the P300 Speller

A visual speller is a brain–computer interface that empowers users with limited motor functionality to input text into a computer by measuring their electroencephalographic responses to visual stimuli. Most prior research on visual spellers has focused on input of alphabetic text. Adapting a speller for other types of segmental or syllabic script is straightforward because such scripts comprise sufficiently few characters that they may all be displayed to the user simultaneously. Logographic scripts, such as Chinese hanzi, however, impose a challenge: How should the thousands of Chinese characters be displayed to the user? Here, we present a visual speller, based on Farwell and Donchin's P300 Speller, for Chinese character input. The speller uses a novel shape-based method called the First–Last, or FLAST, method to encode more than 7,000 Chinese characters. Characters are input by selecting two components, from a set of 56 distinct components, that match the shape of the target character, followed by selection of the character itself. At the input speed of one character per 107 s, 24 able-bodied participants achieved mean online accuracy of 82.8% per component selection and 63.5% per character input. At the faster input speed of one character per 77 s, mean online accuracy was 59.4% per component selection and 33.3% per character input.

[1]  Xingyu Wang,et al.  P300 Chinese input system based on Bayesian LDA , 2010, Biomedizinische Technik. Biomedical engineering.

[2]  M. Kuba,et al.  Visual evoked potentials specific for motion onset , 2004, Documenta Ophthalmologica.

[3]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[4]  Emanuel Donchin,et al.  Definition, Identification, and Reliability of Measurement of the P300 Component of the Event-Related Brain Potential , 1987 .

[5]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[6]  E W Sellers,et al.  Suppressing flashes of items surrounding targets during calibration of a P300-based brain–computer interface improves performance , 2011, Journal of neural engineering.

[7]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[8]  Steven L. Johnson,et al.  A P300-Based Brain–Computer Interface: Effects of Interface Type and Screen Size , 2010, Int. J. Hum. Comput. Interact..

[9]  Sarah Ogilvie,et al.  Concise Encyclopedia of Languages of the World , 2010 .

[10]  E R John,et al.  Information Delivery and the Sensory Evoked Potential , 1967, Science.

[11]  P. Lewis Ethnologue : languages of the world , 2009 .

[12]  Gerald J. Hahn,et al.  Applied Regression Analysis (2nd Ed.) , 2012 .

[13]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[14]  Steven L. Johnson,et al.  Evaluation of P300-Based Brain-Computer Interface in Real-World Contexts , 2010, Int. J. Hum. Comput. Interact..

[15]  Benjamin Blankertz,et al.  Two-dimensional auditory p300 speller with predictive text system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  Eric W. Sellers,et al.  Predictive Spelling With a P300-Based Brain–Computer Interface: Increasing the Rate of Communication , 2010, Int. J. Hum. Comput. Interact..

[17]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[18]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[19]  B.Z. Allison,et al.  ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  James W. Minett,et al.  CHINESE INPUT METHODS: OVERVIEW AND COMPARISONS , 2012 .

[21]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[22]  Gerwin Schalk,et al.  Rapid Communication with a “P300” Matrix Speller Using Electrocorticographic Signals (ECoG) , 2010, Front. Neurosci..

[23]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[24]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[25]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[26]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  W. Bright,et al.  The World's Writing Systems , 1997 .

[28]  G. Driem Languages of the Himalayas : an ethnolinguistic handbook of the greater Himalayan region : containing an introduction to the symbiotic theory of language , 2001 .

[29]  Gang Peng,et al.  An Assistive Communication Brain-Computer Interface for Chinese Text Input , 2010, 2010 4th International Conference on Bioinformatics and Biomedical Engineering.

[30]  Li Xin,et al.  A Virtual Chinese Keyboard BCI System Based on P300 Potentials , 2009 .

[31]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Ted Rule,et al.  Chinese Language , 2009 .

[33]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[34]  Febo Cincotti,et al.  Tactile, Visual, and Bimodal P300s: Could Bimodal P300s Boost BCI Performance? , 2010 .

[35]  C. Neuper,et al.  Toward a high-throughput auditory P300-based brain–computer interface , 2009, Clinical Neurophysiology.

[36]  C. F. Hockett,et al.  The World's Writing Systems , 1997 .

[37]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[38]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[39]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.