UMA-BCI Speller: An easily configurable P300 speller tool for end users

BACKGROUND AND OBJECTIVE Some neurodegenerative conditions can severely limit patients' capability to communicate because of the loss of muscular control. Brain-computer interfaces may help in the restoration of communication with these patients, bypassing the muscular activity, so that brain signals can be directly interpreted by a computer. There are many studies regarding brain-controlled spellers; however, these systems do not usually leap out of the lab because of technical and economic requirements. As a consequence, the potential end users do not benefit from these scientific advances in their daily life. The objective of this paper is to present a novel brain-controlled speller designed to be used by patients due to its versatility and ease of use. METHODS The brain-computer interface research group of the University of Málaga (UMA-BCI) has developed a speller application based on the well-known P300 potential which can be easily installed, configured and used. The application supports the common P300 paradigms: the Row-Column Paradigm and the Rapid Serial Visual Presentation Paradigm. The inner core of the application is implemented with a widely used and studied platform, BCI2000, which ensures its reliability and allows other researchers to apply modifications at will in order to test new features. Ten naïve volunteers carried out exercises using the application and completed usability tests for evaluation purposes. RESULTS New subjects using the application managed to set up and use the proposed speller in less than an hour. The positive results of the evaluation through the usability tests support this application's ease of use. CONCLUSIONS A new brain-controlled spelling tool has been presented whose aim is to be used by severely paralyzed patients in their daily lives, as well as by researchers to test new spelling features.

[1]  Klaus-Robert Müller,et al.  An Efficient ERP-Based Brain-Computer Interface Using Random Set Presentation and Face Familiarity , 2014, PloS one.

[2]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[3]  I Putu Susila,et al.  xBCI: A Generic Platform for Development of an Online BCI System , 2010 .

[4]  M. Congedo,et al.  Open-ViBE: A Three Dimensional Platform for Real-Time Neuroscience , 2005 .

[5]  Xingyu Wang,et al.  Targeting an efficient target-to-target interval for P300 speller brain–computer interfaces , 2012, Medical & Biological Engineering & Computing.

[6]  Piotr Augustyniak,et al.  Interfaces for tetraplegic people – review of solutions supporting activities of daily living , 2015, Bio Algorithms Med Syst..

[7]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[8]  Siamac Fazli,et al.  P300 visual speller based on random set presentation , 2014, 2014 International Winter Workshop on Brain-Computer Interface (BCI).

[9]  Mihaly Benda,et al.  Brain–Computer Interface Spellers: A Review , 2018, Brain sciences.

[10]  Rami Saab,et al.  An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface , 2016, Int. J. Neural Syst..

[11]  Michael Schaefer,et al.  Effects of different viewing perspectives on somatosensory activations during observation of touch , 2009, Human brain mapping.

[12]  T. C. Davies,et al.  Caregiver and special education staff perspectives of a commercial brain-computer interface as access technology: a qualitative study , 2018, Brain-Computer Interfaces.

[13]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[14]  Febo Cincotti,et al.  Advanced brain computer interface for communication and control , 2010, AVI.

[15]  Tanee Demeechai,et al.  New stimulation pattern design to improve P300-based matrix speller performance at high flash rate , 2013, Journal of neural engineering.

[16]  R. Fazel-Rezai,et al.  Human Error in P300 Speller Paradigm for Brain-Computer Interface , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Maria José Blanca-Mena,et al.  Brain-Computer Interface application: auditory serial interface to control a two-class motor-imagery-based wheelchair , 2017, Journal of NeuroEngineering and Rehabilitation.

[18]  Thierry Keller,et al.  Brain-computer interface based on high frequency steady-state visual evoked potentials: A feasibility study , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[19]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[20]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[21]  Chi Zhang,et al.  A novel P300 BCI speller based on the Triple RSVP paradigm , 2018, Scientific Reports.

[22]  F Babiloni,et al.  Introducing BF++: AC++ framework for cognitive bio-feedback systems design. , 2003, Methods of information in medicine.

[23]  Scott Makeig,et al.  BCILAB: a platform for brain–computer interface development , 2013, Journal of neural engineering.

[24]  Jin-Sup Eom,et al.  P300 speller using a new stimulus presentation paradigm , 2013, 2013 International Winter Workshop on Brain-Computer Interface (BCI).

[25]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[26]  Brendan Z. Allison,et al.  Non-invasive Brain-Computer Interfaces: Enhanced Gaming and Robotic Control , 2011, IWANN.

[27]  Xingyu Wang,et al.  A new P300 stimulus presentation pattern for EEG-based spelling systems , 2010, Biomedizinische Technik. Biomedical engineering.

[28]  Yu Ji,et al.  A submatrix-based P300 brain-computer interface stimulus presentation paradigm , 2012, Journal of Zhejiang University SCIENCE C.

[29]  Jonathan R Wolpaw,et al.  Independent home use of a brain-computer interface by people with amyotrophic lateral sclerosis , 2018, Neurology.

[30]  Wafa Alrajhi,et al.  Smart home: toward daily use of BCI-based systems , 2017, 2017 International Conference on Informatics, Health & Technology (ICIHT).

[31]  Urbano Nunes,et al.  GIBS block speller: Toward a gaze-independent P300-based BCI , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[33]  Nader Pouratian,et al.  A comparison of stimulus types in online classification of the P300 speller using language models , 2017, PloS one.

[34]  John Polich,et al.  Affective ERP processing in a visual oddball task: Arousal, valence, and gender , 2008, Clinical Neurophysiology.

[35]  Y. Sakai,et al.  Alphabet matrix layout in P300 speller may alter its performance , 2012, The 4th 2011 Biomedical Engineering International Conference.

[36]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[37]  Yang Liu,et al.  Comparison of stimulus types in visual P300 speller of brain-computer interfaces , 2010, 9th IEEE International Conference on Cognitive Informatics (ICCI'10).

[38]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[39]  Sercan Taha Ahi,et al.  A Dictionary-Driven P300 Speller With a Modified Interface , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  F. Cincotti,et al.  Developing brain-computer interfaces from a user-centered perspective: Assessing the needs of persons with amyotrophic lateral sclerosis, caregivers, and professionals. , 2015, Applied ergonomics.

[41]  Tobias Kaufmann,et al.  Beyond maximum speed—a novel two-stimulus paradigm for brain–computer interfaces based on event-related potentials (P300-BCI) , 2014, Journal of neural engineering.

[42]  Gerwin Schalk,et al.  A Practical Guide to Brain–Computer Interfacing with BCI2000: General-Purpose Software for Brain-Computer Interface Research, Data Acquisition, Stimulus Presentation, and Brain Monitoring , 2010 .

[43]  Jun Kong,et al.  Introducing the Edges Paradigm: A P300 Brain–Computer Interface for Spelling Written Words , 2015, IEEE Transactions on Human-Machine Systems.

[44]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[45]  Ivo Käthner,et al.  Rapid P300 brain-computer interface communication with a head-mounted display , 2015, Front. Neurosci..

[46]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[47]  Brendan Z. Allison,et al.  A comparison of face speller approaches for P300 BCIs , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[48]  Leslie M Collins,et al.  Evaluating Brain-Computer Interface Performance in an ALS Population: Checkerboard and Color Paradigms , 2018, Clinical EEG and neuroscience.

[49]  Steven L. Johnson,et al.  A P300-Based Brain–Computer Interface: Effects of Interface Type and Screen Size , 2010, Int. J. Hum. Comput. Interact..

[50]  Francisco Velasco-Álvarez,et al.  First study towards linear control of an upper-limb neuroprosthesis with an EEG-based Brain-Computer Interface , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[51]  Wolfgang Rosenstiel,et al.  Nessi: An EEG-Controlled Web Browser for Severely Paralyzed Patients , 2007, Comput. Intell. Neurosci..

[52]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[53]  B. Schoelkopf,et al.  Transition from the locked in to the completely locked-in state: A physiological analysis , 2011, Clinical Neurophysiology.

[54]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[55]  Clemens Brunner,et al.  BCI Software Platforms , 2012 .

[56]  Clemens Brunner,et al.  BioSig: A Free and Open Source Software Library for BCI Research , 2008, Computer.

[57]  Klaus-Robert Müller,et al.  Pyff – A Pythonic Framework for Feedback Applications and Stimulus Presentation in Neuroscience , 2010, Front. Neurosci..

[58]  Shuai Liu,et al.  Use of a Green Familiar Faces Paradigm Improves P300-Speller Brain-Computer Interface Performance , 2015, PloS one.

[59]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.