A Multifunctional Brain-Computer Interface Intended for Home Use: An Evaluation with Healthy Participants and Potential End Users with Dry and Gel-Based Electrodes

Current brain-computer interface (BCIs) software is often tailored to the needs of scientists and technicians and therefore complex to allow for versatile use. To facilitate home use of BCIs a multifunctional P300 BCI with a graphical user interface intended for non-expert set-up and control was designed and implemented. The system includes applications for spelling, web access, entertainment, artistic expression and environmental control. In addition to new software, it also includes new hardware for the recording of electroencephalogram (EEG) signals. The EEG system consists of a small and wireless amplifier attached to a cap that can be equipped with gel-based or dry contact electrodes. The system was systematically evaluated with a healthy sample, and targeted end users of BCI technology, i.e., people with a varying degree of motor impairment tested the BCI in a series of individual case studies. Usability was assessed in terms of effectiveness, efficiency and satisfaction. Feedback of users was gathered with structured questionnaires. Two groups of healthy participants completed an experimental protocol with the gel-based and the dry contact electrodes (N = 10 each). The results demonstrated that all healthy participants gained control over the system and achieved satisfactory to high accuracies with both gel-based and dry electrodes (average error rates of 6 and 13%). Average satisfaction ratings were high, but certain aspects of the system such as the wearing comfort of the dry electrodes and design of the cap, and speed (in both groups) were criticized by some participants. Six potential end users tested the system during supervised sessions. The achieved accuracies varied greatly from no control to high control with accuracies comparable to that of healthy volunteers. Satisfaction ratings of the two end-users that gained control of the system were lower as compared to healthy participants. The advantages and disadvantages of the BCI and its applications are discussed and suggestions are presented for improvements to pave the way for user friendly BCIs intended to be used as assistive technology by persons with severe paralysis.

[1]  A. Kübler,et al.  ERPs contributing to classification in the ”P300” BCI , 2011 .

[2]  Tobias Kaufmann,et al.  Spelling is Just a Click Away – A User-Centered Brain–Computer Interface Including Auto-Calibration and Predictive Text Entry , 2012, Front. Neurosci..

[3]  Benjamin Blankertz,et al.  A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System , 2011, Front. Neurosci..

[4]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[5]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[6]  Donatella Mattia,et al.  Facing the challenge: Bringing brain-computer interfaces to end-users , 2013, Artif. Intell. Medicine.

[7]  Gert Cauwenberghs,et al.  Wireless Non-contact EEG/ECG Electrodes for Body Sensor Networks , 2010, 2010 International Conference on Body Sensor Networks.

[8]  A. Kübler,et al.  Training leads to increased auditory brain–computer interface performance of end-users with motor impairments , 2016, Clinical Neurophysiology.

[9]  Daniel Sánchez Morillo,et al.  Dry EEG Electrodes , 2014, Sensors.

[10]  Brendan Z. Allison,et al.  Comparison of Dry and Gel Based Electrodes for P300 Brain–Computer Interfaces , 2012, Front. Neurosci..

[11]  J. Wolpaw,et al.  P300-based brain-computer interface (BCI) event-related potentials (ERPs): People with amyotrophic lateral sclerosis (ALS) vs. age-matched controls , 2015, Clinical Neurophysiology.

[12]  Selina Wriessnegger,et al.  A P300 BCI for e - inclusion, cognitive rehabilitation and smart home control , 2014 .

[13]  Tobias Kaufmann,et al.  Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state , 2013, Front. Neurosci..

[14]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[15]  Donatella Mattia,et al.  A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software , 2011, Clinical EEG and neuroscience.

[16]  Andrea Kübler,et al.  Independent home use of Brain Painting improves quality of life of two artists in the locked-in state diagnosed with amyotrophic lateral sclerosis , 2015 .

[17]  S.A. Wills,et al.  DASHER-an efficient writing system for brain-computer interfaces? , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Martin G Bleichner,et al.  Exploring miniaturized EEG electrodes for brain-computer interfaces. An EEG you do not see? , 2015, Physiological reports.

[19]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[20]  A. Kübler,et al.  The User-Centered Design as Novel Perspective for Evaluating the Usability of BCI-Controlled Applications , 2014, PloS one.

[21]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[22]  Eloisa Vargiu,et al.  Brain Neural Computer Interface for Everyday Home Usage , 2015, HCI.

[23]  J. Wolpaw,et al.  A practical, intuitive brain–computer interface for communicating ‘yes’ or ‘no’ by listening , 2014, Journal of neural engineering.

[24]  Tobias Kaufmann,et al.  Long-term independent brain-computer interface home use improves quality of life of a patient in the locked-in state: a case study. , 2015, Archives of physical medicine and rehabilitation.

[25]  Jyh-Yeong Chang,et al.  Novel Dry Polymer Foam Electrodes for Long-Term EEG Measurement , 2011, IEEE Transactions on Biomedical Engineering.

[26]  Josef Faller,et al.  Control or non-control state: that is the question! An asynchronous visual P300-based BCI approach , 2015, Journal of neural engineering.

[27]  Tobias Kaufmann,et al.  The WIN-speller: a new intuitive auditory brain-computer interface spelling application , 2015, Front. Neurosci..

[28]  F. Cincotti,et al.  Eye-gaze independent EEG-based brain–computer interfaces for communication , 2012, Journal of neural engineering.

[29]  Roozbeh Jafari,et al.  Characterizing contact impedance, signal quality and robustness as a function of the cardinality and arrangement of fingers on dry contact EEG electrodes , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Eloisa Vargiu,et al.  Brain Computer Interface on Track to Home , 2015, TheScientificWorldJournal.

[31]  Reza Fazel-Rezai,et al.  A Review of Hybrid Brain-Computer Interface Systems , 2013, Adv. Hum. Comput. Interact..

[32]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[33]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[34]  Tzyy-Ping Jung,et al.  Biosensor Technologies for Augmented Brain–Computer Interfaces in the Next Decades , 2012, Proceedings of the IEEE.

[35]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[36]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[37]  K. Rosenkranz,et al.  An in-the-ear platform for recording electroencephalogram , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  Gernot R. Müller-Putz,et al.  Evaluation of Different EEG Acquisition Systems Concerning Their Suitability for Building a Brain–Computer Interface: Case Studies , 2016, Front. Neurosci..

[39]  Febo Cincotti,et al.  Out of the frying pan into the fire--the P300-based BCI faces real-world challenges. , 2011, Progress in brain research.

[40]  Young-Joo Kim,et al.  Usability of the P300 Speller: Towards a More Sustainable Brain-Computer Interface , 2009, e Minds Int. J. Hum. Comput. Interact..

[41]  Ivo Käthner,et al.  Rapid P300 brain-computer interface communication with a head-mounted display , 2015, Front. Neurosci..

[42]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  S. Debener,et al.  Towards a truly mobile auditory brain-computer interface: exploring the P300 to take away. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  Andrea Kübler,et al.  Brain Painting V2: evaluation of P300-based brain-computer interface for creative expression by an end-user following the user-centered design , 2015 .

[45]  Bor-Shyh Lin,et al.  A Wearable Channel Selection-Based Brain-Computer Interface for Motor Imagery Detection , 2016, Sensors.

[46]  Eloisa Vargiu,et al.  Cognitive Rehabilitation through BNCI: Serious Games in BackHome , 2014 .

[47]  Nicholas P. Fey,et al.  Controlling Knee Swing Initiation and Ankle Plantarflexion With an Active Prosthesis on Level and Inclined Surfaces at Variable Walking Speeds , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[48]  J. Huggins,et al.  What would brain-computer interface users want? Opinions and priorities of potential users with amyotrophic lateral sclerosis , 2011, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[49]  Shao-Wei Lu,et al.  Design, Fabrication, and Experimental Validation of Novel Flexible Silicon-Based Dry Sensors for Electroencephalography Signal Measurements , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[50]  Gernot R. Müller-Putz,et al.  Brain-controlled applications using dynamic P300 speller matrices , 2015, Artif. Intell. Medicine.

[51]  Suzanne Martin,et al.  P300 Brain Computer Interface Control after an Acquired Brain Injury , 2015 .

[52]  Klas Ihme,et al.  A Dry EEG-System for Scientific Research and Brain–Computer Interfaces , 2010, Front. Neurosci..

[53]  Gernot R. Müller-Putz,et al.  In pursuit of an easy to use brain computer interface for domestic use in a population with brain injury , 2015 .

[54]  D. P. Mandic,et al.  The In-the-Ear Recording Concept: User-Centered and Wearable Brain Monitoring , 2012, IEEE Pulse.

[55]  Eloisa Vargiu,et al.  Brain–Computer Interfaces on Track to Home: Results of the Evaluation at Disabled End-Users’ Homes and Lessons Learnt , 2015, Front. ICT.

[56]  Jyh-Yeong Chang,et al.  Gaming control using a wearable and wireless EEG-based brain-computer interface device with novel dry foam-based sensors , 2012, Journal of NeuroEngineering and Rehabilitation.

[57]  Ivo Käthner,et al.  An auditory multiclass brain-computer interface with natural stimuli: Usability evaluation with healthy participants and a motor impaired end user , 2015, Front. Hum. Neurosci..

[58]  Peter Enoksson,et al.  Micromachined electrodes for biopotential measurements , 2001 .

[59]  S. Debener,et al.  Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear , 2015, Scientific Reports.

[60]  Yuanqing Li,et al.  Surfing the internet with a BCI mouse , 2012, Journal of neural engineering.

[61]  Mark T. Waters,et al.  This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits distribution,andreproductioninanymedium,providedtheoriginalauthorandsourcearecredited.Thislicensedoesnot permit commercial exploitation or the creation of derivative works without sp , 2009 .

[62]  Paolo Castiglioni,et al.  Brain-computer interfaces and neurorehabilitation. , 2009, Studies in health technology and informatics.

[63]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[64]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[65]  Kouji Takano,et al.  A Non-Adhesive Solid-Gel Electrode for a Non-Invasive Brain–Machine Interface , 2012, Front. Neur..

[66]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[67]  C. Grozea,et al.  Bristle-sensors—low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications , 2011, Journal of neural engineering.

[68]  Andrea Kübler,et al.  Wheelchair control by elderly participants in a virtual environment with a brain-computer interface (BCI) and tactile stimulation , 2016, Biological Psychology.

[69]  Tzyy-Ping Jung,et al.  Dry-Contact and Noncontact Biopotential Electrodes: Methodological Review , 2010, IEEE Reviews in Biomedical Engineering.

[70]  J. Huggins,et al.  What would brain-computer interface users want: opinions and priorities of potential users with spinal cord injury. , 2015, Archives of physical medicine and rehabilitation.

[71]  Febo Cincotti,et al.  Hybrid P300-based brain-computer interface to improve usability for people with severe motor disability: electromyographic signals for error correction during a spelling task. , 2015, Archives of physical medicine and rehabilitation.

[72]  Ferdinando Grossi,et al.  Light on! Real world evaluation of a P300-based brain–computer interface (BCI) for environment control in a smart home , 2012, Ergonomics.

[73]  Chin-Teng Lin,et al.  Design, Fabrication and Experimental Validation of a Novel Dry-Contact Sensor for Measuring Electroencephalography Signals without Skin Preparation , 2011, Sensors.

[74]  Ivo Käthner,et al.  Comparison of eye tracking, electrooculography and an auditory brain-computer interface for binary communication: a case study with a participant in the locked-in state , 2015, Journal of NeuroEngineering and Rehabilitation.

[75]  Louise Demers,et al.  The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): An overview and recent progress , 2002 .

[76]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[77]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[78]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[79]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[80]  A. Kübler,et al.  Brain Painting: First Evaluation of a New Brain–Computer Interface Application with ALS-Patients and Healthy Volunteers , 2010, Front. Neurosci..