Brain Painting: Usability testing according to the user-centered design in end users with severe motor paralysis

BACKGROUND For many years the reestablishment of communication for people with severe motor paralysis has been in the focus of brain-computer interface (BCI) research. Recently applications for entertainment have also been developed. Brain Painting allows the user creative expression through painting pictures. OBJECTIVE The second, revised prototype of the BCI Brain Painting application was evaluated in its target function - free painting - and compared to the P300 spelling application by four end users with severe disabilities. METHODS According to the International Organization for Standardization (ISO), usability was evaluated in terms of effectiveness (accuracy), efficiency (information transfer rate (ITR)), utility metric, subjective workload (National Aeronautics and Space Administration Task Load Index (NASA TLX)) and user satisfaction (Quebec User Evaluation of Satisfaction with assistive Technology (QUEST) 2.0 and Assistive Technology Device Predisposition Assessment (ATD PA), Device Form). RESULTS The results revealed high performance levels (M≥80% accuracy) in the free painting and the copy painting conditions, ITRs (4.47-6.65bits/min) comparable to other P300 applications and only low to moderate workload levels (5-49 of 100), thereby proving that the complex task of free painting did neither impair performance nor impose insurmountable workload. Users were satisfied with the BCI Brain Painting application. Main obstacles for use in daily life were the system operability and the EEG cap, particularly the need of extensive support for adjustment. CONCLUSION The P300 Brain Painting application can be operated with high effectiveness and efficiency. End users with severe motor paralysis would like to use the application in daily life. User-friendliness, specifically ease of use, is a mandatory necessity when bringing BCI to end users. Early and active involvement of users and iterative user-centered evaluation enable developers to work toward this goal.

[1]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[2]  Christa Neuper,et al.  BCI-Applications: Needs and requirements of disabled end-users and professional users , 2010 .

[3]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[4]  C D Wickens,et al.  The dynamics of P300 during dual-task performance. , 1980, Progress in brain research.

[5]  Helge J. Ritter,et al.  2009 Special Issue: The MindGame: A P300-based brain-computer interface game , 2009 .

[6]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[7]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[8]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[9]  Klas Ihme,et al.  A Dry EEG-System for Scientific Research and Brain–Computer Interfaces , 2010, Front. Neurosci..

[10]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[11]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[12]  Ivan Volosyak,et al.  Brain–computer interface using water-based electrodes , 2010, Journal of neural engineering.

[13]  Jane E Huggins,et al.  Barriers to and mediators of brain–computer interface user acceptance: focus group findings , 2012, Ergonomics.

[14]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[15]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[16]  A. Kübler,et al.  Brain Painting: First Evaluation of a New Brain–Computer Interface Application with ALS-Patients and Healthy Volunteers , 2010, Front. Neurosci..

[17]  Jonathan R Wolpaw,et al.  A brain-computer interface for long-term independent home use , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[18]  Donatella Mattia,et al.  A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software , 2011, Clinical EEG and neuroscience.

[19]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[20]  Vera Kaiser,et al.  BCI Applications for People with Disabilities: Defining User Needs and User Requirements , 2009 .

[21]  Claude Vincent,et al.  Pilot on evaluating social participation following the use of an assistive technology designed to facilitate face-to-face communication between deaf and hearing persons , 2008 .

[22]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[23]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[24]  Gregg C. Vanderheiden,et al.  Mental workload during brain–computer interface training , 2012, Ergonomics.

[25]  B.Z. Allison,et al.  ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Hiroshi Mitsumoto,et al.  How common is depression among ALS caregivers? A longitudinal study. , 2009, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[27]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[28]  Tobias Kaufmann,et al.  A User Centred Approach for Bringing BCI Controlled Applications to End-Users , 2013 .

[29]  Klaus-Robert Müller,et al.  Playing Pinball with non-invasive BCI , 2008, NIPS.

[30]  Gregory D. Abowd,et al.  Human-Computer Interaction (3rd Edition) , 2003 .

[31]  D.J. McFarland,et al.  The wadsworth BCI research and development program: at home with BCI , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Tobias Kaufmann,et al.  Spelling is Just a Click Away – A User-Centered Brain–Computer Interface Including Auto-Calibration and Predictive Text Entry , 2012, Front. Neurosci..

[33]  Febo Cincotti,et al.  Controlling domotic appliances via a "dynamical" P300-based brain computer interface , 2009 .

[34]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.

[35]  Michael Bensch,et al.  Design and Implementation of a P300-Based Brain-Computer Interface for Controlling an Internet Browser , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  B. Blankertz,et al.  Practicing fast-decision BCI using a "goalkeeper" paradigm , 2009, BMC Neuroscience.

[37]  Louise Demers,et al.  The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): An overview and recent progress , 2002 .

[38]  M. Nuttin,et al.  Asynchronous non-invasive brain-actuated control of an intelligent wheelchair , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  André van Schaik,et al.  A new EEG recording system for passive dry electrodes , 2010, Clinical Neurophysiology.

[40]  M. Matteucci,et al.  The Utility Metric: A Novel Method to Assess the Overall Performance of Discrete Brain–Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Reza Fazel-Rezai.  Brain-Computer Interface Systems - Recent Progress and Future Prospects , 2013 .

[42]  F Cincotti,et al.  Workload measurement in a communication application operated through a P300-based brain–computer interface , 2011, Journal of neural engineering.