Towards a holistic assessment of the user experience with hybrid BCIs

OBJECTIVE In recent years, brain-computer interfaces (BCIs) have become mature enough to immensely benefit from the expertise and tools established in the field of human-computer interaction (HCI). One of the core objectives in HCI research is the design of systems that provide a pleasurable user experience (UX). While the majority of BCI studies exclusively evaluate common efficiency measures such as classification accuracy and speed, single research groups have begun to look at further usability aspects such as ease of use, workload and learnability. However, these evaluation metrics only cover pragmatic aspects of UX while still not considering the hedonic quality of UX. In order to gain a holistic perspective on UX, hedonic quality aspects such as motivation and frustration were also taken into account for our evaluation of three BCI-driven interfaces, which were proposed to be used as a two-stage neuroprosthetic control within the EU project MUNDUS. APPROACH At the first stage, one of six possible actions was selected and either confirmed or cancelled at the second stage. For the experiment, a solely event-related-potential-based interface (ERP-ERP) and two hybrid solutions were tested that were controlled by ERP and motor imagery (MI)--resulting in the two possible combinations: ERP selection/MI confirmation (ERP-MI) or MI selection/ERP confirmation (MI-ERP). Behavioural, subjective and encephalographic (EEG) data of 12 healthy subjects were collected during an online experiment with the three graphical user interfaces (GUIs). MAIN RESULTS Results showed a significantly greater pragmatic quality (in terms of accuracy, efficiency, workload, use quality and learnability) for the ERP-ERP and ERP-MI GUIs in contrast to the MI-ERP GUI. Consequently, the MI-ERP GUI is least suited for use as a neuroprosthetic control. With respect to the comparison of the ERP-ERP and ERP-MI GUIs, no significant differences in pragmatic and hedonic quality of UX were found. Since throughout better results were obtained for the conventional approach and it was most preferred by the subjects, the ERP-ERP GUI seems more suitable for its deployment in actual end-users. Nevertheless, for individuals with stable MI patterns, the hybrid interface can be provided as an additional option of choice within the MUNDUS framework. SIGNIFICANCE Although the paramount goal in BCI research still remains the improvement of classification accuracy and communication speed, it is of significance to note that it is equally important for end-users to keep up their motivation and prevent frustration. By including pragmatic as well as hedonic quality aspects, this study is the first effort to gain a holistic perspective of the UX while interacting with BCI-driven assistive technology aimed at actual end-users. The broad-scale methodology provided valuable insights into the underlying dynamics causing the users' experience to differ across the GUIs. The results will be used to refine a BCI-driven neuroprosthesis and test it with end-users.

[1]  Anton Nijholt,et al.  A Study in User-Centered Design and Evaluation of Mental Tasks for BCI , 2011, MMM.

[2]  Mannes Poel,et al.  Evaluating User Experience in a Selection Based Brain-Computer Interface Game A Comparative Study , 2011, ICEC.

[3]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[4]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[5]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[6]  Antinus Nijholt,et al.  User Experience Evaluation in BCI: Mind the Gap! , 2011 .

[7]  Cornelia Herbert,et al.  Brain Painting: Usability testing according to the user-centered design in end users with severe motor paralysis , 2013, Artif. Intell. Medicine.

[8]  Benjamin Blankertz,et al.  A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface , 2007, HCI.

[9]  Marc Hassenzahl,et al.  The Effect of Perceived Hedonic Quality on Product Appealingness , 2001, Int. J. Hum. Comput. Interact..

[10]  Thorsten O. Zander,et al.  Combining Eye Gaze Input With a Brain–Computer Interface for Touchless Human–Computer Interaction , 2010, Int. J. Hum. Comput. Interact..

[11]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[12]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[13]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  M Angelborg-Thanderz,et al.  Information complexity--mental workload and performance in combat aircraft. , 1997, Ergonomics.

[15]  Anne Marsden,et al.  International Organization for Standardization , 2014 .

[16]  M S Treder,et al.  Gaze-independent brain–computer interfaces based on covert attention and feature attention , 2011, Journal of neural engineering.

[17]  F Cincotti,et al.  Workload measurement in a communication application operated through a P300-based brain–computer interface , 2011, Journal of neural engineering.

[18]  Motoaki Kawanabe,et al.  Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces , 2011, IEEE Transactions on Biomedical Engineering.

[19]  Michael Tangermann,et al.  Brain-computer interface controlled gaming: Evaluation of usability by severely motor restricted end-users , 2013, Artif. Intell. Medicine.

[20]  Nicholas J. Kaiser,et al.  Physiologically inspired cardiac scaffolds for tailored in vivo function and heart regeneration , 2015, Biomedical materials.

[21]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction. Users Diversity , 2011, Lecture Notes in Computer Science.

[22]  A Riccio,et al.  Applying the user-centred design to evaluation of Brain-Computer Interface controlled applications , 2013, Biomedizinische Technik. Biomedical engineering.

[23]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[24]  Patrick S Doyle,et al.  Material properties of biofilms—a review of methods for understanding permeability and mechanics , 2015, Reports on progress in physics. Physical Society.

[25]  Stefano Federici,et al.  Toward functioning and usable brain–computer interfaces (BCIs): A literature review , 2012, Disability and rehabilitation. Assistive technology.

[26]  Francisco Velasco-Álvarez,et al.  First study towards linear control of an upper-limb neuroprosthesis with an EEG-based Brain-Computer Interface , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[28]  Mikko Sams,et al.  EEG-Based Brain-Computer Interface for Tetraplegics , 2007, Comput. Intell. Neurosci..

[29]  Giancarlo Ferrigno,et al.  MUNDUS: MUltimodal Neuroprosthesis for Daily Upper limb Support , 2010 .

[30]  Mannes Poel,et al.  Evaluating user experience with respect to user expectations in brain-computer interface games , 2011 .

[31]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[32]  Eric W. Sellers,et al.  The effect of task based motivation on BCI performance: A preliminary outlook. , 2013 .

[33]  T. Perneger What's wrong with Bonferroni adjustments , 1998, BMJ.

[34]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[35]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[36]  Benjamin Blankertz,et al.  Designing for uncertain, asymmetric control: Interaction design for brain-computer interfaces , 2009, Int. J. Hum. Comput. Stud..

[37]  Donatella Mattia,et al.  A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software , 2011, Clinical EEG and neuroscience.

[38]  Desney S. Tan,et al.  Brain-Computer Interfaces and Human-Computer Interaction , 2010, Brain-Computer Interfaces.

[39]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[40]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[41]  C D Wickens,et al.  Assessment of pilot performance and mental workload in rotary wing aircraft. , 1993, Ergonomics.

[42]  Dirk Heylen,et al.  Evaluating User Experience of Actual and Imagined Movement in BCI Gaming , 2010, Int. J. Gaming Comput. Mediat. Simulations.

[43]  John Williamson,et al.  User-centered design in brain-computer interfaces - A case study , 2013, Artif. Intell. Medicine.

[44]  Stefano Federici,et al.  Toward a Usability Evaluation of BCIs , 2011 .

[45]  J.J. Vidal,et al.  Real-time detection of brain events in EEG , 1977, Proceedings of the IEEE.

[46]  D. Altman,et al.  Multiple significance tests: the Bonferroni method , 1995, BMJ.

[47]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction. Ambient Interaction, 4th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2007 Held as Part of HCI International 2007 Beijing, China, July 22-27, 2007 Proceedings, Part II , 2007, HCI.

[48]  Andrew D. Straw,et al.  Vision Egg: an Open-Source Library for Realtime Visual Stimulus Generation , 2008, Frontiers Neuroinformatics.

[49]  Steven C.R. Williams,et al.  Cortical activation during motor imagery is reduced in Amyotrophic Lateral Sclerosis , 2007, Brain Research.

[50]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[51]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[52]  Cheryl K. Beeler,et al.  Workload history effects: A comparison of sudden increases and decreases on performance , 2006 .

[53]  Benjamin Blankertz,et al.  Hybrid EEG-Based BCI User Interface for Action Selection , 2013 .

[54]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[55]  Marc Hassenzahl,et al.  User experience (UX): towards an experiential perspective on product quality , 2008, IHM '08.

[56]  Gernot R. Müller-Putz,et al.  Discrimination of Motor Imagery-Induced EEG Patterns in Patients with Complete Spinal Cord Injury , 2009, Comput. Intell. Neurosci..

[57]  M A Waclawiw,et al.  Practical guidelines for multiplicity adjustment in clinical trials. , 2000, Controlled clinical trials.

[58]  E. Donchin,et al.  EEG-based communication: prospects and problems. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[59]  Klaus-Robert Müller,et al.  Pyff – A Pythonic Framework for Feedback Applications and Stimulus Presentation in Neuroscience , 2010, Front. Neurosci..