Framework for Electroencephalography-based Evaluation of User Experience

Measuring brain activity with electroencephalography (EEG) is mature enough to assess mental states. Combined with existing methods, such tool can be used to strengthen the understanding of user experience. We contribute a set of methods to estimate continuously the user's mental workload, attention and recognition of interaction errors during different interaction tasks. We validate these measures on a controlled virtual environment and show how they can be used to compare different interaction techniques or devices, by comparing here a keyboard and a touch-based interface. Thanks to such a framework, EEG becomes a promising method to improve the overall usability of complex computer systems.

[1]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[2]  Jérémy Frey,et al.  Continuous Mental Effort Evaluation During 3D Object Manipulation Tasks Based on Brain and Physiological Signals , 2015, INTERACT.

[3]  Gerwin Schalk,et al.  BCI Hardware and Software , 2012 .

[4]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[5]  Christian Mühl,et al.  Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction , 2013, PhyCS.

[6]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[7]  Matthew Pike,et al.  CUES: Cognitive Usability Evaluation System , 2012, EuroHCIR.

[8]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[9]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[10]  Edward Cutrell,et al.  BCI for passive input in HCI , 2007 .

[11]  Nilli Lavie,et al.  The role of perceptual load in inattentional blindness , 2007, Cognition.

[12]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[13]  A. John Maule,et al.  The effects of time pressure on human judgement and decision making , 1997 .

[14]  J. Matias,et al.  Review on psychophysiological methods in game research , 2010 .

[15]  Stephen H. Fairclough,et al.  Use of auditory event-related potentials to measure immersion during a computer game , 2015, Int. J. Hum. Comput. Stud..

[16]  G. Michael Poor,et al.  Mobility Matters: Identifying Cognitive Demands That Are Sensitive to Orientation , 2013, INTERACT.

[17]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[18]  David R. Flatla,et al.  Calibration games: making calibration tasks enjoyable by adding motivating game elements , 2011, UIST.

[19]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  J. Coull.  Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology , 1998, Progress in Neurobiology.

[21]  K. R. Ridderinkhof,et al.  Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. , 2001, Psychophysiology.

[22]  F. E. Grubbs.  Procedures for Detecting Outlying Observations in Samples , 1969 .

[23]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[24]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[25]  M. Manosevitz.  High-Speed Scanning in Human Memory , .

[26]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[27]  O. Svenson,et al.  Decision making : cognitive models and explanations , 1997 .

[28]  Tanja Schultz,et al.  Design and Evaluation of a Self-Correcting Gesture Interface based on Error Potentials from EEG , 2015, CHI.

[29]  Robert J. K. Jacob,et al.  Using fNIRS brain sensing to evaluate information visualization interfaces , 2013, CHI.

[30]  Maureen Clerc,et al.  Enhancing visuospatial attention performance with brain-computer interfaces , 2013, CHI Extended Abstracts.

[31]  Ranjana K. Mehta,et al.  Neuroergonomics: a review of applications to physical and cognitive work , 2013, Front. Hum. Neurosci..

[32]  Chi Thanh Vi,et al.  Detecting error-related negativity for interaction design , 2012, CHI.

[33]  Touradj Ebrahimi,et al.  Spatial filters for the classification of event-related potentials , 2006, ESANN.

[34]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[35]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[36]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .