Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction

Evaluating human-computer interaction is essential as a broadening population uses machines, sometimes in sensitive contexts. However, traditional evaluation methods may fail to combine real-time measures, an “objective” approach and data contextualization. In this review we look at how adding neuroimaging techniques can respond to such needs. We focus on electroencephalography (EEG), as it could be handled effectively during a dedicated evaluation phase. We identify workload, attention, vigilance, fatigue, error recognition, emotions, engagement, flow and immersion as being recognizable by EEG. We find that workload, attention and emotions assessments would benefit the most from EEG. Moreover, we advocate to study further error recognition through neuroimaging to enhance usability and increase user experience.

[1]  Anne Bruseberg,et al.  Focus groups to support the industrial/product designer: a review based on current literature and designers' feedback. , 2002, Applied ergonomics.

[2]  Lennart E. Nacke,et al.  Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience , 2009, ArXiv.

[3]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Matthew Pike,et al.  CUES: Cognitive Usability Evaluation System , 2012, EuroHCIR.

[5]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[6]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[7]  Marcus A. Magnor,et al.  EEG analysis of implicit human visual perception , 2012, CHI.

[8]  J. Dichgans,et al.  Differential effects of central versus peripheral vision on egocentric and exocentric motion perception , 1973, Experimental Brain Research.

[9]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[10]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[11]  Robert J. K. Jacob,et al.  Combining Electroencephalograph and Functional Near Infrared Spectroscopy to Explore Users' Mental Workload , 2009, HCI.

[12]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[13]  Anton Nijholt,et al.  Brain-Computer Interfaces and User Experience Evaluation , 2012 .

[14]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[15]  Regan L. Mandryk,et al.  Game Metrics and Biometrics : The Future of Player Experience Research , 2009 .

[16]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[17]  Laura Astolfi,et al.  On the Use of EEG or MEG Brain Imaging Tools in Neuromarketing Research , 2011, Comput. Intell. Neurosci..

[18]  B. Oken,et al.  Vigilance, alertness, or sustained attention: physiological basis and measurement , 2006, Clinical Neurophysiology.

[19]  Maria V. Sanchez-Vives,et al.  How we experience immersive virtual environments: the concept of presence and its measurement * , 2009 .

[20]  Nico M Schmidt,et al.  Online detection of error-related potentials boosts the performance of mental typewriters , 2012, BMC Neuroscience.

[21]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[22]  M. Bushnell,et al.  Autonomic responses to heat pain: Heart rate, skin conductance, and their relation to verbal ratings and stimulus intensity , 2011, PAIN®.

[23]  Olga Sourina,et al.  Real-Time EEG-Based Emotion Recognition and Its Applications , 2011, Trans. Comput. Sci..

[24]  H FriedmanJerome On Bias, Variance, 0/1Loss, and the Curse-of-Dimensionality , 1997 .

[25]  S. Nieuwenhuis,et al.  Mental fatigue and task control: planning and preparation. , 2000, Psychophysiology.

[26]  Juliana Anyango Ogolla Usability Evaluation: Tasks Susceptible to Concurrent Think-Aloud Protocol , 2011 .

[27]  Ricardo Chavarriaga,et al.  Error Processing of Self-paced Movements , 2013 .

[28]  Brahim Hamadicharef Brain-Computer Interface (BCI) literature - a bibliometric study , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[29]  W. Klimesch,et al.  Induced alpha band power changes in the human EEG and attention , 1998, Neuroscience Letters.

[30]  Michel Besserve,et al.  Multimodal information improves the rapid detection of mental fatigue , 2013, Biomed. Signal Process. Control..

[31]  Laurent Bougrain,et al.  Processing Stages of Visual Stimuli and Event-Related Potentials , 2012 .

[32]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[33]  R Chavarriaga,et al.  Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Jan B. F. van Erp,et al.  Brain-Based Indices for User System Symbiosis , 2010, Brain-Computer Interfaces.

[35]  Maureen Clerc,et al.  Enhancing visuospatial attention performance with brain-computer interfaces , 2013, CHI Extended Abstracts.

[36]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[37]  G. Pfurtscheller,et al.  EEG-based communication: presence of an error potential , 2000, Clinical Neurophysiology.

[38]  Douglas Heingartner Mental block , 2009, IEEE Spectrum.

[39]  Andrew A Fingelkurts,et al.  The Brain's Alpha Rhythms and the Mind John Crosley Shaw; Elsevier Science B.V. 337 pages, ISBN: 0-444-51397-3 , 2004, Clinical Neurophysiology.

[40]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[41]  M. Just,et al.  Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work , 2003 .

[42]  C. Mehring,et al.  Detection of Error Related Neuronal Responses Recorded by Electrocorticography in Humans during Continuous Movements , 2013, PloS one.

[43]  Weiqiang Dong On Bias , Variance , 0 / 1-Loss , and the Curse of Dimensionality RK April 13 , 2014 .

[44]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[45]  K. R. Ridderinkhof,et al.  Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. , 2001, Psychophysiology.

[46]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[47]  Martin Hachet,et al.  A Survey of Interaction Techniques for Interactive 3D Environments , 2013, Eurographics.

[48]  G. Fricchione Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[49]  Chi Thanh Vi,et al.  Detecting error-related negativity for interaction design , 2012, CHI.

[50]  J. Matias,et al.  Review on psychophysiological methods in game research , 2010 .

[51]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[52]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[53]  Deborah Hix,et al.  Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2001 .

[54]  Lennart E. Nacke,et al.  Electroencephalographic Assessment of Player Experience , 2011 .

[55]  Mehmet Göktürk,et al.  Psychophysiological measures of human cognitive states applied in human computer interaction , 2011, WCIT.

[56]  Egon L. van den Broek,et al.  Modality-specific Affective Responses and their Implications for Affective BCI , 2011 .

[57]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[58]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[59]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[60]  Anatole Lécuyer,et al.  Using scalp electrical biosignals to control an object by concentration and relaxation tasks: Design and evaluation , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Alessandro De Gloria,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[62]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[63]  Raja Parasuraman Neuroergonomics: Brain-Inspired Cognitive Engineering , 2013 .