A study about psychophysiological measures in user experience monitoring and evaluation

User experience (UX) has received increased attention in last years, in a reality of mobile applications and internet of things. In order to increase competitiveness, companies have been invested in understand user's emotions during the experience. However, this is still a challenge for HCI researchers. This article presents an investigation, as a part of a major research, based on 14 studies, about use of psychophysiological measures in HCI research. We found 1) that psychophysiological measures are still difficult to apply, once sensors are still invasive and difficult to understand and use; 2) each psychophysiological measure represents various emotions, and each emotion is measured by various psychophysiological measures; and 3) it is necessary to explore and discover more solutions to user's emotion measurement. This scenario shows an opportunity for UX evaluation methods, once a future work considers the use of psychophysiological measures.

[1]  Timo Partala,et al.  The combined walkthrough: measuring behavioral, affective, and cognitive information in usability testing , 2009 .

[2]  David Lester Neumann,et al.  The psychophysiological measurement of empathy , 2011 .

[3]  Jean Scholtz,et al.  Usability Evaluation , 2001 .

[4]  Nicu Sebe,et al.  UX_Mate: from facial expressions to UX evaluation , 2012, DIS '12.

[5]  Lei Zhou,et al.  Using Physiological Measures to Evaluate User Experience of Mobile Applications , 2014, HCI.

[6]  Francisco Luis Gutiérrez Vela,et al.  Enriching Evaluation in Video Games , 2011, INTERACT.

[7]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[8]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[9]  Aiur Retegi,et al.  Eyeface: A new multimethod tool to evaluate the perception of conceptual user experiences , 2015, Comput. Hum. Behav..

[10]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[11]  Rosalind W. Picard.  Affective Computing for HCI , 1999, HCI.

[12]  Robert J. Logan,et al.  Behavioral and emotional usability: Thomson Consumer Electronics , 1994 .

[13]  Fabio Abbattista,et al.  User brain-driven evaluation of an educational 3D virtual environment , 2015, 2015 10th Iberian Conference on Information Systems and Technologies (CISTI).

[14]  P. Jordan.  Designing Pleasurable Products: An Introduction to the New Human Factors , 2000 .

[15]  Andreas Beu,et al.  Engineering Joy , 2001, IEEE Softw..

[16]  Thomas B. Moeslund,et al.  Interfacing assessment using facial expression recognition , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[17]  Leanne M. Hirshfield,et al.  Using Noninvasive Brain Measurement to Explore the Psychological Effects of Computer Malfunctions on Users during Human-Computer Interactions , 2014, Adv. Hum. Comput. Interact..

[18]  Stephen H. Fairclough,et al.  Capturing user engagement via psychophysiology: measures and mechanisms for biocybernetic adaptation , 2013, Int. J. Auton. Adapt. Commun. Syst..

[19]  Foglia Pierfrancesco,et al.  Towards Relating Physiological Signals to Usability Metrics: A Case Study with a Web Avatar , 2014 .

[20]  Martin Ebner,et al.  Emotion Detection: Application of the Valence Arousal Space for Rapid Biological Usability Testing to Enhance Universal Access , 2009, HCI.

[21]  Harold W. Thimbleby,et al.  User experience evaluation through the brain's electrical activity , 2014, NordiCHI.

[22]  Anshu Agarwal,et al.  Beyond usability: evaluating emotional response as an integral part of the user experience , 2009, CHI Extended Abstracts.

[23]  Camila Loiola Brito Maia,et al.  Uma revisão sistemática sobre medição da experiência do usuário , 2014, IHC.

[24]  Tieniu Tan,et al.  Affective Computing: A Review , 2005, ACII.

[25]  Ming-Chuan Chiu,et al.  Integrating psychological and physiological techniques to measure and improve usability an empirical study on health management sport applied product , 2014, Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[26]  Georgios N. Yannakakis,et al.  Correlation between heart rate, electrodermal activity and player experience in first-person shooter games , 2010, Sandbox '10.

[27]  J. Russell.  A circumplex model of affect. , 1980 .

[28]  Sarah Diefenbach,et al.  Experience-Oriented and Product-Oriented Evaluation: Psychological Need Fulfillment, Positive Affect, and Product Perception , 2015, Int. J. Hum. Comput. Interact..

[29]  E. Peper,et al.  Is There More to Blood Volume Pulse Than Heart Rate Variability , Respiratory Sinus Arrhythmia , and Cardiorespiratory Synchrony ? , 2007 .

[30]  Heather L. O'Brien,et al.  Mixed-methods approach to measuring user experience in online news interactions , 2013, J. Assoc. Inf. Sci. Technol..

[31]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[32]  R. Plutchik.  The Nature of Emotions , 2001 .

[33]  Michael Wiklund,et al.  Usability in practice: how companies develop user-friendly products , 1994 .

[34]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[35]  Magid Igbaria,et al.  The respective roles of perceived usefulness and perceived fun in the acceptance of microcomputer technology , 1994, Behav. Inf. Technol..

[36]  Alexandre Pereda-Baños,et al.  A Psychophysiological Approach to the Usability Evaluation of a Multi-view Video Browsing Tool , 2013, MMM.

[37]  Sarah Diefenbach,et al.  The dilemma of the hedonic - Appreciated, but hard to justify , 2011, Interact. Comput..

[38]  Camila Loiola Brito Maia,et al.  A Systematic Review About User Experience Evaluation , 2016, HCI.

[39]  Rosalind W. Picard.  Affective computing: (526112012-054) , 1997 .

[40]  R. Plutchik.  Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice , 2016 .

[41]  Elizabeth Furtado,et al.  Does content categorization lead to knowledge building? An experiment in a social bookmarking service , 2015, Comput. Hum. Behav..

[42]  Ann Blandford,et al.  Conceptualising user hedonic experience , 2004 .

[43]  M B Kostiunina.  [What is the EEG?]. , 1987, Meditsinskaia sestra.

[44]  P. Zimmermann.  Beyond usability: measuring aspects of user experience , 2008 .

[45]  Claire Rowland,et al.  User experience design for the Internet of Things , 2015 .