Using Physiological Measures to Evaluate User Experience of Mobile Applications

Measurements of user experience UX in traditional human-computer interaction studies mostly rely on task performance and self-report data. Recent research has showed that physiological measures are good indicators of cognitive involvement and emotional arousal and are suggested being used as a complementary measure of UX. This paper reports a preliminary study to examine the possibility of including physiological measures in the UX evaluation process. In the experiment, participants' physiological responses, task performance and self-report data were collected and analyzed. It was found that physiological measures varied with task performance, as participants showed greater galvanic skin response GSR change in the failed tasks than that in the successful tasks. In addition, correlations were found between GSR and self-report data of user experience. The results demonstrated the potential value of physiological measures as a data source of user experience evaluation. However, further investigations involving variations in tasks and individual difference are required.

[1]  K. Quigley,et al.  Applications of Psychophysiological Recording , 2000 .

[2]  M. Whitton,et al.  Physiological Measures of Presence in Virtual Environments , 2001 .

[3]  Gillian May Wilson.  Psychophysiological indicators of the impact of media quality on users , 2001, CHI Extended Abstracts.

[4]  Malin Forne,et al.  Physiology as a Tool for UX and Usability Testing – A comparative study of pupil size and other physiological measures. , 2012 .

[5]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[6]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[7]  Dongsong Zhang,et al.  Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications , 2005, Int. J. Hum. Comput. Interact..

[8]  Manfred Tscheligi,et al.  Possibilities of Psychophysiological Methods for Measuring Emotional Aspects in Mobile Contexts , 2009 .

[9]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[10]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[11]  J. Annett.  Subjective rating scales: science or art? , 2002, Ergonomics.

[12]  Robert D. Ward,et al.  Physiological responses to different WEB page designs , 2003, Int. J. Hum. Comput. Stud..

[13]  John Zimmerman,et al.  User experience over time: an initial framework , 2009, CHI.

[14]  Tao Lin,et al.  Do physiological data relate to traditional usability indexes? , 2005, OZCHI.

[15]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[16]  Tom Tullis,et al.  Measuring the User Experience, Second Edition: Collecting, Analyzing, and Presenting Usability Metrics , 2013 .

[17]  Andreas Holzinger,et al.  HCI and Usability for Education and Work, 4th Symposium of the WG HCI&UE of the OCG Austrian Computer Society, USAB 2008, LNCS 5298 , 2008 .

[18]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[19]  Marko Munih,et al.  Dual-task performance in multimodal human-computer interaction: a psychophysiological perspective , 2012, Multimedia Tools and Applications.