AN EMPIRICAL STUDY OF RELATIONSHIPS BETWEEN TRADITIONAL USABILITY INDEXES AND PHYSIOLOGICAL DATA

Task performance data and subjective assessment data are widely used as usability measures in the human-computer interaction (HCI) field. Recently, physiology has also been explored as a metric for evaluating usability. However, it is not clear how physiological measures relate to traditional usability evaluation indexes. In this paper, we investigate the relationships among three kinds of data: task performance, subjective assessment and physiological measures. We found evidence that physiological data correlate with task performance data in a video game: with a decrease of the task performance level, the normalized galvanic skin response (GSR) increases. In addition, physiological data are mirrored in subjective reports assessing stress level. The research provides an initial step toward using physiology as a complementary or an independent usability measure for HCI evaluation.

[1]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[2]  R. Lawson.  Frustration : the development of a scientific concept , 1965 .

[3]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[4]  F. Braceland.  THE STRESS OF LIFE , 1976 .

[5]  G F Wilson,et al.  Air-to-ground training missions: a psychophysiological workload analysis. , 1993, Ergonomics.

[6]  George P. Chrousos,et al.  Mechanisms of Physical and Emotional Stress , 1988, Advances in Experimental Medicine and Biology.

[7]  D. Goldstein,et al.  Sympathoadrenal medullary system and stress. , 1988, Advances in experimental medicine and biology.

[8]  P. Ekman,et al.  Autonomic nervous system activity distinguishes among emotions. , 1983, Science.

[9]  Regan L. Mandryk,et al.  Physiological indicators for the evaluation of co-located collaborative play , 2004, CSCW.

[10]  Gillian May Wilson.  Psychophysiological indicators of the impact of media quality on users , 2001, CHI Extended Abstracts.

[11]  C D Wickens,et al.  Assessment of pilot performance and mental workload in rotary wing aircraft. , 1993, Ergonomics.

[12]  F.R.H. Zijlstra,et al.  Efficiency in work behaviour: A design approach for modern tools , 1993 .

[13]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[14]  Brian McDonald,et al.  Intelligent Biofeedback using an Immersive Competitive Environment , 2001 .

[15]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[16]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[18]  Gm Wilson,et al.  Investigating the impact of audio degradations on users: subjective vs objective assessment methods , 2000 .

[19]  Martin C. Maguire,et al.  Evaluating User-Computer Interaction: A Framework , 1993, Int. J. Man Mach. Stud..

[20]  Jussi Holopainen,et al.  The Psychophysiology of Video Gaming: Phasic Emotional Responses to Game Events , 2005, DiGRA Conference.

[21]  K. J. Vicente,et al.  Spectral Analysis of Sinus Arrhythmia: A Measure of Mental Effort , 1987, Human factors.

[22]  M. Whitton,et al.  Physiological Measures of Presence in Virtual Environments , 2001 .

[23]  J. Kagan,et al.  On the nature of emotion. , 1994, Monographs of the Society for Research in Child Development.

[24]  Robert D. Ward,et al.  Physiological Responses to Well-Designed and Poorly Designed Interfaces , 2002 .

[25]  Alan J. Dix,et al.  Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me (ACE) , 2005, DiGRA Conference.

[26]  I. E. Loewenfeld,et al.  THE SLEEP‐WAKING CYCLE AND PUPILLARY ACTIVITY * , 1964, Annals of the New York Academy of Sciences.

[27]  Veikko Surakka,et al.  Pupillary responses to emotionally provocative stimuli , 2000, ETRA.

[28]  H.G. De Meer,et al.  Utility curves: mean opinion scores considered biased , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).

[29]  Robert D. Ward,et al.  Physiological responses to different WEB page designs , 2003, Int. J. Hum. Comput. Stud..

[30]  F. Wilson,et al.  Should we accept anything less than TV quality: visual communication , 1996 .

[31]  G. Robert J. Hockey,et al.  Level of Operator Control and Changes in Heart Rate Variability during Simulated Flight Maintenance , 1995, Hum. Factors.

[32]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[33]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[34]  Richard S. Lazarus,et al.  Why we should think of stress as a subset of emotion. , 1993 .