EMA: Automated Eye-Movement-Driven Approach for Identification of Usability Issues

The work described in this paper presents an automated, eye movement-driven approach (EMA) that allows for the identification of time intervals in which a user is experiencing difficulties in locating interface components required for completion of a task. Due to the substantial amount of visual search exhibited during these time intervals, this type of the user behavior is referred to as excessive visual search (ES). In this work we propose and evaluate several ES detection algorithms as part of the EMA. Empirical results indicate that it is possible to identify ES with a certain degree of accuracy (51-61% on average), warranting future research that would allow for increased accuracy in ES identification and reduction of misclassification errors. Practical application of EMA should allow the reduction of the amount of time required for manual detection of usability problems present in graphical user interfaces.

[1]  Titus K L Schleyer,et al.  Heuristic evaluation of clinical functions in four practice management systems: a pilot study. , 2007, Journal of the American Dental Association.

[2]  Oleg V. Komogortsev,et al.  Standardization of Automated Analyses of Oculomotor Fixation and Saccadic Behaviors , 2010, IEEE Transactions on Biomedical Engineering.

[3]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[4]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[5]  Elizabeth M Borycki,et al.  Low-cost rapid usability engineering: designing and customizing usable healthcare information systems. , 2006, Healthcare quarterly.

[6]  Jan Stage,et al.  What happened to remote usability testing?: an empirical study of three methods , 2007, CHI.

[7]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[8]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[9]  Joseph H. Goldberg,et al.  Eye tracking in web search tasks: design implications , 2002, ETRA.

[10]  Dan E. Tamir,et al.  An Economical Approach to Usability Testing , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[11]  S. P. Marshall,et al.  The Index of Cognitive Activity: measuring cognitive workload , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.