Identifying web usability problems from eye-tracking data

Eye-tracking research is increasingly used to supplement usability tests in both commercial and academic practice. However, while there has been research into links between eye-tracking metrics and usability problems, this has so far fallen short of establishing a general correlation scheme between the two. Consequently, practitioners are left to make subjective judgements when interpreting eye-tracking data. We address the lack of general guidance by proposing an initial correlation scheme based on data from an exploratory study which aimed to find a wide range of possible correlations between usability problems and eye-tracking patterns. User testing of two websites was conducted and a set of diverse usability problems was extracted from the data; these were then analysed and some were correlated with users' eye-tracking patterns. In addition to this initial correlation scheme, a further finding from this study is that usability problems are connected to not just a single eye-tracking pattern, but to a specific sequence of patterns. This sequence of patterns seems to arise from different coping strategies that users develop when a problem is experienced.

[1]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[2]  Jens Riegelsberger,et al.  Could I have the Menu Please? An Eye Tracking Study of Design Conventions , 2004 .

[3]  Claude Ghaoui,et al.  Encyclopedia of Human Computer Interaction , 2005 .

[4]  Linden J. Ball,et al.  In Search of Salience: A Response-time and Eye-movement Analysis of Bookmark Recognition , 2004, BCS HCI.

[5]  Steve Krug,et al.  Don't Make Me Think!: A Common Sense Approach to Web Usability , 2000 .

[6]  Keith S. Karn,et al.  Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. , 2003 .

[7]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[8]  Linden J. Ball,et al.  An Eye Movement Analysis of Web Page Usability , 2002 .

[9]  Agnieszka Bojko,et al.  Using eye tracking to compare web page designs: a case study , 2006 .

[10]  Jens Riegelsberger,et al.  The Geometry of Web Search , 2004, BCS HCI.

[11]  Joseph H. Goldberg,et al.  Eye tracking in web search tasks: design implications , 2002, ETRA.

[12]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[13]  Linden J. Ball,et al.  Applying the post-experience eye-tracked protocol (PEEP) method in usability testing. , 2006 .

[14]  Janet Finlay,et al.  Designing for Visual Influence: an Eye Tracking Study of the Usability of Graphical Management Information , 2003, INTERACT.

[15]  Jukka Häkkinen,et al.  Can eye movements be quantitatively applied to image quality studies? , 2004, NordiCHI '04.