Finding usability problems through heuristic evaluation

Usability specialists were better than non-specialists at performing heuristic evaluation, and “double experts” with specific expertise in the kind of interface being evaluated performed even better. Major usability problems have a higher probability than minor problems of being found in a heuristic evaluation, but more minor problems are found in absolute numbers. Usability heuristics relating to exits and user errors were more difficult to apply than the rest, and additional measures should be taken to find problems relating to these heuristics. Usability problems that relate to missing interface elements that ought to be introduced were more difficult to find by heuristic evaluation in interfaces implemented as paper prototypes but were as easy as other problems to find in running systems.

[1]  Clare-Marie Karat,et al.  Comparison of empirical testing and walkthrough methods in user interface evaluation , 1992, CHI.

[2]  Jakob Nielsen,et al.  Improving a human-computer dialogue , 1990, CACM.

[3]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[4]  Jakob Nielsen,et al.  Paper versus computer implementations as mockup scenarios for heuristic evaluation , 1990, INTERACT.

[5]  Jakob Nielsen,et al.  Usability engineering at a discount , 1989 .

[6]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[7]  John M. Carroll,et al.  Infinite detail and emulation in an ontologically minimized HCI , 1990, CHI '90.

[8]  Richard Halstead-Nussloch,et al.  The design of phone-based interfaces for consumers , 1989, CHI '89.

[9]  John D. Gould,et al.  Speech Filing - An Office System for Principals , 1984, IBM Syst. J..

[10]  R. Bias,et al.  Interface-Walkthroughs: efficient collaborative testing , 1991, IEEE Software.

[11]  Wendy A. Kellogg,et al.  Qualitative artifact analysis , 1990, INTERACT.

[12]  Robin Jeffries,et al.  Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations , 1992, CHI.

[13]  Richard E. Granda,et al.  The effects of positional constancy on searching menus for information , 1983, CHI '83.

[14]  Mary Beth Rosson,et al.  The task-artifact cycle , 1991 .

[15]  Cathleen Wharton,et al.  Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces , 1990, CHI '90.

[16]  Heather Desurvire,et al.  EMPIRICISM VERSUS JUDGEMENT: COMPARING USER INTERFACE EVALUATION METHODS ON A NEW TELEPHONE-BASED INTERFACE , 1991, SGCH.