Automatic Support for Usability Evaluation

The main goal of the work is to propose a method to evaluate user interfaces using task models and logs generated from a user test of an application. The method can be incorporated into an automatic tool which gives the designer information useful to evaluate and improve the user interface. These results include an analysis of the tasks which have been accomplished, those which failed and those never tried, user errors and their type, time related information, task patterns among the accomplished tasks, and the available tasks from the current state of the user session. This information is also useful to an evaluator checking whether the specified usability goals have been accomplished.

[1]  Dan Diaper,et al.  Task Analysis for Human-Computer Interaction , 1990 .

[2]  Fabio Paternò,et al.  ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models , 1997, INTERACT.

[3]  Andrew Sears,et al.  Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout , 1993, IEEE Trans. Software Eng..

[4]  M. Good,et al.  User-derived impact analysis as a tool for usability engineering , 1986, CHI '86.

[5]  David E. Kieras,et al.  Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task , 1997, TCHI.

[6]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[7]  H. Rex Hartson,et al.  Developing user interfaces: ensuring usability through product & process , 1993 .

[8]  Fabio Paternò,et al.  A User Interface Evaluation Mapping Physical User Actions to Task-Driven Formal Specifications , 1995, DSV-IS.

[9]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[10]  Andrew Sears,et al.  AIDE: a step toward metric-based interface development tools , 1995, UIST '95.

[11]  Miles MacLeod,et al.  The MUSiC performance measurement method , 1997, Behav. Inf. Technol..

[12]  F. Paterno,et al.  Engineering task models , 1997, Proceedings. Third IEEE International Conference on Engineering of Complex Computer Systems (Cat. No.97TB100168).

[13]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[14]  Fabio Paternò,et al.  Automatic generation of task-oriented help , 1995, UIST '95.

[15]  Patty Curthoys,et al.  Developing user interfaces: Ensuring usability through product and process , 1997 .

[16]  Peter Johnson,et al.  Beyond Hacking: a Model Based Approach to User Interface Design , 1993 .

[17]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[18]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[19]  Anthony J. Hornof,et al.  GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs , 1995, UIST '95.