A Guide to GOMS Model Usability Evaluation using GOMSL and GLEAN4

The standard accepted technique for developing a usable system, empirical user testing, is based on iterative testing and design revision using actual users to test the system and help identify usability problems. It is widely agreed that this approach, inherited from Human Factors, does indeed work when carefully applied (Landauer, 1995). However, Card, Moran, & Newell (1983) have argued, and many HCI researchers have agreed (e.g., see Butler, Bennett, Polson, & Karat, 1989), that empirical user testing is too slow and expensive for modern software development practice, especially when difficult-to-get domain experts are the target user group. One response has been the development of "discount" or "inspection" methods for assessing the usability of an interface design quickly and at low cost (Nielsen & Mack, 1994). However, another response, which has been evolving since the seminal Card, Moran, and Newell work, is the concept of engineering models for usability. Analogously to the models used in other engineering disciplines, engineering models for usability produce quantitative predictions of how well humans will be able to perform tasks with a proposed design. Such predictions can be used as a surrogate for actual empirical user data, making it possible to iterate through design revisions and evaluations much more rapidly. Furthermore, unlike purely empirical assessments, an engineering model for an interface design can capture the essence of the design in an inspectable representation, making it easier to reuse successful design insights in the future.

[1]  J. Elkerton Online Aiding for Human-Computer Interfaces , 1988 .

[2]  Shane T. Mueller,et al.  Models of Working Memory: Insights into Working Memory from the Perspective of the EPIC Architecture for Modeling Skilled Perceptual-Motor and Cognitive Human Performance , 1998 .

[3]  Susan Palmiter,et al.  Designing Help Using a GOMS Model: An Information Retrieval Evaluation , 1991 .

[4]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[5]  John D. Gould,et al.  How to design usable systems , 1995 .

[6]  Thomas K. Landauer,et al.  Trouble with Computers: Usefulness, Usability, and Productivity , 1996 .

[7]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device , 1990, Cogn. Sci..

[8]  David E. Kieras,et al.  A validation of the GOMS model methodology in the development of a specialized, commercial software application , 1994, CHI '94.

[9]  David E. Kieras,et al.  An Approach to the Formal Analysis of User Complexity , 1999, Int. J. Man Mach. Stud..

[10]  Marilyn Tremaine,et al.  Skilled financial planning: the cost of translating ideas into action , 1989, CHI '89.

[11]  David E. Kieras,et al.  The Acquisition of Procedures from Text: A Production-System Analysis of Transfer of Training. Technical Report No. 16. , 1985 .

[12]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[13]  A. W. Melton,et al.  Coding Processes in Human Memory. , 1973 .

[14]  David E. Kieras,et al.  Task Analysis and the Design of Functionality , 2014, The Computer Science and Engineering Handbook.

[15]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[16]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[17]  P. Kidwell,et al.  The trouble with computers: Usefulness, usability and productivity , 1996, IEEE Annals of the History of Computing.

[18]  David E. Kieras,et al.  DEVELOPING A USER INTERFACE TECHNOLOGY FOR USE IN INDUSTRY , 1987 .

[19]  Barry Kirwan,et al.  A Guide To Task Analysis: The Task Analysis Working Group , 1992 .

[20]  David E. Kieras,et al.  Automating interface evaluation , 1994, CHI '94.

[21]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[22]  Jr. Allen B. Tucker,et al.  The Computer Science and Engineering Handbook , 1997 .

[23]  Jay Elkerton,et al.  Designing minimal documentation using a GOMS model: a usability evaluation of an engineering approach , 1990, CHI '90.

[24]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[25]  Terence Parr Language Translation Using PCCTS and C , 1999 .

[26]  David E. Kieras,et al.  Towards a Practical GOMS Model Methodology for User Interface Design , 1988 .

[27]  Dan Diaper,et al.  Task Analysis for Human-Computer Interaction , 1990 .

[28]  K. A. Ericsson,et al.  Long-Term Working Memory as an Alternative to Capacity Models of Working Memory in Everyday Skilled Performance , 1999 .

[29]  David E. Kieras,et al.  Extending goms to human error and applying it to error-tolerant design , 2000 .

[30]  P. Polson,et al.  Report on the workshop on analytical models , 1989, SGCH.

[31]  David E. Kieras,et al.  Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task , 1997, TCHI.

[32]  Richard Gong Validating and refining the GOMS model methodology for software user interface design and evaluation , 1993 .

[33]  Anthony J. Hornof,et al.  GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs , 1995, UIST '95.

[34]  Gary M. Olson,et al.  The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS , 1990, Hum. Comput. Interact..

[35]  David E. Kieras,et al.  Using GOMS for user interface design and evaluation: which technique? , 1996, TCHI.

[36]  David E. Kieras,et al.  The GOMS Family of Analysis Techniques: Tools for Design and Evaluation , 1994 .

[37]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[38]  David E. Kieras,et al.  The Acquisition and Performance of Text-Editing Skill: A Cognitive Complexity Analysis , 1990, Hum. Comput. Interact..

[39]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[40]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[41]  David E Kieras The Role of Cognitive Simulation Models in the Development of Advanced Training and Testing Systems. , 1987 .