Predictive human performance modeling made easy

Although engineering models of user behavior have enjoyed a rich history in HCI, they have yet to have a widespread impact due to the complexities of the modeling process. In this paper we describe a development system in which designers generate predictive cognitive models of user behavior simply by demonstrating tasks on HTML mock-ups of new interfaces. Keystroke-Level Models are produced automatically using new rules for placing mental operators, then implemented in the ACT-R cognitive architecture. They interact with the mock-up through integrated perceptual and motor modules, generating behavior that is automatically quantified and easily examined. Using a query-entry user interface as an example [19], we demonstrate that this new system enables more rapid development of predictive models, with more accurate results, than previously published models of these tasks.

[1]  Judy Kay,et al.  Artificial intelligence in education : shaping the future of learning through intelligent technologies , 2003 .

[2]  Gregory D. Abowd,et al.  Human-computer interaction (2nd ed.) , 1998 .

[3]  John T. Stasko,et al.  Animation support in a user interface toolkit: flexible, robust, and reusable abstractions , 1993, UIST '93.

[4]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[5]  Anthony J. Hornof,et al.  GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs , 1995, UIST '95.

[6]  Bonnie E. John.  Toward a deeper comparison of methods: a reaction to Nielsen & Phillips and new data , 1994, CHI '94.

[7]  B. Shneiderman.  Designing the User Interface (3rd Ed.) , 1998 .

[8]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[9]  Michael Freed,et al.  Automating CPM-GOMS , 2002, CHI.

[10]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[11]  David E. Kieras,et al.  Automating interface evaluation , 1994, CHI Conference Companion.

[12]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[13]  David E. Kieras,et al.  Using GOMS for user interface design and evaluation: which technique? , 1996, TCHI.

[14]  H. Albert Napier,et al.  Predicting the Skilled Use of Hierarchical Menus With the Keystroke-Level Model , 1993, Hum. Comput. Interact..

[15]  Jakob Nielsen,et al.  Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared , 1993, INTERCHI.

[16]  Jef Raskin.  The humane interface (book excerpt) , 2000, UBIQ.

[17]  Michael D. Byrne,et al.  A comparison of tools for building GOMS models , 2000, CHI.

[18]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[19]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[20]  Kenneth R. Koedinger,et al.  Toward a Rapid Development Environment for Cognitive Tutors , 2003 .

[21]  Michael D. Byrne,et al.  A tool for creating predictive performance models from user interface demonstrations , 1999, UIST '99.

[22]  David V. Beard,et al.  Quick and Dirty GOMS: A Case Study of Computed Tomography Interpretation , 1996, Hum. Comput. Interact..

[23]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[24]  Bonnie E. John.  TYPIST: A Theory of Performance in Skilled Typing , 1996, Hum. Comput. Interact..

[25]  Frank J. Lee,et al.  Simple cognitive modeling in a complex cognitive architecture , 2003, CHI '03.

[26]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[27]  Tom Carey,et al.  Human-computer interaction , 1994 .