Discount Learnability Evaluation

Learnability evaluation has traditionally required expensive and time-consuming techniques. Practitioners have refrained from performing extended learnability evaluation due to its prohibitive costs. We propose a discount method for evaluation of an interactive system's learnability. Our method is based on automated logging of user actions, detection of user mental chunks, and observation of chunk size as it grows over time with experience. We introduce a model for chunk detection, and present experimental results validating the use of chunk size as an indicator of learnability.

[1]  Paulo Alexandre Vieira Jacinto dos Santos.  Automatic detection of user transitionality by analysis of interaction , 1995 .

[2]  Cathleen Wharton,et al.  Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces , 1990, CHI '90.

[3]  Jakob Nielsen,et al.  Usability engineering at a discount , 1989 .

[4]  Albert N. Badre,et al.  CHIME: A Knowledge-based Computer-Human Interaction Monitoring Engine , 1991 .

[5]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[6]  Ben Shneiderman,et al.  Directions in human-computer interaction , 1982 .

[7]  Allen Newell,et al.  Computer text-editing: An information-processing analysis of a routine cognitive skill , 1980, Cognitive Psychology.

[8]  Albert N. Badre.  Selecting and Representing Information Structures for Visual Presentation , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[10]  Bill Curtis,et al.  Applying Discount Usability Engineering , 1995, IEEE Softw..

[11]  Albert N. Badre,et al.  Automatic chunk detection in human-computer interaction , 1994, AVI '94.

[12]  Woodrow Barfield,et al.  Expert-novice differences for software: implications for problem-solving and knowledge acquisition , 1986 .

[13]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[14]  Judith S Reitman,et al.  Skilled perception in Go: Deducing memory structures from inter-response times , 1976, Cognitive Psychology.

[15]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[16]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[17]  Tom Carey,et al.  Human-computer interaction , 1994 .

[18]  Ben Shneiderman,et al.  Designing the user interface - strategies for effective human-computer interaction, 2nd Edition , 1992 .

[19]  H. Simon,et al.  Perception in chess , 1973 .