Easing the generation of predictive human performance models from legacy systems

With the rise of tools for predictive human performance modeling in HCI comes a need to model legacy applications. Models of legacy systems are used to compare products to competitors, or new proposed design ideas to the existing version of an application. We present CogTool-Helper, an exemplar of a tool that results from joining this HCI need to research in automatic GUI testing from the Software Engineering testing community. CogTool-Helper uses automatic UI-model extraction and test case generation to automatically create CogTool storyboards and models and infer methods to accomplish tasks beyond what the UI designer has specified. A design walkthrough with experienced CogTool users reveal that CogTool-Helper resonates with a "pain point" of real-world modeling and provide suggestions for future work.

[1]  Mary Lou Soffa,et al.  Hierarchical GUI Test Case Generation Using Automated Planning , 2001, IEEE Trans. Software Eng..

[2]  Mark O. Riedl,et al.  A perception/action substrate for cognitive modeling in HCI , 2001, Int. J. Hum. Comput. Stud..

[3]  Guy Pyrzak,et al.  When two methods are better than one: combining user study with cognitive modeling , 2007, CHI Extended Abstracts.

[4]  Rob Miller,et al.  GUI testing using computer vision , 2010, CHI.

[5]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[6]  Atif M. Memon,et al.  GUI ripping: reverse engineering of graphical user interfaces for testing , 2003, 10th Working Conference on Reverse Engineering, 2003. WCRE 2003. Proceedings..

[7]  Atif M. Memon.  GUI Testing: Pitfalls and Process , 2002, Computer.

[8]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[9]  Chen Fu,et al.  Creating GUI Testing Tools Using Accessibility Technologies , 2009, 2009 International Conference on Software Testing, Verification, and Validation Workshops.

[10]  Atif M. Memon,et al.  Generating Event Sequence-Based Test Cases Using GUI Runtime State Feedback , 2010, IEEE Transactions on Software Engineering.

[11]  Rachel K. E. Bellamy,et al.  Deploying CogTool: integrating quantitative usability assessment into real-world software development , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[12]  Kenneth R. Koedinger,et al.  Predictive human performance modeling made easy , 2004, CHI.

[13]  Bonnie E. John,et al.  CogTool-Explorer: a model of goal-directed user exploration that considers information layout , 2012, CHI.

[14]  Lee J. White,et al.  Generating test cases for GUI responsibilities using complete interaction sequences , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[15]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[16]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[17]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using GOMSL and GLEAN4 , 1999 .