Toward automated exploration of interactive systems

The ease with which a user interface can be navigated strongly contributes to its usability. In this paper we describe preliminary results of a project aimed at making the evaluation of user interfaces from this perspective more routine. We have designed a system to carry out an autonomous, exploratory navigation through the graphical user interface of interactive, off-the-shelf software applications. The system is not a robust tool, but rather a proof of concept that can exhibit interesting behaviors. The traversal process generates a representation of the connectivity of the user interface, as well as navigational paths to specific commands. The reasoning component of the system is based on the ACT-R architecture, while the perceptual and motor components of the system are built on top of the SegMan perception/action substrate. We present the design of the system and its use in exploring a simple user interface.

[1]  Kristen L. Macuga,et al.  Predicting the effects of cellular-phone dialing on driver performance , 2002, Cognitive Systems Research.

[2]  Man Ieee Systems.  IEEE transactions on systems, man and cybernetics , 1971 .

[3]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[4]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[5]  Deborah A. Boehm-Davis,et al.  Modeling Behavior in Complex and Dynamic Situations-The Example of Flying an Automated Aircraft , 2001 .

[6]  Andrew Sears,et al.  Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout , 1993, IEEE Trans. Software Eng..

[7]  Frank E. Ritter,et al.  Supporting cognitive models as users , 2000, TCHI.

[8]  Hsinchun Chen,et al.  Browsing in hypertext: a cognitive study , 1992, IEEE Trans. Syst. Man Cybern..

[9]  Anthony J. Hornof,et al.  Cognitive modeling demonstrates how people use anticipated location knowledge of menu items , 1999, CHI '99.

[10]  Frank E. Ritter,et al.  A USER MODELING DESIGN TOOL FOR COMPARING INTERFACES , 2002 .

[11]  Frank E. Ritter,et al.  A User Modeling Design Tool Based on a Cognitive Architecture for Comparing Interfaces , 2002, CADUI.

[12]  Robert Spence,et al.  A framework for navigation , 1999, Int. J. Hum. Comput. Stud..

[13]  Luke S. Zettlemoyer,et al.  The user interface as an agent environment , 2000, AGENTS '00.

[14]  Robert St. Amant.  Navigation and Planning in a Mixed-Initiative User Interface , 1997, AAAI/IAAI.

[15]  John R. Anderson,et al.  Eye tracking the visual search of click-down menus , 1999, CHI '99.

[16]  Mark O. Riedl,et al.  A perception/action substrate for cognitive modeling in HCI , 2001, Int. J. Hum. Comput. Stud..

[17]  A. Newell.  Unified Theories of Cognition , 1990 .

[18]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[19]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..