A comprehension-based model of correct performance and errors in skilled, display-based, human-computer interaction

This paper describes a computational model of skilled use of an application with a graphical user interface. The model provides a principled explanation of action slips, errors made by experienced users. The model is based on Hutchins, Holland and Norman's analysis of direct manipulation and is implemented using Kintsch and Mannes's construction-integration theory of action planning. The model attends to a limited number of objects on the screen and then selects action on one of them, such as moving mouse cursor, clicking mouse button, typing letters, and so on, by integrating information from various sources. These sources include the display, task goals, expected display states, and knowledge about the interface and the application domain. The model simulates a graph drawing task. In addition, we describe how the model makes errors even when it is provided with the knowledge sufficient to generate correct actions.