Making a task difficult: evidence that device-oriented steps are effortful and error-prone.

Errors in the execution of procedural tasks can have severe consequences. Attempts to ameliorate these slip errors through increased training and motivation have been shown to be ineffective. Instead, we identified the steps in a task procedure on which errors are most likely to occur, so that these might be designed out of the task procedure in the first place. Specifically, we considered whether device-oriented steps (i.e., steps in the task procedure that do not directly contribute to the achievement of the task goal) are more error-prone than task-oriented steps (i.e., steps that do directly contribute to the task goal). Two experiments are reported in which participants were trained to perform a novel procedural task. Across conditions, we manipulated the extent to which each step in the task procedure appeared to contribute to the achievement of the task goal (i.e., alternating the assignment of a task step between device- and task-oriented), while keeping the interface and underlying task procedure the same. Results show that participants made more errors and took longer to complete a task step when it played a device-oriented role rather than a task-orientated role. These effects were exacerbated by the introduction of a secondary task designed to increase working memory load, suggesting that when a task step plays a device-oriented role it is more weakly represented in memory. We conclude that device-oriented task steps are inherently problematic and should be avoided where possible in the design of task procedures.

[1]  Harold W. Thimbleby,et al.  User interface design , 1990, ACM Press Frontier Series.

[2]  S. Y.-W. Li An empirical investigation of post-completion error : a cognitive perspective , 2006 .

[3]  Raj M. Ratwani,et al.  Predicting postcompletion errors using eye movements , 2008, CHI.

[4]  Richard M. Young,et al.  Device-Oriented and Task-Oriented Exploratory Learning of Interactive Devices , 2000 .

[5]  Anna Louise Cox,et al.  Snookered by an interruption?: use a cue , 2012, BCS HCI.

[6]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[7]  Ann Blandford,et al.  Different Cognitive Mechanisms Account for Different Types of Procedural Steps , 2009 .

[8]  Maartje Ament Frankenstein and human error: device-oriented steps are more problematic than task-oriented ones , 2011, CHI EA '11.

[9]  Ann Blandford,et al.  The roles of conceptual device models and user goals in avoiding device initialization errors , 2010, Interact. Comput..

[10]  Richard M. Young,et al.  The Machine Inside the Machine: Users' Models of Pocket Calculators , 1981, Int. J. Man Mach. Stud..

[11]  Michael D. Byrne,et al.  Task Structure and Postcompletion Error in the Execution of a Routine Procedure , 2006, Hum. Factors.

[12]  Sheryl L. Miller,et al.  When using the tool interferes with doing the task , 1996, CHI Conference Companion.

[13]  S. M. Casey,et al.  Set Phasers on Stun: And Other True Tales of Design, Technology, and Human Error , 1998 .

[14]  Michael D. Byrne,et al.  Goal Formation and the Unselected Window Problem , 2007 .

[15]  Ann Blandford,et al.  Slip errors and cue salience , 2007, ECCE '07.

[16]  Abigail Sellen,et al.  The role of visual and kinesthetic feedback in the prevention of mode errors , 1990, INTERACT.

[17]  Ann Blandford,et al.  The effect of interruptions on postcompletion and other procedural errors: an account based on the activation-based goal memory model. , 2008, Journal of experimental psychology. Applied.

[18]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device , 1990, Cogn. Sci..

[19]  Rachel Reichman Communication Paradigms for a Window System , 1986 .

[20]  D. Norman Categorization of action slips. , 1981 .

[21]  Ann Blandford,et al.  Working Memory Load Affects Device-Specific but Not Task-Specific Error Rates , 2010 .

[22]  Andrew F. Monk,et al.  Mode Errors: A User-Centered Analysis and Some Preventative Measures Using Keying-Contingent Sound , 1986, Int. J. Man Mach. Stud..

[23]  J. Shaoul Human Error , 1973, Nature.

[24]  Wayne D. Gray The nature and processing of errors in interactive behavior , 2000, Cogn. Sci..

[25]  Robert S. Bridger,et al.  Effects of dialogue design on automatic teller machine (ATM) usability: Transaction times and card loss , 2000, Behav. Inf. Technol..

[26]  Michael D. Byrne,et al.  Cue effectiveness in mitigating postcompletion errors in a routine procedural task , 2008, Int. J. Hum. Comput. Stud..

[27]  Maartje Gertruda Anna Ament The role of goal relevance in the occurrence of systematic slip errors in routine procedural tasks , 2011 .

[28]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[29]  Ann Blandford,et al.  Does Being Motivated to Avoid Procedural Errors Influence Their Systematicity , 2007 .

[30]  Michael D. Byrne,et al.  A Working Memory Model of a Common Procedural Error , 1997, Cogn. Sci..