Resolving the paradox of the active user: stable suboptimal performance in interactive tasks

This paper brings the intellectual tools of cognitive science to bear on resolving the “paradox of the active user” [Interfacing Thought: Cognitive Aspects of Human–Computer Interaction, Cambridge, MIT Press, MA, USA]—the persistent use of inefficient procedures in interactive tasks by experienced or even expert users when demonstrably more efficient procedures exist. The goal of this paper is to understand the roots of this paradox by finding regularities in these inefficient procedures. We examine three very different data sets. For each data set, we first satisfy ourselves that the preferred procedures used by some subjects are indeed less efficient than the recommended procedures. We then amass evidence, for each set, and conclude that when a preferred procedure is used instead of a more efficient, recommended procedure, the preferred procedure tends to have two major characteristics: (1) the preferred procedure is a well-practiced, generic procedure that is applicable either within the same task environment in different contexts or across different task environments, and (2) the preferred procedure is composed of interactive components that bring fast, incremental feedback on the external problem states. The support amassed for these characteristics leads to a new understanding of the paradox. In interactive tasks, people are biased towards the use of general procedures that start with interactive actions. These actions require much less cognitive effort as each action results in an immediate change to the external display that, in turn, cues the next action. Unfortunately for the users, the bias to use interactive unit tasks leads to a path that requires more effort in the long run. Our data suggest that interactive behavior is composed of a series of distributed choices; that is, people seldom make a once-and-for-all decision on procedures. This series of biased selection of interactive unit tasks often leads to a stable suboptimal level of performance.

[1]  S. Payne,et al.  Strategic use of familiarity in display-based problem solving. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Bonnie E. John,et al.  The Strategic Use of Complex Computer Systems , 2000, Hum. Comput. Interact..

[3]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[4]  Mary Beth Rosson,et al.  Paradox of the active user , 1987 .

[5]  John R. Anderson,et al.  Spanning seven orders of magnitude: a challenge for cognitive modeling , 2002, Cogn. Sci..

[6]  W. Vaughan Choice: A local analysis. , 1985, Journal of the experimental analysis of behavior.

[7]  G. Miller,et al.  Cognitive science. , 1981, Science.

[8]  S. Payne,et al.  The Effects of Operator Implementation Cost on Planfulness of Problem Solving and Learning , 1998, Cognitive Psychology.

[9]  John Millar Carroll Interfacing Thought: Cognitive Aspects of Human-Computer Interaction , 2003 .

[10]  Judith S. Olson,et al.  The growth of software skill: a longitudinal look at learning & performance , 1993, INTERCHI.

[11]  John R. Anderson,et al.  Why do children learn to say “Broke”? A model of learning the past tense without feedback , 2002, Cognition.

[12]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[13]  John R. Anderson,et al.  Cognitive Modeling and Intelligent Tutoring , 1990, Artif. Intell..

[14]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[15]  R. Siegler,et al.  Older and younger adults' strategy choices in multiplication: testing predictions of ASCM using the choice/no-choice method. , 1997, Journal of experimental psychology. General.

[16]  J. Hamers,et al.  [Methods and techniques]. , 1997, Verpleegkunde.

[17]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[18]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[19]  Bonnie E. John,et al.  From sufficient to efficient usage: an analysis of strategic knowledge , 1997, CHI.

[20]  John R. Anderson,et al.  Change-episodes in coding: when and how do programmers change their code? , 1987 .

[21]  H. Simon,et al.  Why are some problems hard? Evidence from Tower of Hanoi , 1985, Cognitive Psychology.

[22]  J. H. Larkin,et al.  Display-based problem solving , 1989 .

[23]  Bonnie E. John,et al.  Exploring the unrealized potential of computer-aided drafting , 1996, CHI.

[24]  Stephen J. Payne,et al.  Display-Based Action at the User Interface , 1991, Int. J. Man Mach. Stud..

[25]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[26]  W Vaughan,et al.  Melioration, matching, and maximization. , 1981, Journal of the experimental analysis of behavior.

[27]  Bonnie E. John,et al.  The strategic use of CAD: an empirically inspired, theory-based course , 1999, CHI '99.

[28]  George Beekman HyperCard 2 in a hurry , 1992 .

[29]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[30]  Wayne D. Gray The nature and processing of errors in interactive behavior , 2000, Cogn. Sci..

[31]  R. Herrnstein Experiments on Stable Suboptimality in Individual Behavior , 1991 .

[32]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[33]  R. Siegler,et al.  Variation, selection, and cognitive change. , 1995 .

[34]  Suresh K. Bhavnani Designs conducive to the use of efficient strategies , 2000, DIS '00.

[35]  Keith Oatley,et al.  Information Flow in a User Interface: the Effect of Experience and Context on the Recall of MacWrite Screens , 1988, BCS HCI.

[36]  Elliot Soloway,et al.  Empirical Studies of Programmers: Second Workshop , 1991 .

[37]  Roberta L. Klatzky,et al.  Expertise in a Computer Operating System: Conceptualization and Performance , 1990, Hum. Comput. Interact..

[38]  Bonnie E. John,et al.  Delegation and circumvention: two faces of efficiency , 1998, CHI.

[39]  John R. Anderson The Adaptive Character of Thought , 1990 .

[40]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .