A task-based framework for the quantitative evaluation of input devices

This research describes the development of a conceptual framework and methodology that will permit the evaluation of input devices in graphical user interfaces in a more meaningful context than previous studies. We provide a procedure for the reuse of performance characteristics in expanded domains. Individual performance differences are analyzed and their implications for current evaluation methods are discussed. We have built an interactive simulation for domain-independent testing of the suitability of different input devices for specific tasks, based on the demand characteristics of the task and the performance characteristics of the device. The simulation will allow researchers and practitioners to evaluate the suitability of particular input devices in a given user interface with a severely restricted role for usability testing. Using the system, it will be possible to select a device based upon optimal task completion time or estimated error rate. The role of inter-task transition times is explored. A methodology for prediction of performance with the use of execution graphs is described.

[1]  Jock D. Mackinlay,et al.  A morphological analysis of the design space of input devices , 1991, TOIS.

[2]  Sarah A. Douglas,et al.  Differences in movement microstructure of the mouse and the finger-controlled isometric joystick , 1996, CHI.

[3]  Gary M. Olson,et al.  The growth of cognitive modeling in human-computer interaction since GOMS , 1990 .

[4]  Alan E. Albert.  The Effect of Graphic Input Devices on Performance in a Cursor Positioning Task , 1982 .

[5]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[6]  D. Chaffin,et al.  An investigation of fitts' law using a wide range of movement amplitudes. , 1976, Journal of motor behavior.

[7]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[8]  Christopher D. Wickens,et al.  When Users Want What's not Best for Them , 1995 .

[9]  David E. Kieras,et al.  An Approach to the Formal Analysis of User Complexity , 1999, Int. J. Man Mach. Stud..

[10]  Gary M. Olson,et al.  The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS , 1990, Hum. Comput. Interact..

[11]  William Buxton,et al.  Lexical and pragmatic considerations of input structures , 1983, COMG.

[12]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[13]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[14]  Abigail Sellen,et al.  A comparison of input devices in element pointing and dragging tasks , 1991, CHI.

[15]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[16]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[17]  S. Mackenzie,et al.  A comparison of input device in elemental pointing and dragging task , 1991, CHI 1991.

[18]  Tom Wujec,et al.  Multimedia Interface Design , 1993, ICHIM.

[19]  R J Jagacinski,et al.  Fitts' Law in two dimensions with hand and head movements. , 1983, Journal of motor behavior.

[20]  Brian W. Epps.  Comparison of Six Cursor Control Devices Based on Fitts' Law Models , 1986 .

[21]  Ian Mackenzie,et al.  Fitts' law as a performance model in human-computer interaction , 1992 .

[22]  Christine L. MacKenzie,et al.  Physical versus virtual pointing , 1996, CHI.

[23]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[24]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[25]  Alfred Schmitt,et al.  Calculation of Totally Optimized Button Configurations Using Fitts' Law , 1999, HCI.

[26]  John R. Anderson,et al.  ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention , 1997, Hum. Comput. Interact..

[27]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[28]  Robert St. Amant,et al.  Search for efficient device-dependent action sequences in the user interface , 2003, IUI '03.

[29]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[30]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[31]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[32]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[33]  William Ribarsky,et al.  Interaction in Semi-Immersiv e Large Display Environments , 1998 .

[34]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[35]  Terry Winograd,et al.  FlowMenu: combining command, text, and data entry , 2000, UIST '00.

[36]  N Walker,et al.  Spatial and Temporal Characteristics of Rapid Cursor-Positioning Movements with Electromechanical Mice in Human-Computer Interaction , 1993, Human factors.

[37]  Sarah A. Douglas,et al.  The effect of reducing homing time on the speed of a finger-controlled isometric pointing device , 1994, CHI Conference Companion.

[38]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[39]  William Buxton,et al.  There's more to interaction than meets the eye: some issues in manual input , 1987 .

[40]  Jock D. Mackinlay,et al.  The design space of input devices , 1990, CHI '90.

[41]  I. Scott MacKenzie,et al.  Extending Fitts' law to two-dimensional tasks , 1992, CHI.

[42]  David F. McAllister,et al.  Comparison of stereoscopic cursors for the interactive manipulation of B-splines , 1991, Electronic Imaging.

[43]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[44]  Shumin Zhai,et al.  Scale effects in steering law tasks , 2001, CHI.

[45]  Alexander I. Rudnicky,et al.  Models for evaluating interaction protocols in speech recognition , 1991, CHI.

[46]  Luke S. Zettlemoyer,et al.  An Imprecise Mouse Gesture for the Fast Activation of Controls , 1999, INTERACT.