Towards a Methodology Employing Critical Parameters to Deliver Performance Improvements in Interactive Systems

In the design of interactive systems, overall performance issues tend to receive less attention than provision of functionality. As a result, systems may not always offer perform- ance improvements to their users. In this paper we present some proposals for methods based on the use of application-specific critical parameters, i.e., performance parameters that measure how well the system serves its purpose. We argue that these parameters can provide a basis for dealing with performance issues in design. To construct this basis, there is a need to focus on identifying parameters through field studies, and on constructing models for use in making performance pre- dictions. We provide a number of examples of critical parameters, and discuss problems we have encountered in identifying them and in model construction. We summarise the results of a study of designers working with critical parameters. A final section of the paper discusses the feasibility of introducing critical parameters to HCI design practice.

[1]  Walter G. Vincenti,et al.  What Engineers Know and How They Know It: Analytical Studies from Aeronautical History. , 1992 .

[2]  S Lammers,et al.  Programmers at Work: Interviews with 19 of Today's Most Brilliant Programmers , 1986 .

[3]  W. Gibbs.  Taking Computers to Task , 1997 .

[4]  Peter G. Polson,et al.  Theory-Based Design for Easily Learned Interfaces , 1990, Hum. Comput. Interact..

[5]  D. Wellman,et al.  Talking About Machines: An Ethnography of a Modern Job. , 1997 .

[6]  William M. Newman,et al.  Better or just different? On the benefits of designing interactive systems in terms of critical parameters , 1997, DIS '97.

[7]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[8]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[9]  J. Orr.  Talking about Machines: An Ethnography of a Modern Job , 1998 .

[10]  Alan J. Dix,et al.  Interaction in the large , 1998, Interact. Comput..

[11]  Thomas K. Landauer,et al.  The trouble with computers , 1995 .

[12]  Stuart K. Card,et al.  Information foraging in information access environments , 1995, CHI '95.

[13]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[14]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[15]  Kenton O'Hara,et al.  Student readers' use of library documents: implications for library technologies , 1998, CHI.

[16]  J. Orr,et al.  Talking About Machines: An Ethnography of a Modern Job. , 1997 .

[17]  Kee Yong Lim,et al.  The MUSE Method for Usability Engineering , 1997, INTERACT.

[18]  James D. Herbsleb,et al.  Preserving knowledge in design projects: what designers need to know , 1993, INTERCHI.

[19]  R. Harper,et al.  Inside the IMF: An Ethnography of Documents, Technology, and Organizational Action , 1997 .

[20]  Thomas P. Moran,et al.  Questions, Options, and Criteria: Elements of Design Space Analysis , 1991, Hum. Comput. Interact..

[21]  Clayton Lewis,et al.  Theory-based design for easily learned interfaces , 1990 .

[22]  Walter Guido Vincenti,et al.  What Engineers Know and How They Know It: Analytical Studies from Aeronautical History by Walter G. Vincenti , 1992, Technology and Culture.