Giving ergonomics away? The application of ergonomics methods by novices.

A re-occurring theme in applied ergonomics is the idea of "giving the methods away" to those with little formal education in the subject. Little is known, however, about the reliability and validity of these methods when applied to the design process, for novices or experts. It is important to establish just how well the methods will perform in the hands of the analyst. The study reported in this paper presents data on novice intra-analyst and inter-analyst reliability together with criterion-referenced validity across a range of methods. Considerable variation in the reliability and validity of the methods was found. The data were then used in utility analysis, to determine the cost-effectiveness of the methods for an example of car radio-cassette design. The analysis shows that estimates of cost-effectiveness may help in the selection of methods.

[1]  Mark S. Young,et al.  Guide to Methodology in Ergonomics: Designing for Human Use , 1999 .

[2]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[3]  W. Karwowski.  International encyclopedia of ergonomics and human factors , 2001 .

[4]  Gary Herrin,et al.  A guide to practical human reliability assessment , 1996 .

[5]  J. Boudreau.  Effects of employee flows on utility analysis of human resource productivity improvement programs. , 1983 .

[6]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[7]  M. Burke,et al.  A New Approach for Utility Analysis , 1990 .

[8]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[9]  Dan Diaper.  Giving HCI away , 1990 .

[10]  Chris Baber,et al.  Repertory Grid Theory and its Application to Product Evaluation , 1996 .

[11]  John Annett,et al.  A note on the validity and reliability of ergonomics methods , 2002 .

[12]  Mark S. Young,et al.  Drive-by-wire: The case of driver workload and reclaiming control with adaptive cruise control , 1997 .

[13]  John W. Boudreau,et al.  Role of recruitment in staffing utility analysis. , 1985 .

[14]  Mark A. Huselid,et al.  Direct estimates of SDy and the implications for utility analysis , 1992 .

[15]  Wesley E. Woodson,et al.  Human Factors Design Handbook , 1981 .

[16]  Barry Kirwan,et al.  A Guide To Task Analysis: The Task Analysis Working Group , 1992 .

[17]  F. Schmidt,et al.  Individual differences in productivity: An empirical test of estimates derived from studies of selection procedure utility. , 1983 .

[18]  Mark S. Young,et al.  What price ergonomics? , 1999, Nature.

[19]  George R. S. Weir,et al.  People and Computers IX: Crafting Interaction: Styles, Metaphors, Modalities and Agents , 1994 .

[20]  S. Stevenage,et al.  Learning to predict human error: issues of acceptability, reliability and validity. , 1998, Ergonomics.

[21]  John T. Hazer,et al.  Factors influencing managers' reactions to utility analysis: Effects of SDy method, information frame, and focal intervention. , 1997 .

[22]  Janice Redish,et al.  Task analysis , 2002 .

[23]  John A. Henderson,et al.  Is utility really futile? A failure to replicate and an extension. , 1998 .

[24]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[25]  Robert Jacobson,et al.  Information Design , 2000 .

[26]  Y Yang,et al.  Evaluating usability of human-computer interfaces: a practical method , 1990 .

[27]  N. Stanton,et al.  Is utility in the mind of the beholder? A study of ergonomics methods. , 1998, Applied Ergonomics.

[28]  Dan Diaper,et al.  Task Analysis for Human-Computer Interaction , 1990 .

[29]  A. Shepherd,et al.  Guide to Task Analysis , 2003 .

[30]  Neville A. Stanton,et al.  Human Factors In Consumer Products , 1997 .

[31]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[32]  C Baber,et al.  Human error identification techniques applied to public technology: predictions compared with observed use. , 1996, Applied ergonomics.