The influence of user expertise and prototype fidelity in usability tests.

An empirical study examined the impact of user expertise and prototype fidelity on the outcomes of a usability test. User expertise (expert vs. novice) and prototype fidelity (paper prototype, 3D mock-up, and fully operational appliance) were manipulated as independent variables in a 2x3 between-subjects design. Employing a floor scrubber as a model product, 48 users carried out several cleaning tasks. Usability problems identified by participants were recorded. Furthermore, performance, system management strategies and perceived usability were measured. The results showed that experts reported more usability problems than novices but these were considered to be less severe than those reported by novices. Reduced fidelity prototypes were generally suitable to predict product usability of the real appliance. The implications for the running of usability tests are specific to the fidelity of the prototype.

[1]  Joseph S. Dumas,et al.  Does the Fidelity of Software Prototypes Affect the Perception of Usability? , 1992 .

[2]  Bruno Rüttinger,et al.  Environmental conservation in the domestic domain: the influence of technical design features and person-based factors , 2004, Ergonomics.

[3]  Juergen Sauer,et al.  Designing interactive consumer products: utility of paper prototypes and effectiveness of enhanced control labelling. , 2008, Applied ergonomics.

[4]  Anu Kankainen,et al.  Usability testing of mobile applications: a comparison between laboratory and field testing , 2005 .

[5]  Andreas Sonderegger,et al.  The influence of prototype fidelity and aesthetics of design in usability tests: effects on user behaviour, subjective evaluation and emotion. , 2009, Applied ergonomics.

[6]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[7]  William H. Cushman,et al.  Human Factors in Product Design , 1991 .

[8]  Jan Stage,et al.  Does time heal?: a longitudinal study of usability , 2005 .

[9]  S Säde,et al.  Testing usability with 3D paper prototypes--Case Halton system. , 1998, Applied ergonomics.

[10]  Eduardo Salas,et al.  Scaled Worlds: Development, Validation and Applications , 2004 .

[11]  T. Cox,et al.  Human stress and cognition: Vernon Hamilton and David Warburton (Eds) John Wiley and Sons, Chichester, pp 502, £19.50 , 1980 .

[12]  Mark T. Keane,et al.  Cognitive Psychology: A Student's Handbook , 1990 .

[13]  Janetta Mitchell McCoy,et al.  Physical Work Environment , 2005 .

[14]  Demetrios Karis,et al.  Usability problem identification using both low- and high-fidelity prototypes , 1996, CHI.

[15]  Jan Stage,et al.  New techniques for usability evaluation of mobile systems , 2004, Int. J. Hum. Comput. Stud..

[16]  W. Green,et al.  Usability and Product Design: A Case Study , 1999 .

[17]  Angela M. Cirucci,et al.  Usability Testing , 2021, UX Research Methods for Media and Communication Studies.

[18]  Jakob Nielsen,et al.  Paper versus computer implementations as mockup scenarios for heuristic evaluation , 1990, INTERACT.

[19]  Carolyn Snyder,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2003 .

[20]  B. Brehmer,et al.  Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study , 1993 .

[21]  R. Zajonc.  SOCIAL FACILITATION. , 1965, Science.

[22]  Jochen Prümper,et al.  Virtuelle Prototypen als Werkzeuge zur benutzerzentrierten Produktentwicklung , 1993 .

[23]  Manfred Tscheligi,et al.  Paper prototyping - what is it good for?: a comparison of paper- and computer-based low-fidelity prototyping , 2003, CHI Extended Abstracts.

[24]  Jo Wood,et al.  On the reliability of usability testing , 2001, CHI Extended Abstracts.

[25]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[26]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[27]  Klaus Kaasgaard,et al.  Comparative usability evaluation , 2004, Behav. Inf. Technol..

[28]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[29]  James A. Landay,et al.  High-Fidelity or Low-Fidelity, Paper or Computer? Choosing Attributes when Testing Web Prototypes , 2002 .

[30]  M. Frone,et al.  Handbook of work stress , 2005 .

[31]  Andreas Sonderegger,et al.  The influence of laboratory set-up in usability tests: effects on user performance, subjective ratings and physiological measures , 2009, Ergonomics.

[32]  David W. Biers,et al.  Usability Evaluation and Prototype Fidelity: Users and Usability Professionals , 1998 .

[33]  Joe Siponen,et al.  Challenging the HCI Concept of Fidelity by Positioning Ozlab Prototypes , 2006 .