Comparative analysis of high- and low-fidelity prototypes for more valid usability evaluations of mobile devices

Validation of low-fidelity prototyping test results is difficult because we cannot claim whether the results are the effect of the prototype itself or the essence of the design concept we try to evaluate. However, it will cost too much if we implement a fully functional prototype for more valid evaluation. In this research, we provide a qualitative and reflective analysis of usability evaluations of a text messaging functionality of a mobile phone by comparing three types of prototyping techniques---paper-based and computer-based and fully functional prototype. This analysis led us to realize how significantly the unique characteristics of each different prototype affect the usability evaluation in different ways. We identify what characteristics of each prototype causes the differences in finding usability problems, and then suggest key considerations for designing more valid low-fidelity prototypes based on this analysis.

[1]  Mary Beth Rosson,et al.  A laboratory method for studying activity awareness , 2004, NordiCHI '04.

[2]  Tek-Jin Nam,et al.  Integrating hardware and software: augmented reality based prototyping method for digital products , 2003, CHI Extended Abstracts.

[3]  Michael Boyle,et al.  Customizable physical interfaces for interacting with conventional applications , 2002, UIST '02.

[4]  A. Lancaster,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2004, IEEE Transactions on Professional Communication.

[5]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, ACM Trans. Graph..

[6]  Darren Leigh,et al.  The calder toolkit: wired and wireless components for rapidly prototyping interactive devices , 2004, DIS '04.

[7]  Helen M. Grady Web site design: a case study in usability testing using paper prototypes , 2000, SIGDOC.

[8]  James A. Landay,et al.  Guest Editors' Introduction: Rapid Prototyping for Ubiquitous Computing , 2005, IEEE Pervasive Comput..

[9]  Gilbert Cockton,et al.  Sale must end: should discount methods be cleared off HCI's shelves? , 2002, INTR.

[10]  Peter Khooshabeh,et al.  Paper or interactive?: a study of prototyping techniques for ubiquitous computing environments , 2003, CHI Extended Abstracts.

[11]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[12]  Carolyn Snyder,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2003 .

[13]  Oscar Gutierrez Prototyping techniques for different problem contexts , 1989, CHI '89.

[14]  Yufei Yuan,et al.  Comparing telephone-computer interface designs: Are software simulations as good as hardware prototypes? , 1995, Int. J. Hum. Comput. Stud..

[15]  Celine Pering Interaction design prototyping of communicator devices: towards meeting the hardware-software challenge , 2002, INTR.

[16]  Kurt Schneider,et al.  Prototypes as assets, not toys. Why and how to extract knowledge from prototypes. (Experience report) , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[17]  Scott E. Hudson,et al.  Forming interactivity: a tool for rapid prototyping of physical interactive products , 2002, DIS '02.

[18]  Kori Inkpen Quinn,et al.  Evaluating early prototypes in context: trade-offs, challenges, and successes , 2005, IEEE Pervasive Computing.

[19]  Marc Rettig,et al.  Prototyping for tiny fingers , 1994, CACM.

[20]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[21]  Kenneth R. Stern,et al.  Low vs. high-fidelity prototyping debate , 1996, INTR.

[22]  Demetrios Karis,et al.  Usability problem identification using both low- and high-fidelity prototypes , 1996, CHI.

[23]  M. H. Heycock,et al.  Papers , 1971, BMJ : British Medical Journal.

[24]  Manfred Tscheligi,et al.  Paper prototyping - what is it good for?: a comparison of paper- and computer-based low-fidelity prototyping , 2003, CHI Extended Abstracts.

[25]  Michael Thompson,et al.  Prototyping: tools and techniques: improving software and documentation quality through rapid prototyping , 1992, SIGDOC '92.

[26]  Bonnie E. John,et al.  Multipurpose prototypes for assessing user interfaces in pervasive computing systems , 2005, IEEE Pervasive Computing.