Heuristic evaluation of paper-based Web pages: A simplified inspection usability methodology

Online medical information, when presented to clinicians, must be well-organized and intuitive to use, so that the clinicians can conduct their daily work efficiently and without error. It is essential to actively seek to produce good user interfaces that are acceptable to the user. This paper describes the methodology used to develop a simplified heuristic evaluation (HE) suitable for the evaluation of screen shots of Web pages, the development of an HE instrument used to conduct the evaluation, and the results of the evaluation of the aforementioned screen shots. In addition, this paper presents examples of the process of categorizing problems identified by the HE and the technological solutions identified to resolve these problems. Four usability experts reviewed 18 paper-based screen shots and made a total of 108 comments. Each expert completed the task in about an hour. We were able to implement solutions to approximately 70% of the violations. Our study found that a heuristic evaluation using paper-based screen shots of a user interface was expeditious, inexpensive, and straightforward to implement.

[1]  Marita Franzke,et al.  Usability evaluation with the cognitive walkthrough , 1995, CHI 95 Conference Companion.

[2]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[3]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[4]  Peter L. Elkin,et al.  Case Report: Optimization of a Research Web Environment for Academic Internal Medicine Faculty , 2002, J. Am. Medical Informatics Assoc..

[5]  Vimla L. Patel,et al.  Using usability heuristics to evaluate patient safety of medical devices , 2003, J. Biomed. Informatics.

[6]  Larry E. Wood,et al.  User Interface Design: Bridging the Gap from User Requirements to Design , 1997 .

[7]  Heather Kanuka,et al.  Effects of violating screen design principles of balance, unity, and focus on recall learning, study time, and completion rates , 1999 .

[8]  L. Faulkner.  Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[9]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[10]  Marie-Catherine Beuscart-Zéphir,et al.  Usability assessment study of a web site displaying medical resources on line: the CISMeF. , 2002, Studies in health technology and informatics.

[11]  Jianhua Li,et al.  Sharing Infobuttons to Resolve Clinicians' Information Needs , 2003, AMIA.

[12]  B. Shneiderman.  Designing the User Interface (3rd Ed.) , 1998 .

[13]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[14]  L. Ohno-Machado.  Journal of Biomedical Informatics , 2001 .

[15]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[16]  Steve Parkes,et al.  Trends in the use of verbal protocol analysis in software engineering research , 2003, Behav. Inf. Technol..

[17]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[18]  Vimla L. Patel,et al.  Characterizing Information Needs and Cognitive Processes During CIS Use , 2003, AMIA.

[19]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[20]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[21]  H. M. Grady.  Web site design: a case study in usability testing using paper prototypes , 2000, 18th Annual Conference on Computer Documentation. ipcc sigdoc 2000. Technology and Teamwork. Proceedings. IEEE Professional Communication Society International Professional Communication Conference an.

[22]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[23]  Vimla L. Patel,et al.  Heuristic evaluation of infusion pumps: implications for patient safety in Intensive Care Units , 2004, Int. J. Medical Informatics.

[24]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[25]  Jianhua Li,et al.  Use of Online Resources While Using a Clinical Information System , 2003, AMIA.

[26]  Vimla L. Patel,et al.  Cognitive and usability engineering methods for the evaluation of clinical information systems , 2004, J. Biomed. Informatics.

[27]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[28]  C R Doarn,et al.  Heuristic evaluation of a web-based interface for internet telemedicine. , 1999, Telemedicine journal : the official journal of the American Telemedicine Association.

[29]  Vimla L. Patel,et al.  Clinical Information Needs in Context: An Observational Study of Clinicians While Using a Clinical Information System , 2003, AMIA.