A novel methodology for evaluating user interfaces in health care

A pilot study is reported to identify an improved method of evaluating digital user interfaces in health care. Experience and developments from the aviation industry and the NASA-TLX mental workload assessment tools are applied in conjunction with Nielsen heuristics for evaluating an Electronic Health Record System in an Irish hospital. The NASA-TLX performs subjective workload assessments on operators working with various human-computer systems. Results suggest that depending on the cognitive workload and the working context of users, the usability will differ for the same digital interface. We conclude that incorporating the NASA-TLX with Nielsen's heuristics offers a more reliable method in design and evaluation of digital user interfaces in clinical environments, since the healthcare work context is taken into account. Improved interfaces can be expected to reduce medical errors and improve patient care.

[1]  Heather W. Desurvire,et al.  Faster, cheaper!! Are usability inspection methods as effective as empirical testing? , 1994 .

[2]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[3]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[4]  Nazife Baykal,et al.  A Knowledge Based Search Tool for Performance Measures in Health Care Systems , 2012, Journal of Medical Systems.

[5]  Moshe Eizenman,et al.  THE IMPACT OF COGNITIVE DISTRACTION ON DRIVER VISUAL BEHAVIOUR AND VEHICLE CONTROL , 2002 .

[6]  Lee L Swanstrom,et al.  A triangulating operating platform enhances bimanual performance and reduces surgical workload in single-incision laparoscopy. , 2011, Journal of the American College of Surgeons.

[7]  Stephen H Walsh.  The clinician's perspective on electronic health records and how they can affect patient care , 2004, BMJ : British Medical Journal.

[8]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  André Kushniruk,et al.  Evaluation in the design of health information systems: application of approaches emerging from usability engineering , 2002, Comput. Biol. Medicine.

[10]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[11]  G. Young,et al.  Assessment of workload using NASA Task Load Index in perianesthesia nursing. , 2008, Journal of perianesthesia nursing : official journal of the American Society of PeriAnesthesia Nurses.

[12]  Blackford Middleton,et al.  Barriers to Electronic Health Record Use during Patient Visits , 2006, AMIA.

[13]  M. Mills,et al.  Usability of Health Web Sites for Older Adults: A Preliminary Study , 2004, Computers, informatics, nursing : CIN.