User Testing of an Admission, Discharge, Transfer System: Usability Evaluation

Introduction: To improve the first step of the hospitalization procedure, appropriate interaction must be established between users and the admission, discharge, and transfer system. The aim of this study was to evaluate the usability of the ADT system in some of selected Iranian non-teaching hospitals. Material and Methods: This study was cross-sectional research that has evaluated the usability of a selected ADT system using the think-aloud method by 11 medical record administrators. Users were asked to follow the provided scenario, then share and elaborate on what they saw, thought about, did, felt, and decided during their interaction with the system. Users' feedbacks were collected and organized into four main categories for further processing. Results: To evaluate the usability of an ADT system, four routine scenario tasks were followed by users and only 45.45% of them could implement all tasks. Overall, 36 independent problems were identified. All problems were related to the data entry categories that accounted for the largest share. The most important problems were related to the issues regarding "date of birth" field in this category which deals with the outpatient admission process. Conclusion: The study of the usability testing method indicated that the ADT subsystem of non-teaching hospital has many problems in interact with real users with the system. It showed that more than half of the users could not completely and successfully perform the entire real-world scenario tasks. Furthermore, the most usability problems were found in data entry categories.

[1]  Reza Khajouei,et al.  Usability evaluation of an emergency information system: a heuristic evaluation. , 2013 .

[2]  M. Shah,et al.  Electronic Prescribing Usability: Reduction of Mental Workload and Prescribing Errors Among Community Physicians. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[3]  Vickie Nguyen,et al.  Detection and characterization of usability problems in structured data entry interfaces in dentistry , 2013, Int. J. Medical Informatics.

[4]  Vimla L. Patel,et al.  Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces , 1997, AMIA.

[5]  Maarten van Someren,et al.  The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes , 1994 .

[6]  Monique W. M. Jaspers,et al.  A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence , 2009, Int. J. Medical Informatics.

[7]  Monique W. M. Jaspers,et al.  Determination of the effectiveness of two methods for usability evaluation using a CPOE medication ordering system , 2011, Int. J. Medical Informatics.

[8]  Jakob Nielsen,et al.  Estimating the number of subjects needed for a thinking aloud test , 1994, Int. J. Hum. Comput. Stud..

[9]  J. M. Christian Bastien,et al.  Usability testing: a review of some methodological and technical aspects of the method , 2010, Int. J. Medical Informatics.

[10]  Monique W. M. Jaspers,et al.  Usability Evaluation of a Computerized Physician Order Entry for Medication Ordering , 2009, MIE.

[11]  Robert C. Williges,et al.  Criteria For Evaluating Usability Evaluation Methods , 2001, Int. J. Hum. Comput. Interact..

[12]  R. Khajouei,et al.  Classification and prioritization of usability problems using an augmented classification scheme , 2011, J. Biomed. Informatics.

[13]  Khajouei Reza,et al.  USABILITY EVALUATION OF A LABORATORY INFORMATION SYSTEM , 2013 .

[14]  Reza Khajouei,et al.  Evaluation methods used on health information systems (HISs) in Iran and the effects of HISs on Iranian healthcare: A systematic review , 2015, Int. J. Medical Informatics.

[15]  Paul F. Marty,et al.  Usability at 90mph: Presenting and evaluating a new, high-speed method for demonstrating user testing in front of an audience , 2005, First Monday.

[16]  Anu Kankainen,et al.  Usability testing of mobile applications: a comparison between laboratory and field testing , 2005 .

[17]  M. Moattari,et al.  Validating a Web-based Diabetes Education Program in continuing nursing education: knowledge and competency change and user perceptions on usability and quality , 2014, Journal of Diabetes & Metabolic Disorders.

[18]  Dov Te'eni,et al.  Human-Computer Interaction: Developing Effective Organizational Information Systems , 2006 .

[19]  Reza Khajouei,et al.  Usability Evaluation of Laboratory and Radiology Information Systems Integrated into a Hospital Information System , 2014, Journal of Medical Systems.

[20]  Julia Wagner,et al.  Usability testing in the hospital , 2012 .

[21]  Niels Peek,et al.  Usability evaluation of a guideline implementation system for cardiac rehabilitation: think aloud study. , 2012, Studies in health technology and informatics.

[22]  Zahra Ghanbari,et al.  Psychometric properties of the persian language version of the system usability scale. , 2014, Health promotion perspectives.

[23]  Faisal Sultan,et al.  Development of an in-house hospital information system in a hospital in Pakistan , 2014, Int. J. Medical Informatics.

[24]  Menno D. T. de Jong,et al.  Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison , 2004, Interact. Comput..

[25]  Clare-Marie Karat,et al.  Cost-Benefit Analysis of Usability Engineering Techniques , 1990 .

[26]  Monique W. M. Jaspers,et al.  Usability Evaluation of a Laboratory Order Entry System: Cognitive Walkthrough and Think Aloud Combined , 2005, MIE.