Pre-Post Evaluation of Physicians' Satisfaction with a Redesigned Electronic Medical Record System

Physicians' acceptance of Electronic Medical Record Systems (EMRs) is closely related to their usability. Knowledge about end-users' opinions on usability of an EMR system may contribute to planning for the next phase of the usability cycle of the system. A demand for integration of new functionalities, such as computerized order entry and an electronic patient status led to redesign of our EMR system, which had been in use for over 8 years at the Academic Medical Center of Amsterdam. The aim of this study was to understand whether the redesigned EMR system was an improvement of the earlier EMR and which system aspects accounted for user satisfaction and which did not. We conducted a formative pre- and post usability evaluation of our former and redesigned EMR system. For the assessment of both system versions' usability, we distributed two standardized usability questionnaires among 150 clinicians who routinely had used the older EMR system and had been working with its newer version for 6 weeks. Though overall user satisfaction was relatively high for both EMR systems, screen layout and interaction structure proved less easy to work with in the newer EMR system. The new EMR system however was more appreciated because of its enhanced functionality, capabilities and likeable user-interface. The results point to a number of actions that might be useful in future usability improvement efforts of our EMR system and other EMRs.

[1]  C. Delpierre,et al.  A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach? , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[2]  Monique W. M. Jaspers,et al.  The think aloud method: a guide to user interface design , 2004, Int. J. Medical Informatics.

[3]  Paul N. Gorman,et al.  Impacts of computerized physician documentation in a teaching hospital: perceptions of faculty and resident physicians. , 2004, Journal of the American Medical Informatics Association : JAMIA.

[4]  Robyn Tamblyn,et al.  Review Paper: The Impact of Electronic Health Records on Time Efficiency of Physicians and Nurses: A Systematic Review , 2005, J. Am. Medical Informatics Assoc..

[5]  P Knaup,et al.  The computerized patient record: where do we stand ? , 2006, Yearbook of medical informatics.

[6]  M. Gardiner,et al.  Applying cognitive psychology to user-interface design , 1987 .

[7]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[8]  Daniel B. Hier,et al.  Differing faculty and housestaff acceptance of an electronic health record , 2005, Int. J. Medical Informatics.

[9]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[10]  Qi Li,et al.  Using qualitative studies to improve the usability of an EMR , 2005, J. Biomed. Informatics.

[11]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[12]  Anne F. Kittler,et al.  A cost-benefit analysis of electronic medical records in primary care. , 2003, The American journal of medicine.

[13]  Sabeen Durrani,et al.  Applying Cognitive Psychology to User Interfaces , 2009, IHCI.