A usability evaluation of four commercial dental computer-based patient record systems.

BACKGROUND The usability of dental computer-based patient record (CPR) systems has not been studied, despite early evidence that poor usability is a problem for dental CPR system users at multiple levels. METHODS The authors conducted formal usability tests of four dental CPR systems by using a purposive sample of four groups of five novice users. The authors measured task outcomes (correctly completed, incorrectly completed and incomplete) in each CPR system while the participants performed nine clinical documentation tasks, as well as the number of usability problems identified in each CPR system and their potential relationship to task outcomes. The authors reviewed the software application design aspects responsible for these usability problems. RESULTS The range for correctly completed tasks was 16 to 64 percent, for incorrectly completed tasks 18 to 38 percent and for incomplete tasks 9 to 47 percent. The authors identified 286 usability problems. The main types were three unsuccessful attempts, negative affect and task incorrectly completed. They also identified six problematic interface and interaction designs that led to usability problems. CONCLUSION The four dental CPR systems studied have significant usability problems for novice users, resulting in a steep learning curve and potentially reduced system adoption. CLINICAL IMPLICATIONS The significant number of data entry errors raises concerns about the quality of documentation in clinical practice.

[1]  Madhu C. Reddy,et al.  Incorporating ideas from computer-supported cooperative work , 2004, J. Biomed. Informatics.

[2]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[3]  Sara Rosenbaum,et al.  How common are electronic health records in the United States? A summary of the evidence. , 2006, Health affairs.

[4]  E Coiera,et al.  Section 1: Health and Clinical Mangement: The Safety and Quality of Decision Support Systems , 2006, Yearbook of Medical Informatics.

[5]  John Fitzpatrick,et al.  If you build it (right), they will come: the physician-friendly CPOE. Not everything works as planned right out of the box. A Mississippi hospital customizes its electronic order entry system for maximum use by physicians. , 2005, Health management technology.

[6]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[7]  Elizabeth M Borycki,et al.  Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application , 2005, Int. J. Medical Informatics.

[8]  Heiko Spallek,et al.  Research Paper: A Qualitative Investigation of the Content of Dental Paper-based and Computer-based Patient Record Formats , 2007, J. Am. Medical Informatics Assoc..

[9]  David W. Bates,et al.  Reducing the frequency of errors in medicine using information technology. , 2001, Journal of the American Medical Informatics Association : JAMIA.

[10]  Charles G. Martin,et al.  Influence of data display formats on physician investigators' decisions to stop clinical trials: prospective trial with repeated measures , 1999, BMJ.

[11]  Vimla L. Patel,et al.  Heuristic evaluation of infusion pumps: implications for patient safety in Intensive Care Units , 2004, Int. J. Medical Informatics.

[12]  Vimla L. Patel,et al.  A cognitive taxonomy of medical errors , 2004, J. Biomed. Informatics.

[13]  Bonnie E. John,et al.  Evaluating a multimedia authoring tool , 1997 .

[14]  Daniel Z. Sands,et al.  A usability study of physicians interaction with a paper-based patient record system and a graphical-based electronic patient record system , 2002, AMIA.

[15]  Jeremy C Wyatt,et al.  Helping clinicians to find data and avoid delays , 1998, The Lancet.

[16]  Morten Hertzum,et al.  The Evaluator Effect in Usability Studies: Problem Detection and Severity Judgments , 1998 .

[17]  I. Sim,et al.  Physicians' use of electronic medical records: barriers and solutions. , 2004, Health affairs.

[18]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[19]  Titus K L Schleyer,et al.  Assessing software usability through heuristic evaluation. , 2007, Journal of the American Dental Association.

[20]  Vimla L. Patel,et al.  The Cognitive Complexity of a Provider Order Entry Interface , 2003, AMIA.

[21]  P S Button,et al.  Automating clinical documentation in dentistry: case study of a clinical integration model. , 1999, Journal of healthcare information management : JHIM.

[22]  Vimla L. Patel,et al.  Cognitive Approaches to the Evaluation of Healthcare Information Systems , 2005 .

[23]  Heiko Spallek,et al.  Clinical computing in general dentistry. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[24]  Vimla L. Patel,et al.  Cognitive and usability engineering methods for the evaluation of clinical information systems , 2004, J. Biomed. Informatics.

[25]  Steven R. Simon,et al.  Correlates of electronic health record adoption in office practices: a statewide survey. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[26]  Titus K L Schleyer,et al.  Heuristic evaluation of clinical functions in four practice management systems: a pilot study. , 2007, Journal of the American Dental Association.

[27]  David D. Woods,et al.  Users as Designers: How People Cope with Poor HCI Design in Computer-Based Medical Devices , 1994, Hum. Factors.

[28]  Todd R. Johnson,et al.  Increasing productivity and reducing errors through usability analysis: a case study and recommendations , 2000, AMIA.

[29]  C. Aydin,et al.  Evaluating the organizational impact of healthcare information systems , 2005 .

[30]  T K Schleyer,et al.  Validation of an instrument to measure dental students' use of, knowledge about, and attitudes towards computers. , 2001, Journal of dental education.

[31]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[32]  Qi Li,et al.  Using qualitative studies to improve the usability of an EMR , 2005, J. Biomed. Informatics.

[33]  Todd R. Johnson,et al.  A user-centered framework for redesigning health care interfaces , 2005, J. Biomed. Informatics.