Errors and electronic prescribing: a controlled laboratory study to examine task complexity and interruption effects

OBJECTIVE To examine the effect of interruptions and task complexity on error rates when prescribing with computerized provider order entry (CPOE) systems, and to categorize the types of prescribing errors. DESIGN Two within-subject factors: task complexity (complex vs simple) and interruption (interruption vs no interruption). Thirty-two hospital doctors used a CPOE system in a computer laboratory to complete four prescribing tasks, half of which were interrupted using a counterbalanced design. MEASUREMENTS Types of prescribing errors, error rate, resumption lag, and task completion time. RESULTS Errors in creating and updating electronic medication charts that were measured included failure to enter allergy information; selection of incorrect medication, dose, route, formulation, or frequency of administration from lists and drop-down menus presented by the CPOE system; incorrect entry or omission in entering administration times, start date, and free-text qualifiers; and omissions in prescribing and ceasing medications. When errors occurred, the error rates across the four prescribing tasks ranged from 0.5% (1 incorrect medication selected out of 192 chances for selecting a medication or error opportunities) to 16% (5 failures to enter allergy information out of 32 error opportunities). Any impact of interruptions on prescribing error rates and task completion times was not detected in our experiment. However, complex tasks took significantly longer to complete (F(1, 27)=137.9; p<0.001) and when execution was interrupted they required almost three times longer to resume compared to simple tasks (resumption lag complex=9.6 seconds, SD=5.6; resumption lag simple=3.4 seconds, SD=1.7; t(28)=6.186; p<0.001). CONCLUSION Most electronic prescribing errors found in this study could be described as slips in using the CPOE system to create and update electronic medication charts. Cues available within the user interface may have aided resumption of interrupted tasks making CPOE systems robust to some interruption effects. Further experiments are required to rule out any effect interruption might have on CPOE error rates.

[1]  J. Trafton,et al.  The effect of interruption duration and demand on resuming suspended goals. , 2008, Journal of experimental psychology. Applied.

[2]  E. Coiera Clinical communication: a new informatics paradigm. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[3]  Farah Magrabi,et al.  Why is it so difficult to measure the effects of interruptions in healthcare? , 2010, MedInfo.

[4]  Joseph S. Valacich,et al.  The Influence of Task Interruption on Individual Decision Making: An Information Overload Perspective , 1999 .

[5]  Hardeep Singh,et al.  Prescription errors and outcomes related to inconsistent information transmitted through computerized order entry: a prospective study. , 2009, Archives of internal medicine.

[6]  Joseph F. Amaral,et al.  Effects of an integrated clinical information system on medication safety in a multi-hospital setting. , 2007, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[7]  Joseph S. Valacich,et al.  The Effects of Interruptions, Task Complexity, and Information Presentation on Computer-Supported Decision-Making Performance , 2003, Decis. Sci..

[8]  B. Karsh,et al.  Interruptions and Distractions in Healthcare: Review and Reappraisal Method Inclusion and Exclusion Criteria Nih Public Access , 2022 .

[9]  K. A. Latorella Investigating Interruptions: An Example from the Flightdeck , 1996 .

[10]  Rahul M. Dodhia,et al.  Interruptions create prospective memory tasks , 2009 .

[11]  Ann Blandford,et al.  The effect of interruptions on postcompletion and other procedural errors: an account based on the activation-based goal memory model. , 2008, Journal of experimental psychology. Applied.

[12]  W. Dunsmuir,et al.  Association of interruptions with an increased risk and severity of medication administration errors. , 2010, Archives of internal medicine.

[13]  Brian P. Bailey,et al.  On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state , 2006, Comput. Hum. Behav..

[14]  E Coiera,et al.  Section 1: Health and Clinical Mangement: The Safety and Quality of Decision Support Systems , 2006, Yearbook of Medical Informatics.

[15]  B. Franklin,et al.  The effects of electronic prescribing on the quality of prescribing. , 2008, British journal of clinical pharmacology.

[16]  Constantine Stephanidis,et al.  Human-computer interaction : theory and practice , 2003 .

[17]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[18]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[19]  F. Glascoe Improving clinical communication: a view from psychology. , 2001 .

[20]  Dylan M. Jones,et al.  Interruption of the Tower of London task: support for a goal-activation approach. , 2006, Journal of experimental psychology. General.

[21]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[22]  M. Byrne,et al.  A Working Memory Model of a Common Procedural Error , 1997 .

[23]  Joan S. Ash,et al.  The unintended consequences of computerized provider order entry: Findings from a mixed methods exploration , 2009, Int. J. Medical Informatics.

[24]  M. Singer,et al.  Medication errors: a prospective cohort study of hand-written and computerised physician order entry in the intensive care unit , 2005, Critical care.

[25]  Vimla L. Patel,et al.  Multitasking by Clinicians in the Context of CPOE and CIS Use , 2007, MedInfo.

[26]  Penelope M. Sanderson,et al.  Interruptions in healthcare: Theoretical views , 2009, Int. J. Medical Informatics.

[27]  Farah Magrabi Using cognitive models to evaluate safety-critical interfaces in healthcare , 2008, CHI Extended Abstracts.

[28]  Remy R Coeytaux,et al.  Effect of a computerized prescriber-order-entry system on reported medication errors. , 2005, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[29]  Ivan Burmistrov,et al.  Do Interrupted Users Work Faster or Slower? The Micro-analysis of Computerized Text Editing Task , 2003 .

[30]  Robert Paris Carroll Practice in rating. , 1931 .

[31]  Johanna I. Westbrook,et al.  Section 1: Health and Clinical Mangement: The Safety and Quality of Decision Support Systems , 2006 .

[32]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[33]  R. Wood Task complexity: Definition of the construct , 1986 .

[34]  Enrico W. Coiera,et al.  Communication behaviours in a hospital setting: an observational study , 1998, BMJ.

[35]  Gloria Mark,et al.  The cost of interrupted work: more speed and stress , 2008, CHI.

[36]  C. Zhan,et al.  Potential benefits and problems with computerized prescriber order entry: analysis of a voluntary medication error-reporting database. , 2006, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[37]  André Kushniruk,et al.  How Usability of a Web-Based Clinical Decision Support System Has the Potential to Contribute to Adverse Medical Events , 2008, AMIA.

[38]  D. Norman Categorization of action slips. , 1981 .

[39]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..