Automation bias in electronic prescribing

BackgroundClinical decision support (CDS) in e-prescribing can improve safety by alerting potential errors, but introduces new sources of risk. Automation bias (AB) occurs when users over-rely on CDS, reducing vigilance in information seeking and processing. Evidence of AB has been found in other clinical tasks, but has not yet been tested with e-prescribing. This study tests for the presence of AB in e-prescribing and the impact of task complexity and interruptions on AB.MethodsOne hundred and twenty students in the final two years of a medical degree prescribed medicines for nine clinical scenarios using a simulated e-prescribing system. Quality of CDS (correct, incorrect and no CDS) and task complexity (low, low + interruption and high) were varied between conditions. Omission errors (failure to detect prescribing errors) and commission errors (acceptance of false positive alerts) were measured.ResultsCompared to scenarios with no CDS, correct CDS reduced omission errors by 38.3% (p < .0001, n = 120), 46.6% (p < .0001, n = 70), and 39.2% (p < .0001, n = 120) for low, low + interrupt and high complexity scenarios respectively. Incorrect CDS increased omission errors by 33.3% (p < .0001, n = 120), 24.5% (p < .009, n = 82), and 26.7% (p < .0001, n = 120). Participants made commission errors, 65.8% (p < .0001, n = 120), 53.5% (p < .0001, n = 82), and 51.7% (p < .0001, n = 120). Task complexity and interruptions had no impact on AB.ConclusionsThis study found evidence of AB omission and commission errors in e-prescribing. Verification of CDS alerts is key to avoiding AB errors. However, interventions focused on this have had limited success to date. Clinicians should remain vigilant to the risks of CDS failures and verify CDS.

[1]  Joyce J. P. A. Bierbooms,et al.  A scenario analysis of the future residential requirements for people with mental health problems in Eindhoven , 2011, BMC Medical Informatics Decis. Mak..

[2]  Joseph S. Valacich,et al.  The Influence of Task Interruption on Individual Decision Making: An Information Overload Perspective , 1999 .

[3]  Farah Magrabi,et al.  Errors and electronic prescribing: a controlled laboratory study to examine task complexity and interruption effects , 2010, J. Am. Medical Informatics Assoc..

[4]  ELSKE AMMENWERTH,et al.  Review Paper: The Effect of Electronic Prescribing on Medication Errors and Adverse Drug Events: A Systematic Review , 2008, J. Am. Medical Informatics Assoc..

[5]  Farah Magrabi,et al.  Why is it so difficult to measure the effects of interruptions in healthcare? , 2010, MedInfo.

[6]  Michelle Sweidan,et al.  Evaluation of features to support safety and quality in general practice clinical software , 2011, BMC Medical Informatics Decis. Mak..

[7]  Richard O Day,et al.  Where to find information about drugs. , 2016, Australian prescriber.

[8]  Abdul V. Roudsari,et al.  Automation bias: a systematic review of frequency, effect mediators, and mitigators , 2012, J. Am. Medical Informatics Assoc..

[9]  Lorenzo Strigini,et al.  How to Discriminate between Computer-Aided and Computer-Hindered Decisions , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  Abdul V. Roudsari,et al.  Study of the Effects of Clinical Decision Support System's Incorrect Advice and Clinical Case Difficulty on Users' Decision Making Accuracy , 2011, ITCH.

[11]  Lorenzo Strigini,et al.  Effects of incorrect computer-aided detection (CAD) output on human decision-making in mammography. , 2004, Academic radiology.

[12]  K. Mosier,et al.  Human Decision Makers and Automated Decision Aids: Made for Each Other? , 1996 .

[13]  Wei Wu,et al.  The Effect of Computerized Physician Order Entry with Clinical Decision Support on the Rates of Adverse Drug Events: A Systematic Review , 2008, Journal of General Internal Medicine.

[14]  Abdul V. Roudsari,et al.  Automation bias: Empirical results assessing influencing factors , 2014, Int. J. Medical Informatics.

[15]  Enrico Coiera,et al.  Technology, cognition and error , 2015, BMJ Quality & Safety.

[16]  Graeme Miller,et al.  General Practice Activity in Australia 2013–14 , 2012 .

[17]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[18]  Enrico W. Coiera,et al.  Automation bias and verification complexity: a systematic review , 2017, J. Am. Medical Informatics Assoc..

[19]  Raja Parasuraman,et al.  Monitoring Automation Failures: Effects of Automation Reliability and Task Complexity , 1992 .

[20]  David Taylor An in depth investigation into causes of prescribing errors by foundation trainees in relation to their medical education , 2007 .

[21]  Mark W. Scerbo,et al.  Automation-induced complacency for monitoring highly reliable systems: the role of task complexity, system experience, and operator trust , 2007 .

[22]  Julie M. Fiskio,et al.  Analysis of clinical decision support system malfunctions: a case series and survey , 2016, J. Am. Medical Informatics Assoc..

[23]  Dietrich Manzey,et al.  Misuse of Diagnostic Aids in Process Control: The Effects of Automation Misses on Complacency and Automation Bias , 2008 .

[24]  Frank Bogun,et al.  Misdiagnosis of atrial fibrillation and its clinical consequences. , 2004, The American journal of medicine.

[25]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[26]  Rahul M. Dodhia,et al.  Interruptions create prospective memory tasks , 2009 .

[27]  Dietrich Manzey,et al.  Misuse of automated decision aids: Complacency, automation bias and the impact of training experience , 2008, Int. J. Hum. Comput. Stud..

[28]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[29]  Kathleen L. Mosier,et al.  Accountability and automation bias , 2000, Int. J. Hum. Comput. Stud..

[30]  Farah Magrabi,et al.  A systematic review of the psychological literature on interruption and its patient safety implications , 2012, J. Am. Medical Informatics Assoc..

[31]  J. Braithwaite,et al.  Effects of Two Commercial Electronic Prescribing Systems on Prescribing Error Rates in Hospital In-Patients: A Before and After Study , 2012, PLoS medicine.

[32]  Kathleen L. Mosier,et al.  Aircrews and Automation Bias: The Advantages of Teamwork? , 2001 .

[33]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[34]  Greg A. Jamieson,et al.  The impact of context-related reliability on automation failure detection and scanning behaviour , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[35]  Linda Onnasch,et al.  Misuse of Automation: The Impact of System Experience on Complacency and Automation Bias in Interaction with Automated Aids , 2010 .

[36]  A. Egberts,et al.  The Effect of Computerized Physician Order Entry on Medication Prescription Errors and Clinical Outcome in Pediatric and Intensive Care: A Systematic Review , 2009, Pediatrics.

[37]  D. Altman,et al.  Multiple significance tests: the Bonferroni method , 1995, BMJ.

[38]  Linda Onnasch,et al.  Human Performance Consequences of Automated Decision Aids , 2012 .

[39]  Action Programme on Essential Drugs,et al.  Guide to good prescribing : a practical manual , 1995 .