Pilot evaluation of an optimized context-specific drug-drug interaction alerting system: A controlled pre-post study

OBJECTIVES Clinical decision support (CDS) systems are frequently used to reduce unwanted drug-drug interactions (DDIs) but often result in alert fatigue. The main objective of this study was to investigate whether a newly developed context-specific DDI alerting system would improve alert acceptance. METHODS A controlled pre-post intervention study was conducted in 4 departments in a university hospital. After a 7-month pre-intervention period, the new system was activated in the intervention departments, while the old system remained activated in the control departments. Post-intervention data was collected for a 7-month period. RESULTS A significant increase of the overall acceptance rate was observed between the pre- and post-intervention period (2.2% versus 52.4%; p<0.001) for the intervention departments and between the intervention and control departments (2.5% versus 52.4%; p<0.001) in the post-intervention period. There were no significant differences in acceptance rates between the pre- and post-intervention period in the control departments and also not between the control and intervention departments in the pre-intervention period. CONCLUSIONS The improvement was probably related to several optimization strategies including the customization of the severity classification, the creation of individual screening intervals, the inclusion of context factors for risk assessment, the new alert design and the creation of a follow-up system. The marked increase in alert acceptance looks promising and should be further evaluated after hospital wide implementation. System aspects that require further optimization were identified and will be developed. Further research is warranted to develop context-aware algorithms for complex class-class interactions.

[1]  Charles E. Leonard,et al.  Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. , 2010, Archives of internal medicine.

[2]  Jonathan P. Weiner,et al.  Comment: "e-Iatrogenesis": The Most Critical Unintended Consequence of CPOE and other HIT , 2007, J. Am. Medical Informatics Assoc..

[3]  E. Berner,et al.  Clinical Decision Support Systems: Theory and Practice , 1998 .

[4]  Shobha Phansalkar,et al.  Design of decision support interventions for medication prescribing , 2013, Int. J. Medical Informatics.

[5]  R. Van de Velde,et al.  Framework for a clinical information system , 2000, Int. J. Medical Informatics.

[6]  E Coiera,et al.  Section 1: Health and Clinical Mangement: The Safety and Quality of Decision Support Systems , 2006, Yearbook of Medical Informatics.

[7]  Pieter Cornu,et al.  Performance of a clinical decision support system and of clinical pharmacists in preventing drug–drug interactions on a geriatric ward , 2014, International Journal of Clinical Pharmacy.

[9]  Andrew J. Sauer,et al.  Clinical and Genetic Determinants of Torsade de Pointes Risk , 2012, Circulation.

[10]  Jerome H. Carter,et al.  Design and Implementation Issues , 2007 .

[11]  H De Clercq,et al.  An integrated drug prescription and distribution system: challenges and opportunities. , 2002, Studies in health technology and informatics.

[12]  Pedro J. Caraballo,et al.  Impact of clinical decision support preventing the use of QT-prolonging medications for patients at risk for torsade de pointes , 2015, J. Am. Medical Informatics Assoc..

[13]  Linas Simonaitis,et al.  Regenstrief Institute's Medical Gopher: A next-generation homegrown electronic medical record system , 2014, Int. J. Medical Informatics.

[14]  Diane L. Seger,et al.  Are We Heeding the Warning Signs? Examining Providers’ Overrides of Computerized Drug-Drug Interaction Alerts in Primary Care , 2013, PloS one.

[15]  Dean F. Sittig,et al.  How to Design Computerized Alerts to Ensure Safe Prescribing Practices , 2004 .

[16]  J Brender,et al.  STARE-HI – Statement on Reporting of Evaluation Studies in Health Informatics , 2013, Applied Clinical Informatics.

[17]  David J. Greenblatt,et al.  Drug-Drug Interactions: Clinical Perspective , 2001 .

[18]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[19]  Pieter Cornu,et al.  Discrepancies in Medication Information for the Primary Care Physician and the Geriatric Patient at Discharge , 2012, The Annals of pharmacotherapy.

[20]  Thomas H. Payne,et al.  Characteristics and override rates of order checks in a practitioner order entry system , 2002, AMIA.

[21]  Davide Bolchini,et al.  A successful model and visual design for creating context-aware drug-drug interaction alerts. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[22]  A. Camm,et al.  Drug induced QT prolongation and torsades de pointes , 2003, Heart.

[23]  A. Dupont,et al.  Effect of Medication Reconciliation at Hospital Admission on Medication Discrepancies During Hospitalization and at Discharge for Geriatric Patients , 2012, The Annals of pharmacotherapy.

[24]  R Van De Velde,et al.  Framework for a clinical information system. , 2002, Studies in health technology and informatics.

[25]  D. Coplen.  Types of Unintended Consequences Related to Computerized Provider Order Entry , 2007 .

[26]  P. Cornu,et al.  Physician’s expectations regarding prescribing clinical decision support systems in a Belgian hospital , 2014, Acta clinica Belgica.

[27]  Jon D. Duke,et al.  Adherence to drug-drug interaction alerts in high-risk patients: a trial of context-enhanced alerting , 2013, J. Am. Medical Informatics Assoc..

[28]  Bernardo Santos-Ramos,et al.  Prevalence of drug interactions in hospital healthcare , 2012, International Journal of Clinical Pharmacy.

[29]  Ervina Resetar,et al.  Customizing a Commercial Rule Base for Detecting Drug-Drug Interactions , 2005, AMIA.

[30]  T H Payne,et al.  Drug interaction alert override rates in the Meaningful Use era , 2014, Applied Clinical Informatics.

[31]  Diane L. Seger,et al.  Viewpoint Paper: Tiering Drug-Drug Interaction Alerts by Severity Increases Compliance Rates , 2009, J. Am. Medical Informatics Assoc..

[32]  Nicolette de Keizer,et al.  STARE-HI -Statement on Reporting of Evaluation Studies in Health Informatics , 2009, Yearbook of Medical Informatics.

[33]  Marc Berg,et al.  Unintended consequences of reducing QT-alert overload in a computerized physician order entry system , 2009, European Journal of Clinical Pharmacology.

[34]  Dean F Sittig,et al.  Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. , 2009, Journal of healthcare information management : JHIM.

[35]  David W. Bates,et al.  Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems - I-MeDeSA , 2011, J. Am. Medical Informatics Assoc..

[36]  Heleen van der Sijs,et al.  Clinically relevant QTc prolongation due to overridden drug-drug interaction alerts: a retrospective cohort study. , 2009, British journal of clinical pharmacology.

[37]  Marc Berg,et al.  System-related Errors Nature of Patient Care Information Information Technology in Health Care: The Some Unintended Consequences of , 2010 .

[38]  Jae-Ho Lee,et al.  Impact of a clinical decision support system for high-alert medications on the prevention of prescription errors , 2014, Int. J. Medical Informatics.

[39]  Thomas H. Payne,et al.  Review Paper: Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review , 2007, J. Am. Medical Informatics Assoc..

[40]  Jiunn H. Lin,et al.  CYP Induction-Mediated Drug Interactions: in Vitro Assessment and Clinical Implications , 2006, Pharmaceutical Research.

[41]  Sandra L Kane-Gill,et al.  A critical evaluation of clinical decision support for the detection of drug–drug interactions , 2011, Expert opinion on drug safety.

[42]  Francis Y. Lau,et al.  Measuring value for money: a scoping review on economic evaluation of health information systems , 2013, J. Am. Medical Informatics Assoc..

[43]  David W. Bates,et al.  High-priority drug-drug interactions for use in electronic health records , 2012, J. Am. Medical Informatics Assoc..

[44]  L. Moja,et al.  Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. , 2014, American journal of public health.

[45]  Joseph Finkelstein,et al.  The use and interpretation of quasi-experimental studies in medical informatics. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[46]  David W. Bates,et al.  Criteria for assessing high-priority drug-drug interactions for clinical decision support in electronic health records , 2013, BMC Medical Informatics and Decision Making.

[47]  Walter E. Haefeli,et al.  What, if all alerts were specific - Estimating the potential impact on drug interaction alert burden , 2014, Int. J. Medical Informatics.

[48]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[49]  Jonathan M. Teich,et al.  Drug-drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records , 2012, J. Am. Medical Informatics Assoc..

[50]  M. Rowland.  INTRODUCING PHARMACOKINETIC AND PHARMACODYNAMIC CONCEPTS* , 2001, Journal of liposome research.

[51]  Dean F. Sittig,et al.  Clinician's assessments of outpatient electronic medical record alert and reminder usability and usefulness requirements , 2002, AMIA.

[52]  Edward H. Shortliffe,et al.  Evaluation Methods in Biomedical Informatics , 2000 .

[53]  D. Bates,et al.  Critical Drug-Drug Interactions for Use in Electronic Health Records Systems With Computerized Physician Order Entry: Review of Leading Approaches , 2011, Journal of patient safety.

[54]  Marc Berg,et al.  Understanding handling of drug safety alerts: a simulation study , 2010, Int. J. Medical Informatics.

[55]  Shobha Phansalkar,et al.  Clinical decision support for drug-drug interactions: improvement needed. , 2013, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[56]  Diane L. Seger,et al.  A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems , 2010, J. Am. Medical Informatics Assoc..

[57]  Marc Berg,et al.  Overriding of drug safety alerts in computerized physician order entry. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[58]  Diane L. Seger,et al.  Application of Information Technology: Improving Acceptance of Computerized Prescribing Alerts in Ambulatory Care , 2006, J. Am. Medical Informatics Assoc..

[59]  L. Hayden,et al.  Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2011 .