Sensitivity and specificity of dosing alerts for dosing errors among hospitalized pediatric patients.

OBJECTIVES To determine the sensitivity and specificity of a dosing alert system for dosing errors and to compare the sensitivity of a proprietary system with and without institutional customization at a pediatric hospital. METHODS A retrospective analysis of medication orders, orders causing dosing alerts, reported adverse drug events, and dosing errors during July, 2011 was conducted. Dosing errors with and without alerts were identified and the sensitivity of the system with and without customization was compared. RESULTS There were 47,181 inpatient pediatric orders during the studied period; 257 dosing errors were identified (0.54%). The sensitivity of the system for identifying dosing errors was 54.1% (95% CI 47.8% to 60.3%) if customization had not occurred and increased to 60.3% (CI 54.0% to 66.3%) with customization (p=0.02). The sensitivity of the system for underdoses was 49.6% without customization and 60.3% with customization (p=0.01). Specificity of the customized system for dosing errors was 96.2% (CI 96.0% to 96.3%) with a positive predictive value of 8.0% (CI 6.8% to 9.3). All dosing errors had an alert over-ridden by the prescriber and 40.6% of dosing errors with alerts were administered to the patient. The lack of indication-specific dose ranges was the most common reason why an alert did not occur for a dosing error. DISCUSSION Advances in dosing alert systems should aim to improve the sensitivity and positive predictive value of the system for dosing errors. CONCLUSIONS The dosing alert system had a low sensitivity and positive predictive value for dosing errors, but might have prevented dosing errors from reaching patients. Customization increased the sensitivity of the system for dosing errors.

[1]  G. Kadmon,et al.  Computerized Order Entry With Limited Decision Support to Prevent Prescription Errors in a PICU , 2009, Pediatrics.

[2]  Rainu Kaushal,et al.  To What Extent Do Pediatricians Accept Computer-Based Dosing Suggestions? , 2007, Pediatrics.

[3]  Randolph A. Miller,et al.  Focus on health information technology, electronic health records and their financial impact: A framework for evaluating the appropriateness of clinical decision support alerts and responses , 2012, J. Am. Medical Informatics Assoc..

[4]  William L. Galanter,et al.  Application of Information Technology: A Trial of Automated Decision Support Alerts for Contraindicated Medications Using Computerized Physician Order Entry , 2005, J. Am. Medical Informatics Assoc..

[5]  L. Cordero,et al.  Impact of Computerized Physician Order Entry on Clinical Practice in a Newborn Intensive Care Unit , 2004, Journal of Perinatology.

[6]  J. Hayes,et al.  Frequency and Preventability of Adverse Drug Reactions in Paediatric Patients , 2004, Drug safety.

[7]  H. Bauchner,et al.  Effect of Computer Order Entry on Prevention of Serious Medication Errors in Hospitalized Children , 2008, Pediatrics.

[8]  N. Laird,et al.  Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention , 1995 .

[9]  Alex C Varkey,et al.  Impact of a pharmacotherapy alerting system on medication errors. , 2013, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[10]  Judith R. Logan,et al.  Evaluating the accuracy of electronic pediatric drug dosing rules. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[11]  Asif Ahmad,et al.  Using a computerized provider order entry system to meet the unique prescribing needs of children: description of an advanced dosing model , 2011, BMC Medical Informatics Decis. Mak..

[12]  C. DesRoches,et al.  Electronic health record adoption by children's hospitals in the United States. , 2010, Archives of pediatrics & adolescent medicine.

[13]  D. Bates,et al.  Medication errors and adverse drug events in pediatric inpatients. , 2001, JAMA.

[14]  J. Perlman,et al.  Fatal hyperphosphatemia after oral phosphate overdose in a premature infant. , 1997, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[15]  Jeremy S. Stultz,et al.  Computerized clinical decision support for medication prescribing and utilization in pediatrics , 2012, J. Am. Medical Informatics Assoc..

[16]  A. Potts,et al.  Computerized physician order entry and medication errors in a pediatric critical care unit. , 2004, Pediatrics.

[17]  P. Schneider,et al.  ASHP national survey of pharmacy practice in hospital settings: prescribing and transcribing--2010. , 2011, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[18]  J. Benes,et al.  The impact of hospitalwide computerized physician order entry on medical errors in a pediatric hospital. , 2005, Journal of pediatric surgery.

[19]  C. Taketomo,et al.  Pediatric Dosage Handbook , 1997 .

[20]  Nick Barber,et al.  Systematic Review of Medication Errors in Pediatric Patients , 2006, The Annals of pharmacotherapy.

[21]  Bruce W Chaffee,et al.  The need for collaborative engagement in creating clinical decision-support alerts. , 2013, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[22]  Jeremy S. Stultz,et al.  Appropriateness of commercially available and partially customized medication dosing alerts among pediatric patients. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[23]  I. Wong,et al.  Characteristics of clinical decision support alert overrides in an electronic prescribing system at a tertiary care paediatric hospital , 2011, The International journal of pharmacy practice.

[24]  Alireza Kazemi,et al.  The Effect of Computerized Physician Order Entry and Decision Support System on Medication Errors in the Neonatal Ward: Experiences from an Iranian Teaching Hospital , 2011, Journal of Medical Systems.