Detection of overdose and underdose prescriptions—An unsupervised machine learning approach

Overdose prescription errors sometimes cause serious life-threatening adverse drug events, while underdose errors lead to diminished therapeutic effects. Therefore, it is important to detect and prevent these errors. In the present study, we used the one-class support vector machine (OCSVM), one of the most common unsupervised machine learning algorithms for anomaly detection, to identify overdose and underdose prescriptions. We extracted prescription data from electronic health records in Kyushu University Hospital between January 1, 2014 and December 31, 2019. We constructed an OCSVM model for each of the 21 candidate drugs using three features: age, weight, and dose. Clinical overdose and underdose prescriptions, which were identified and rectified by pharmacists before administration, were collected. Synthetic overdose and underdose prescriptions were created using the maximum and minimum doses, defined by drug labels or the UpToDate database. We applied these prescription data to the OCSVM model and evaluated its detection performance. We also performed comparative analysis with other unsupervised outlier detection algorithms (local outlier factor, isolation forest, and robust covariance). Twenty-seven out of 31 clinical overdose and underdose prescriptions (87.1%) were detected as abnormal by the model. The constructed OCSVM models showed high performance for detecting synthetic overdose prescriptions (precision 0.986, recall 0.964, and F-measure 0.973) and synthetic underdose prescriptions (precision 0.980, recall 0.794, and F-measure 0.839). In comparative analysis, OCSVM showed the best performance. Our models detected the majority of clinical overdose and underdose prescriptions and demonstrated high performance in synthetic data analysis. OCSVM models, constructed using features such as age, weight, and dose, are useful for detecting overdose and underdose prescriptions.

[1]  Olivier Martin,et al.  A machine learning–based clinical decision support system to identify prescriptions with a high risk of medication error , 2020, J. Am. Medical Informatics Assoc..

[2]  Sara R. G. Myers,et al.  Using a Machine Learning System to Identify and Prevent Medication Prescribing Errors: A Clinical and Cost Analysis Evaluation. , 2019, Joint Commission journal on quality and patient safety.

[3]  A. Carroll Averting Alert Fatigue to Prevent Adverse Drug Reactions. , 2019, JAMA.

[4]  Eyal Zimlichman,et al.  Reducing drug prescription errors and adverse drug events by application of a probabilistic, machine-learning based clinical decision support system in an inpatient setting , 2019, J. Am. Medical Informatics Assoc..

[5]  Renata Vieira,et al.  DDC-Outlier: Preventing Medication Errors Using Unsupervised Learning , 2019, IEEE Journal of Biomedical and Health Informatics.

[6]  Aziz Sheikh,et al.  What is the epidemiology of medication errors, error-related adverse events and risk factors for errors in adults managed in community care contexts? A systematic review of the international literature , 2018, BMJ Open.

[7]  Qoua L. Her,et al.  Medication-related clinical decision support alert overrides in inpatients , 2018, J. Am. Medical Informatics Assoc..

[8]  N Page,et al.  A systematic review of the effectiveness of interruptive medication prescribing alerts in hospital CPOE systems to change prescriber behavior and improve patient safety , 2017, Int. J. Medical Informatics.

[9]  A. Sheikh,et al.  The third global patient safety challenge: tackling medication-related harm. , 2017, Bulletin of the World Health Organization.

[10]  David W. Bates,et al.  Screening for medication errors using an outlier detection system , 2017, J. Am. Medical Informatics Assoc..

[11]  Seiichi Uchida,et al.  A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data , 2016, PloS one.

[12]  Jae-Ho Lee,et al.  Impact of a clinical decision support system for high-alert medications on the prevention of prescription errors , 2014, Int. J. Medical Informatics.

[13]  Allen J. Flynn,et al.  Clinical decision support for atypical orders: detection and warning of atypical medication orders submitted to a computerized provider order entry system , 2014, J. Am. Medical Informatics Assoc..

[14]  S A Spooner,et al.  Analysis Of Electronic Medication Orders With Large Overdoses , 2014, Applied Clinical Informatics.

[15]  Jonathan M. Teich,et al.  Drug-drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records , 2012, J. Am. Medical Informatics Assoc..

[16]  Fei Tony Liu,et al.  Isolation-Based Anomaly Detection , 2012, TKDD.

[17]  D. Bates,et al.  Clinical decision support systems could be modified to reduce 'alert fatigue' while still minimizing the risk of litigation. , 2011, Health affairs.

[18]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[19]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[20]  Marc Berg,et al.  Overriding of drug safety alerts in computerized physician order entry. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[21]  C. Marano,et al.  To err is human. Building a safer health system , 2005, Italian Journal of Public Health.

[22]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005 .

[23]  P. Kanjanarat,et al.  Nature of preventable adverse drug events in hospitals: a literature review. , 2003, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[24]  G J Kuperman,et al.  Patient safety and computerized medication ordering at Brigham and Women's Hospital. , 2001, The Joint Commission journal on quality improvement.

[25]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[26]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[27]  Katrien van Driessen,et al.  A Fast Algorithm for the Minimum Covariance Determinant Estimator , 1999, Technometrics.

[28]  Jonathan M. Teich,et al.  The impact of computerized physician order entry on medication error prevention. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[29]  D. Bates,et al.  Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. , 1998, JAMA.

[30]  Jared J Cash Alert fatigue. , 2009, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[31]  D. Bates,et al.  Review Paper: Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review , 2007, J. Am. Medical Informatics Assoc..

[32]  Joshua D. Warner,et al.  Distributed under Creative Commons Cc-by 4.0 Scikit-image: Image Processing in Python , 2022 .