An automated pipeline for analyzing medication event reports in clinical settings

BackgroundMedication events in clinical settings are significant threats to patient safety. Analyzing and learning from the medication event reports is an important way to prevent the recurrence of these events. Currently, the analysis of medication event reports is ineffective and requires heavy workloads for clinicians. An automated pipeline is proposed to help clinicians deal with the accumulated reports, extract valuable information and generate feedback from the reports. Thus, the strategy of medication event prevention can be further developed based on the lessons learned.MethodsIn order to build the automated pipeline, four classic machine learning classifiers (i.e., support vector machine, Naïve Bayes, random forest, and multi-layer perceptron) were compared to identify the event originating stages, event types, and event causes from the medication event reports. The precision, recall and F-1 measure were calculated to assess the performance of the classifiers. Further, a strategy to measure the similarity of medication event reports in our pipeline was established and evaluated by human subjects through a questionnaire.ResultsWe developed three classifiers to identify the medication event originating stages, event types and causes, respectively. For the event originating stages, a support vector machine classifier obtains the best performance with an F-1 measure of 0.792. For the event types, a support vector machine classifier exhibits the best performance with an F-1 measure of 0.758. And for the event causes, a random forest classifier reaches an F-1 measure of 0.925. The questionnaire results show that the similarity measurement is consistent with the domain experts in the task of identifying similar reports.ConclusionWe developed and evaluated an automated pipeline that could identify three attributes from the medication event reports and calculate the similarity scores between the reports based on the attributes. The pipeline is expected to improve the efficiency of analyzing the medication event reports and to learn from the reports in a timely manner.

[1]  Fan Yu,et al.  Towards large-scale twitter mining for drug-related adverse events , 2012, SHB '12.

[2]  Jimmy J. Lin,et al.  Pairwise Word Interaction Modeling with Deep Neural Networks for Semantic Similarity Measurement , 2016, NAACL.

[3]  Abeed Sarker,et al.  Portable automatic text classification for adverse drug reaction detection via multi-corpus training , 2015, J. Biomed. Informatics.

[4]  Chen Liang,et al.  Automated Classification of Multi-Labeled Patient Safety Reports: A Shift from Quantity to Quality Measure , 2017, MedInfo.

[5]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[6]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[7]  Steffen Staab,et al.  Taxonomy Learning - Factoring the Structure of a Taxonomy into a Semantic Classification Decision , 2002, COLING.

[8]  Anna-Lan Huang,et al.  Similarity Measures for Text Document Clustering , 2008 .

[9]  Chen Liang,et al.  Predicting Harm Scores from Patient Safety Event Reports , 2017, MedInfo.

[10]  D. Bates,et al.  Adverse drug events and medication errors: detection and classification methods , 2004, Quality and Safety in Health Care.

[11]  Sidahmed Benabderrahmane,et al.  IntelliGO: a new vector-based semantic similarity measure including annotation origin , 2010, BMC Bioinformatics.

[12]  Philip Resnik,et al.  Using Information Content to Evaluate Semantic Similarity in a Taxonomy , 1995, IJCAI.

[13]  Eric R. LaRose,et al.  Adverse Drug Event Discovery Using Biomedical Literature: A Big Data Neural Network Adventure , 2017, JMIR medical informatics.

[14]  E. Cook,et al.  Drug complications in outpatients , 2000, Journal of general internal medicine.

[15]  M. E. Durán García,et al.  Medication error prevalence. , 2010, International journal of health care quality assurance.

[16]  Frank Wang,et al.  Identifying and Synchronizing Health Information Technology (HIT) Events from FDA Medical Device Reports , 2017, MedInfo.

[17]  Abha Agrawal.  Medication errors: prevention using information technology systems. , 2009, British journal of clinical pharmacology.

[18]  Sylvie Ranwez,et al.  Semantic Similarity from Natural Language and Ontology Analysis , 2015, Synthesis Lectures on Human Language Technologies.

[19]  M R Cohen,et al.  Medication error reports. , 1975, Hospital pharmacy.

[20]  P. Schneider,et al.  Interrater agreement with a standard scheme for classifying medication errors. , 2007, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[21]  D. Bates,et al.  The Costs of Adverse Drug Events in Hospitalized Patients , 1997 .

[22]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[23]  Anita Burgun-Parenthoine,et al.  A transversal approach to predict gene product networks from ontology-based similarity , 2007, BMC Bioinformatics.

[24]  Bin Yao,et al.  Unveiling Originated Stages of Medication Errors: An Automated Pipeline Approach , 2018, Nursing Informatics.

[25]  Michael R. Cohen.  Medication errors. , 2014, Nursing.

[26]  Gary Geunbae Lee,et al.  Information gain and divergence-based feature selection for machine learning-based text categorization , 2006, Inf. Process. Manag..

[27]  Yang Gong,et al.  Design a Learning-Oriented Fall Event Reporting System Based on Kirkpatrick Model , 2017, MedInfo.

[28]  Phillip W. Lord,et al.  Semantic Similarity in Biomedical Ontologies , 2009, PLoS Comput. Biol..

[29]  Ming Yang,et al.  Filtering big data from social media - Building an early warning system for adverse drug reactions , 2015, J. Biomed. Informatics.

[30]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  D. Bates,et al.  Relationship between medication errors and adverse drug events , 1995, Journal of General Internal Medicine.

[32]  Ying Wang,et al.  Using multiclass classification to automate the identification of patient safety incident reports by type and severity , 2017, BMC Medical Informatics and Decision Making.

[33]  Martin Porter,et al.  Snowball: A language for stemming algorithms , 2001 .

[34]  Yang Gong,et al.  Developing a similarity searching module for patient safety event reporting system using semantic similarity measures , 2017, BMC Medical Informatics and Decision Making.

[35]  R. Hicks,et al.  Medication Errors: Experience of the United States Pharmacopeia (USP) MEDMARX Reporting System , 2003, Journal of clinical pharmacology.

[36]  P Ryan,et al.  Novel Data‐Mining Methodologies for Adverse Drug Event Discovery and Analysis , 2012, Clinical pharmacology and therapeutics.

[37]  Nigam H. Shah,et al.  Mining clinical text for signals of adverse drug-drug interactions , 2014, J. Am. Medical Informatics Assoc..

[38]  P. Maurette.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[39]  Carl Macrae,et al.  The problem with incident reporting , 2015, BMJ Quality & Safety.

[40]  C. Wittich,et al.  Medication errors: an overview for clinicians. , 2014, Mayo Clinic proceedings.

[41]  Hongfang Liu,et al.  Prioritizing Adverse Drug Reaction and Drug Repositioning Candidates Generated by Literature-Based Discovery , 2016, BCB.

[42]  W. Hendee.  To Err is Human: Building a Safer Health System , 2001 .