Adverse drug event presentation and tracking (ADEPT): semiautomated, high throughput pharmacovigilance using real-world data

Abstract Objective To advance use of real-world data (RWD) for pharmacovigilance, we sought to integrate a high-sensitivity natural language processing (NLP) pipeline for detecting potential adverse drug events (ADEs) with easily interpretable output for high-efficiency human review and adjudication of true ADEs. Materials and methods The adverse drug event presentation and tracking (ADEPT) system employs an open source NLP pipeline to identify in clinical notes mentions of medications and signs and symptoms potentially indicative of ADEs. ADEPT presents the output to human reviewers by highlighting these drug-event pairs within the context of the clinical note. To measure incidence of seizures associated with sildenafil, we applied ADEPT to 149 029 notes for 982 patients with pediatric pulmonary hypertension. Results Of 416 patients identified as taking sildenafil, NLP found 72 [17%, 95% confidence interval (CI) 14–21] with seizures as a potential ADE. Upon human review and adjudication, only 4 (0.96%, 95% CI 0.37–2.4) patients with seizures were determined to have true ADEs. Reviewers using ADEPT required a median of 89 s (interquartile range 57–142 s) per patient to review potential ADEs. Discussion ADEPT combines high throughput NLP to increase sensitivity of ADE detection and human review, to increase specificity by differentiating true ADEs from signs and symptoms related to comorbidities, effects of other medications, or other confounders. Conclusion ADEPT is a promising tool for creating gold standard, patient-level labels for advancing NLP-based pharmacovigilance. ADEPT is a potentially time savings platform for computer-assisted pharmacovigilance based on RWD.

[1]  D. Greenblatt,et al.  A method for estimating the probability of adverse drug reactions , 1981, Clinical pharmacology and therapeutics.

[2]  Angus Roberts,et al.  Building a semantically annotated corpus of clinical texts , 2009, J. Biomed. Informatics.

[3]  Sunghwan Sohn,et al.  Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications , 2010, J. Am. Medical Informatics Assoc..

[4]  D. Ivy,et al.  Initial Experience With Tadalafil in Pediatric Pulmonary Arterial Hypertension , 2011, Pediatric Cardiology.

[5]  R. Barst,et al.  Survival in Childhood Pulmonary Arterial Hypertension: Insights From the Registry to Evaluate Early and Long-Term Pulmonary Arterial Hypertension Disease Management , 2011, Circulation.

[6]  C. McNaughton,et al.  Misuse of the Naranjo Adverse Drug Reaction probability scale in toxicology , 2013, Clinical toxicology.

[7]  Carol Friedman,et al.  Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions , 2013, J. Am. Medical Informatics Assoc..

[8]  J. Schold,et al.  Prevalence of Copied Information by Attendings and Residents in Critical Care Progress Notes* , 2013, Critical care medicine.

[9]  Hua Xu,et al.  Research and applications: Assisted annotation of medical free text using RapTAT , 2014, J. Am. Medical Informatics Assoc..

[10]  Louise Deléger,et al.  Evaluating the impact of pre-annotation on annotation speed and potential bias: natural language processing gold standard development for clinical named entity recognition in clinical trial announcements , 2013, J. Am. Medical Informatics Assoc..

[11]  James J. Masanz,et al.  Negation’s Not Solved: Generalizability Versus Optimizability in Clinical Natural Language Processing , 2014, PloS one.

[12]  R. Barst,et al.  STARTS-2: Long-Term Survival With Oral Sildenafil Monotherapy in Treatment-Naive Pediatric Pulmonary Arterial Hypertension , 2014, Circulation.

[13]  J. Feinstein,et al.  Reported Sildenafil Side Effects in Pediatric Pulmonary Hypertension Patients , 2015, Front. Pediatr..

[14]  I. Edwards,et al.  Longitudinal medical records as a complement to routine drug safety signal analysis† , 2015, Pharmacoepidemiology and drug safety.

[15]  M. Schuemie,et al.  Useful Interplay Between Spontaneous ADR Reports and Electronic Healthcare Records in Signal Detection , 2015, Drug Safety.

[16]  R. Shader Some Reflections on IBM Watson and on Women's Health. , 2016, Clinical therapeutics.

[17]  Peter J. Pitts,et al.  21st century pharmacovigilance: efforts, roles, and responsibilities. , 2016, The Lancet. Oncology.

[18]  M. Ibara,et al.  Pharmacovigilance and Biomedical Informatics: A Model for Future Development. , 2016, Clinical therapeutics.

[19]  Chen Lin,et al.  Multilayered temporal modeling for the clinical domain , 2016, J. Am. Medical Informatics Assoc..

[20]  Jonathan P. Bickel,et al.  A Computable Phenotype Improves Cohort Ascertainment in a Pediatric Pulmonary Hypertension Registry , 2017, Jornal de Pediatria.

[21]  S. Khozin,et al.  Real-world Data for Clinical Evidence Generation in Oncology. , 2017, Journal of the National Cancer Institute.

[22]  Florence T. Bourgeois,et al.  The Pediatric Research Equity Act Moves Into Adolescence. , 2017, JAMA.

[23]  N. Rodondi,et al.  Development of a standardized chart review method to identify drug‐related hospital admissions in older people , 2018, British journal of clinical pharmacology.

[24]  Steven Bethard,et al.  UArizona at the MADE1.0 NLP Challenge , 2018, Medication and Adverse Drug Event Detection.

[25]  S. Sandhiya,et al.  Comparison of different methods for causality assessment of adverse drug reactions , 2018, International Journal of Clinical Pharmacy.

[26]  Marc Cuggia,et al.  Timeline representation of clinical data: usability and added value for pharmacovigilance , 2018, BMC Medical Informatics and Decision Making.

[27]  Patrick R. Alba,et al.  Detecting Adverse Drug Events with Rapidly Trained Classification Models , 2019, Drug Safety.

[28]  Hong Yu,et al.  Overview of the First Natural Language Processing Challenge for Extracting Medication, Indication, and Adverse Drug Events from Electronic Health Record Notes (MADE 1.0) , 2019, Drug Safety.

[29]  D. Margolis,et al.  Adverse drug reaction causality assessment tools for drug-induced Stevens-Johnson syndrome and toxic epidermal necrolysis: room for improvement , 2019, European Journal of Clinical Pharmacology.

[30]  L. Gupta,et al.  Clinical Profile and Comparison of Causality Assessment Tools in Cutaneous Adverse Drug Reactions , 2019, Indian dermatology online journal.

[31]  M. Devarakonda,et al.  Adverse Drug Events Detection in Clinical Notes by Jointly Modeling Entities and Relations Using Neural Networks , 2019, Drug Safety.

[32]  Kenneth D Mandl,et al.  Adverse drug event rates in pediatric pulmonary hypertension: a comparison of real-world data sources , 2019, J. Am. Medical Informatics Assoc..