Joint Models for Extracting Adverse Drug Events from Biomedical Text

Extracting adverse drug events receives much research attention in the biomedical community. Previous work adopts pipeline models, firstly recognizing drug/disease entity mentions and then identifying adverse drug events from drug/disease pairs. In this paper, we investigate joint models for simultaneously extracting drugs, diseases and adverse drug events. Compared with pipeline models, joint models have two main advantages. First, they make use of information integration to facilitate performance improvement; second, they reduce error propagation in pipeline methods. We compare a discrete model and a deep neural model for extracting drugs, diseases and adverse drug events jointly. Experimental results on a standard ADE corpus show that the discrete joint model outperforms a state-of-the-art baseline pipeline significantly. In addition, when discrete features are replaced by neural features, the recall is further improved.

[1]  Luca Toldo,et al.  Extraction of Adverse Drug Effects from Medical Case Reports , 2012, J. Biomed. Semant..

[2]  Joakim Nivre,et al.  A Transition-Based System for Joint Part-of-Speech Tagging and Labeled Non-Projective Dependency Parsing , 2012, EMNLP.

[3]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[4]  Jian Su,et al.  Exploring Various Knowledge in Relation Extraction , 2005, ACL.

[5]  Erik M. van Mulligen,et al.  Knowledge-based extraction of adverse drug events from biomedical text , 2014, BMC Bioinformatics.

[6]  D. Roth 1 Global Inference for Entity and Relation Identification via a Linear Programming Formulation , 2007 .

[7]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[8]  Peter Kulchyski and , 2015 .

[9]  Shay B. Cohen,et al.  Proceedings of ACL , 2013 .

[10]  Qing Zeng-Treitler,et al.  Exploring Relations among Semantic Groups: A Comparison of Concept Co-occurrence in Biomedical Sources , 2010, MedInfo.

[11]  Rong Xu,et al.  Automatic construction of a large-scale and accurate drug-side-effect association knowledge base from biomedical literature , 2014, J. Biomed. Informatics.

[12]  Christopher D. Manning,et al.  Joint Parsing and Named Entity Recognition , 2009, NAACL.

[13]  Andreas Holzinger,et al.  On Knowledge Discovery in Open Medical Data on the Example of the FDA Drug Adverse Event Reporting System for Alendronate (Fosamax) , 2013, CHI-KDD.

[14]  Andreas Holzinger,et al.  Knowledge discovery of drug data on the example of adverse reaction prediction , 2014, BMC Bioinformatics.

[15]  Dan Klein,et al.  An Empirical Analysis of Optimization for Max-Margin NLP , 2015, EMNLP.

[16]  Heng Ji,et al.  Incremental Joint Extraction of Entity Mentions and Relations , 2014, ACL.

[17]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[18]  Joakim Nivre,et al.  Algorithms for Deterministic Incremental Dependency Parsing , 2008, CL.

[19]  Luca Toldo,et al.  Extraction of potential adverse drug events from medical case reports , 2012, Journal of biomedical semantics.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Dan Roth,et al.  Exploiting Syntactico-Semantic Structures for Relation Extraction , 2011, ACL.

[22]  Yue Zhang,et al.  Neural Networks for Open Domain Targeted Sentiment , 2015, EMNLP.

[23]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[24]  Nick Cercone,et al.  Computational Linguistics , 1986, Communications in Computer and Information Science.

[25]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[26]  BMC Bioinformatics , 2005 .

[27]  Wanxiang Che,et al.  Stacking Heterogeneous Joint Models of Chinese POS Tagging and Dependency Parsing , 2012, COLING.

[28]  Ophir Frieder,et al.  Extracting Adverse Drug Reactions from Social Media , 2015, AAAI.

[29]  Jun Hu,et al.  Determining molecular predictors of adverse drug reactions with causality analysis based on structure learning , 2014, J. Am. Medical Informatics Assoc..

[30]  Stephen Clark,et al.  Syntactic Processing Using the Generalized Perceptron and Beam Search , 2011, CL.

[31]  Yue Zhang,et al.  Joint Morphological Generation and Syntactic Linearization , 2014, AAAI.

[32]  Fei Li,et al.  A transition-based model for jointly extracting drugs, diseases and adverse drug events , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[33]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[34]  Stephen Clark,et al.  Joint Word Segmentation and POS Tagging Using a Single Perceptron , 2008, ACL.

[35]  ZhangYue,et al.  Syntactic processing using the generalized perceptron and beam search , 2011 .