Drug-Drug Interaction Extraction from Biomedical Text Using Long Short Term Memory Network

The simultaneous administration of multiple drugs increases the probability of interaction among them, as one drug may affect the activities of others. This interaction among drugs may have a positive or negative impact on the therapeutic outcomes. Thus, identification of unknown drug-drug interactions (DDIs) is of significant concern for improving the safety and efficacy of drug consumption. Although multiple DDI resources exist, it is becoming infeasible to maintain these up-to-date manually with the number of biomedical texts growing at a fast pace. Most existing methods model DDI extraction as a classification problem and rely mainly on handcrafted features, and certain features further depend on domain-specific tools. Recently, neural network models using latent features have been demonstrated to yield similar or superior performance compared to existing models. In this study, we present three long short-term memory (LSTM) network models, namely B-LSTM, AB-LSTM, and Joint AB-LSTM. All three models use word and position embedding as latent features; thus, they do not rely on explicit feature engineering. Furthermore, the use of a bidirectional LSTM (Bi-LSTM) network allows for extraction of implicit features from an entire sentence. The two models AB-LSTM and Joint AB-LSTM also apply attentive pooling in the Bi-LSTM layer output in order to assign weights to features. Our experimental results on the SemEval-2013 DDI extraction dataset indicate that the Joint AB-LSTM model produces reasonable performance (F-score: 69.39%) even with the simple architecture.

[1]  Jaewoo Kang,et al.  Drug drug interaction extraction from the literature using a recursive neural network , 2018, PloS one.

[2]  Luca Toldo,et al.  Extraction of potential adverse drug events from medical case reports , 2012, Journal of biomedical semantics.

[3]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[4]  Majid Rastegar-Mojarad,et al.  UWM-TRIADS: Classifying Drug-Drug Interactions with Two-Stage SVM and Post-Processing , 2013, SemEval@NAACL-HLT.

[5]  Rita Businaro,et al.  Why We Need an Efficient and Careful Pharmacovigilance , 2013 .

[6]  Xiaolong Wang,et al.  Drug-Drug Interaction Extraction via Convolutional Neural Networks , 2016, Comput. Math. Methods Medicine.

[7]  Sanda M. Harabagiu,et al.  Automatic extraction of relations between medical concepts in clinical texts , 2011, J. Am. Medical Informatics Assoc..

[8]  Paloma Martínez,et al.  SemEval-2013 Task 9 : Extraction of Drug-Drug Interactions from Biomedical Texts (DDIExtraction 2013) , 2013, *SEMEVAL.

[9]  Haibin Liu,et al.  Extracting drug-drug interactions from literature using a rich feature-based linear kernel approach , 2015, AMIA.

[10]  Stu Hutson Researchers sound alarm on 'silent' drug interactions , 2011, Nature Medicine.

[11]  Rong Xu,et al.  Large-scale automatic extraction of side effects associated with targeted anticancer drugs from full-text oncological articles , 2015, J. Biomed. Informatics.

[12]  Yijia Zhang,et al.  An attention-based effective neural model for drug-drug interactions extraction , 2017, BMC Bioinformatics.

[13]  Wei Zheng,et al.  Drug–drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths , 2017, Bioinform..

[14]  Guillaume Lample,et al.  Neural Architectures for Named Entity Recognition , 2016, NAACL.

[15]  Guodong Zhou,et al.  Dependency-directed Tree Kernel-based Protein-Protein Interaction Extraction from Biomedical Literature , 2011, IJCNLP.

[16]  Sunil Kumar Sahu,et al.  Relation extraction from clinical texts using domain invariant convolutional neural network , 2016, BioNLP@ACL.

[17]  Wei Wang,et al.  Dependency-based long short term memory network for drug-drug interaction extraction , 2017, BMC Bioinformatics.

[18]  Abdul Mateen Rajput,et al.  Automatic detection of adverse events to predict drug label changes using text and data mining techniques , 2013, Pharmacoepidemiology and drug safety.

[19]  Makoto Miwa,et al.  Extracting Drug-Drug Interactions with Attention CNNs , 2017, BioNLP.

[20]  Alberto Díaz,et al.  NIL_UCM: Extracting Drug-Drug interactions from text through combination of sequence and tree kernels , 2013, SemEval@NAACL-HLT.

[21]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[22]  Alberto Lavelli,et al.  Exploiting the Scope of Negations and Heterogeneous Features for Relation Extraction: A Case Study for Drug-Drug Interaction Extraction , 2013, HLT-NAACL.

[23]  Ming Yang,et al.  Filtering big data from social media - Building an early warning system for adverse drug reactions , 2015, J. Biomed. Informatics.

[24]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[25]  K. Bretonnel Cohen,et al.  UColorado_SOM: Extraction of Drug-Drug Interactions from Biomedical Text using Knowledge-rich and Knowledge-poor Features , 2013, SemEval@NAACL-HLT.

[26]  Andrew Y. Ng,et al.  Parsing Natural Scenes and Natural Language with Recursive Neural Networks , 2011, ICML.

[27]  Sunil Kumar Sahu,et al.  Evaluating distributed word representations for capturing semantics of biomedical concepts , 2015, BioNLP@IJCNLP.

[28]  Paloma Martínez,et al.  The DDI corpus: An annotated corpus with pharmacological substances and drug-drug interactions , 2013, J. Biomed. Informatics.

[29]  Tutut Herawan,et al.  Computational and mathematical methods in medicine. , 2006, Computational and mathematical methods in medicine.

[30]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[31]  Tung Tran,et al.  Extracting Drug-Drug Interactions with Word and Character-Level Recurrent Neural Networks , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[32]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[33]  Zhiyong Lu,et al.  Pressing needs of biomedical text mining in biocuration and beyond: opportunities and challenges , 2016, Database J. Biol. Databases Curation.

[34]  Isabel Segura-Bedmar,et al.  The 1st DDIExtraction-2011 challenge task: Extraction of Drug-Drug Interactions from biomedical texts , 2011 .

[35]  Mariana L. Neves,et al.  WBI-DDI: Drug-Drug Interaction Extraction using Majority Voting , 2013, *SEMEVAL.

[36]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[37]  Sophia Ananiadou,et al.  Text mining resources for the life sciences , 2016, Database J. Biol. Databases Curation.

[38]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[39]  ZhouGuodong,et al.  Tree kernel-based protein-protein interaction extraction from biomedical literature , 2012 .

[40]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[41]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[42]  Juliane Fluck,et al.  SCAI: Extracting drug-drug interactions using a rich feature vector , 2013, SemEval@NAACL-HLT.

[43]  Wei Shi,et al.  Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification , 2016, ACL.

[44]  Yen S. Low,et al.  Text Mining for Adverse Drug Events: the Promise, Challenges, and State of the Art , 2014, Drug Safety.

[45]  Razvan Pascanu,et al.  Understanding the exploding gradient problem , 2012, ArXiv.

[46]  Núria Queralt-Rosinach,et al.  Extraction of relations between genes and diseases from text and large-scale data analysis: implications for translational research , 2014, BMC Bioinformatics.

[47]  Alberto Lavelli,et al.  FBK-irst : A Multi-Phase Kernel Based Approach for Drug-Drug Interaction Detection and Classification that Exploits Linguistic Information , 2013, *SEMEVAL.

[48]  Jari Björne,et al.  UTurku: Drug Named Entity Recognition and Drug-Drug Interaction Extraction Using SVM Classification and Domain Knowledge , 2013, *SEMEVAL.

[49]  Hongfei Lin,et al.  Drug drug interaction extraction from biomedical literature using syntax convolutional neural network , 2016, Bioinform..