A Causality Driven Approach to Adverse Drug Reactions Detection in Tweets

Social media sites such as Twitter is a platform where users usually express their feelings, opinions, and experiences, e.g., users often share their experiences about medications including adverse drug reactions in their tweets. Mining and detecting this information on adverse drug reactions could be immensely beneficial for pharmaceutical companies, drug-safety authorities and medical practitioners. However, the automatic extraction of adverse drug reactions from tweets is a nontrivial task due to the short and informal nature of tweets. In this paper, we aim to detect adverse drug reaction mentions in tweets where we assume that there exists a cause-effect relationship between drug names and adverse drug reactions. We propose a causality driven neural network-based approach to detect adverse drug reactions in tweets. Our approach applies a multi-head self attention mechanism to learn word-to-word interactions. We show that when the causal features are combined with the word-level semantic features, our approach can outperform several state-of-the-art adverse drug reaction detection approaches.

[1]  S. Evans,et al.  Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports , 2001, Pharmacoepidemiology and drug safety.

[2]  Abeed Sarker,et al.  Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features , 2015, J. Am. Medical Informatics Assoc..

[3]  Anne Cocos,et al.  Deep learning for pharmacovigilance: recurrent neural network architectures for labeling adverse drug reactions in Twitter posts , 2017, J. Am. Medical Informatics Assoc..

[4]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[5]  Bing Li,et al.  Research on Adverse Drug Reaction Recognitions Based on Conditional Random Field , 2017, ICBIM 2017.

[6]  Christopher C. Yang,et al.  Social media mining for drug safety signal detection , 2012, SHB '12.

[7]  Danushka Bollegala,et al.  Causality Patterns for Detecting Adverse Drug Reactions From Social Media: Text Mining Approach , 2018, JMIR public health and surveillance.

[8]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[9]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[10]  Wesley De Neve,et al.  Multimedia Lab @ ACL WNUT NER Shared Task: Named Entity Recognition for Twitter Microposts using Distributed Word Representations , 2015, NUT@IJCNLP.

[11]  Lei Cao,et al.  MARAS: Signaling Multi-Drug Adverse Reactions , 2017, KDD.

[12]  Yanqing Ji,et al.  A Potential Causal Association Mining Algorithm for Screening Adverse Drug Reactions in Postmarketing Surveillance , 2011, IEEE Transactions on Information Technology in Biomedicine.

[13]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[14]  Philip S. Yu,et al.  Multi-Task Pharmacovigilance Mining from Social Media Posts , 2018, WWW.

[15]  Stefan M. Rüger,et al.  Adverse Drug Reaction Classification With Deep Neural Networks , 2016, COLING.