Automated Contradiction Detection in Biomedical Literature

Medical literature suffers from inconsistencies between reported findings that answer the same research question. This paper introduces an automated two-phase contradiction detection model that integrates semantic properties as input features to a Learning-to-Rank framework, to accurately identify key findings of a research article. It also relies on negation, antonyms and similarity measures to detect contradictions between findings. The proposed technique is implemented and tested on a publicly available contradiction corpus 259 manually annotated abstracts. The performance is compared based on recall, precision and F-measure. Experimental evaluations prove the utility of the model and its contribution to the contradiction classification and extraction task.

[1]  Farzaneh Sarafraz,et al.  Finding conflicting statements in the biomedical literature , 2012 .

[2]  Abdulaziz Alamri,et al.  The Detection of Contradictory Claims in Biomedical Abstracts , 2016 .

[3]  Mark Stevenson,et al.  Automatic Detection of Answers to Research Questions from Medline Abstracts , 2015, BioNLP@IJCNLP.

[4]  John A. Stankovic,et al.  Preclude: Conflict detection in textual health advice , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[5]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR Forum.

[6]  Tie-Yan Liu Learning to Rank for Information Retrieval , 2009, Found. Trends Inf. Retr..

[7]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[8]  Eric Yeh,et al.  Deciding Entailment and Contradiction with Stochastic and Edit Distance-based Alignment , 2008, TAC.

[9]  Luciano Del Corro,et al.  ClausIE: clause-based open information extraction , 2013, WWW.

[10]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.

[11]  Doug Downey,et al.  It’s a Contradiction – no, it’s not: A Case Study using Functional Relations , 2008, EMNLP.

[12]  Patrick Pantel,et al.  VerbOcean: Mining the Web for Fine-Grained Semantic Verb Relations , 2004, EMNLP.

[13]  Luyang Li,et al.  Contradiction Detection with Contradiction-Specific Word Embedding , 2017, Algorithms.

[14]  Tapas Kanungo,et al.  Machine Learned Sentence Selection Strategies for Query-Biased Summarization , 2008 .

[15]  Mark Stevenson,et al.  A corpus of potentially contradictory research claims from cardiovascular research abstracts , 2016, Journal of Biomedical Semantics.

[16]  Dan L. Longo,et al.  Precision Medicine—Personalized, Problematic, and Promising , 2015 .

[17]  W. Bruce Croft,et al.  Harnessing Semantics for Answer Sentence Retrieval , 2015, ESAIR@CIKM.

[18]  Sanda M. Harabagiu,et al.  Negation, Contrast and Contradiction in Text Processing , 2006, AAAI.

[19]  Christopher J. C. Burges,et al.  From RankNet to LambdaRank to LambdaMART: An Overview , 2010 .

[20]  John P A Ioannidis,et al.  Reversals of established medical practices: evidence to abandon ship. , 2012, JAMA.

[21]  Jason Rho,et al.  A decade of reversal: an analysis of 146 contradicted medical practices. , 2013, Mayo Clinic proceedings.

[22]  Christopher D. Manning,et al.  Finding Contradictions in Text , 2008, ACL.

[23]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[24]  Dejing Dou,et al.  Discovering Inconsistencies in PubMed Abstracts through Ontology-Based Information Extraction , 2017, BCB.

[25]  S. Greenfield,et al.  Comparative Effectiveness Research: A Report From the Institute of Medicine , 2009, Annals of Internal Medicine.

[26]  Mark Stevenson,et al.  Automatic identification of potentially contradictory claims to support systematic reviews , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[27]  Wendy W. Chapman,et al.  A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge Summaries , 2001, J. Biomed. Informatics.

[28]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[29]  W. Bruce Croft,et al.  Beyond Factoid QA: Effective Methods for Non-factoid Answer Sentence Retrieval , 2016, ECIR.