Addressing Discourse and Document Structure in the RTE Search Task

This paper describes Bar-Ilan University’s submissions to RTE-5. This year we focused on the Search pilot, enhancing our entailment system to address two main issues introduced by this new setting: scalability and, primarily, document-level discourse. Our system achieved the highest score on the Search task amongst participating groups, and proposes first steps towards addressing this challenging setting.

[1]  Sanda M. Harabagiu,et al.  Textual Entailment Through Extended Lexical Overlap and Lexico-Semantic Matching , 2007, ACL-PASCAL@ACL.

[2]  Kentaro Inui,et al.  Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing , 2007, ACL 2007.

[3]  Medea Lo Leggio,et al.  Considering Discourse References in Textual Entailment Annotation , 2009 .

[4]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[5]  Jimmy J. Lin,et al.  Quantitative evaluation of passage retrieval algorithms for question answering , 2003, SIGIR.

[6]  Andrew Hickl,et al.  Unsupervised Resource Creation for Textual Inference Applications , 2008, LREC.

[7]  Daniel Jurafsky,et al.  Semantic Taxonomy Induction from Heterogenous Evidence , 2006, ACL.

[8]  Ido Dagan,et al.  Considering Discourse References in Textual Entailment Annotation | NIST , 2009 .

[9]  Ido Dagan,et al.  Evaluating the Inferential Utility of Lexical-Semantic Resources , 2009, EACL.

[10]  Christopher D. Manning,et al.  Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling , 2005, ACL.

[11]  Dekang Lin,et al.  Automatic Retrieval and Clustering of Similar Words , 1998, ACL.

[12]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[13]  Ido Dagan,et al.  Extracting Lexical Reference Rules from Wikipedia , 2009, ACL.

[14]  Vasile Rus,et al.  Logic Form Transformation of WordNet and its Applicability to Question Answering , 2001, ACL.

[15]  Ido Dagan,et al.  Semantic Inference at the Lexical-Syntactic Level , 2007, AAAI.

[16]  Ido Dagan,et al.  A Compact Forest for Scalable Inference over Entailment and Paraphrase Rules , 2009, EMNLP.

[17]  Ido Dagan,et al.  Efficient Semantic Deduction and Approximate Matching over Compact Parse Forests , 2008, TAC.

[18]  Patrick Pantel,et al.  Discovery of inference rules for question-answering , 2001, Natural Language Engineering.

[19]  Dan Roth,et al.  Semantic and Logical Inference Model for Textual Entailment , 2007, ACL-PASCAL@ACL.