Using Variant Directional Dis(similarity) Measures for the Task of Textual Entailment

Textual entailment (TE) is a task used to determine degree of semantic inference between a pair of text fragments in many natural language processing applications. In literature, a single document summarization framework has exploited TE to establish degree of connectedness between pair of sentences in a text summarization method. Despite noteworthy performance of the method, the extensive resource requirements and slow speed of the TE tool render it impractical to generate summaries in real time scenarios. This has stimulated the authors to propose the use of available directional dis(similarity) (distance and similarity) measures in place of TE system. The present paper aims to find a suitable directional measure which can successfully replace the TE system and decrease the overall runtime of the summarization method. Therefore, state-of-the-art directional dis(similarity) measures are implemented in the same summarization framework to present a comparative analysis of performance of all the measures. The experiments are conducted on DUC 2002 dataset and the results are evaluated using ROUGE tool to find the most suitable directional measure of textual entailment.

[1]  Eduard H. Hovy,et al.  Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics , 2003, NAACL.

[2]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[3]  Manpreet Kaur,et al.  Text Summarization through Entailment-based Minimum Vertex Cover , 2014, *SEMEVAL.

[4]  Alexander Yates,et al.  Types of Common-Sense Knowledge Needed for Recognizing Textual Entailment , 2011, ACL.

[5]  M. de Rijke,et al.  Light-Weight Entailment Checking for Computational Semantics , 2001 .

[6]  Rada Mihalcea,et al.  Measuring the Semantic Similarity of Texts , 2005, EMSEE@ACL.

[7]  Xiaohua Hu,et al.  The Evaluation of Sentence Similarity Measures , 2008, DaWaK.

[8]  Johan Bos,et al.  Recognising Textual Entailment with Logical Inference , 2005, HLT.

[9]  Ion Androutsopoulos,et al.  Learning Textual Entailment using SVMs and String Similarity Measures , 2007, ACL-PASCAL@ACL.

[10]  Marti A. Hearst,et al.  HLT-NAACL 2003 : Human Language Technology conference of the North American Chapter of the Association for Computational Linguistics : proceedings of the main conference : May 27 to June 1, 2003, Edmonton, Alberta, Canada , 2003 .

[11]  Rada Mihalcea,et al.  Textual Entailment as a Directional Relation , 2009, J. Res. Pract. Inf. Technol..

[12]  Peter Clark,et al.  The Seventh PASCAL Recognizing Textual Entailment Challenge , 2011, TAC.

[13]  Danushka Bollegala,et al.  Similarity Is Not Entailment - Jointly Learning Similarity Transformation for Textual Entailment , 2021, AAAI.