Using First-Order Logic to Compress Sentences

Sentence compression is one of the most challenging tasks in natural language processing, which may be of increasing interest to many applications such as abstractive summarization and text simplification for mobile devices. In this paper, we present a novel sentence compression model based on first-order logic, using Markov Logic Network. Sentence compression is formulated as a word/phrase deletion problem in this model. By taking advantage of first-order logic, the proposed method is able to incorporate local linguistic features and to capture global dependencies between word deletion operations. Experiments on both written and spoken corpora show that our approach produces competitive performance against the state-of-the-art methods in terms of manual evaluation measures such as importance, grammaticality, and overall quality.

[1]  Tadashi Nomoto A Comparison of Model Free versus Model Intensive Approaches to Sentence Compression , 2009, EMNLP.

[2]  Daniel Marcu,et al.  Summarization beyond sentence extraction: A probabilistic approach to sentence compression , 2002, Artif. Intell..

[3]  Mirella Lapata,et al.  Sentence Compression Beyond Word Deletion , 2008, COLING.

[4]  Stefan Riezler,et al.  Statistical Sentence Condensation using Ambiguity Packing and Stochastic Disambiguation Methods for Lexical-Functional Grammar , 2003, NAACL.

[5]  Michael Strube,et al.  Dependency Tree Based Sentence Compression , 2008, INLG.

[6]  Pedro M. Domingos,et al.  Discriminative Training of Markov Logic Networks , 2005, AAAI.

[7]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[8]  Ion Androutsopoulos,et al.  An extractive supervised two-stage method for sentence compression , 2010, NAACL.

[9]  Yu Hao,et al.  Function-Based Question Classification for General QA , 2010, EMNLP.

[10]  J. Clarke,et al.  Global inference for sentence compression : an integer linear programming approach , 2008, J. Artif. Intell. Res..

[11]  Yuji Matsumoto,et al.  Jointly Identifying Temporal Relations with Markov Logic , 2009, ACL.

[12]  Zhu Xiaoyan Sentence compression with a Markov logic network , 2011 .

[13]  Patrick Pantel,et al.  Discovery of inference rules for question-answering , 2001, Natural Language Engineering.

[14]  Iván V. Meza,et al.  Jointly Identifying Predicates, Arguments and Senses using Markov Logic , 2009, NAACL.

[15]  Mirella Lapata,et al.  Sentence Compression as Tree Transduction , 2009, J. Artif. Intell. Res..

[16]  Hongyan Jing,et al.  Sentence Reduction for Automatic Text Summarization , 2000, ANLP.