A Concept-Based Integer Linear Programming Approach for Single-Document Summarization

Automatic single-document summarization is a process that receives a single input document and outputs a condensed version with only the most relevant information. This paper proposes an unsupervised concept-based approach for singledocument summarization using Integer Linear Programming (ILP). Such an approach maximizes the coverage of the important concepts in the summary, avoiding redundancy, and taking into consideration some readability aspects of the generated summary as well. A new weighting method that combines both coverage and position of the sentences is proposed to estimate the importance of a concept. Moreover, a weighted distribution strategy that prioritizes sentences at the beginning of the document if they have relevant concepts is investigated. The readability of the generated summaries is improved by the inclusion of constraints into the ILP model to avoid dangling coreferences and breaks in the normal discourse flow of the document. Experimental results on the DUC 2001-2002 and the CNN corpora demonstrated that the proposed approach is competitive with state-of-the-art summarizers evaluated regarding the traditional ROUGE scores.

[1]  Rada Mihalcea,et al.  TextRank: Bringing Order into Text , 2004, EMNLP.

[2]  Ryan T. McDonald A Study of Global Inference Algorithms in Multi-document Summarization , 2007, ECIR.

[3]  Dilek Z. Hakkani-Tür,et al.  The ICSI/UTD Summarization System at TAC 2009 , 2009, TAC.

[4]  Daraksha Parveen,et al.  Topical Coherence for Graph-based Extractive Summarization , 2015, EMNLP.

[5]  Rafael Dueire Lins,et al.  Automatic Text Document Summarization Based on Machine Learning , 2015, DocEng.

[6]  Daraksha Parveen,et al.  Integrating Importance, Non-Redundancy and Coherence in Graph-Based Extractive Summarization , 2015, IJCAI.

[7]  Ani Nenkova,et al.  Easily Identifiable Discourse Relations , 2008, COLING.

[8]  Oren Etzioni,et al.  Towards Coherent Multi-Document Summarization , 2013, NAACL.

[9]  Benoît Favre,et al.  Concept-based Summarization using Integer Linear Programming: From Concept Pruning to Multiple Optimal Solutions , 2015, EMNLP.

[10]  George D. C. Cavalcanti,et al.  Assessing sentence scoring techniques for extractive text summarization , 2013, Expert Syst. Appl..

[11]  Rafael Dueire Lins,et al.  A Quantitative and Qualitative Assessment of Automatic Text Summarization Systems , 2015, DocEng.

[12]  Ani Nenkova,et al.  A Survey of Text Summarization Techniques , 2012, Mining Text Data.

[13]  Ming Zhou,et al.  Ranking with Recursive Neural Networks and Its Application to Multi-Document Summarization , 2015, AAAI.

[14]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[15]  Lin Zhao,et al.  Using External Resources and Joint Learning for Bigram Weighting in ILP-Based Multi-Document Summarization , 2015, NAACL.

[16]  Rafael Dueire Lins,et al.  A Context Based Text Summarization System , 2014, 2014 11th IAPR International Workshop on Document Analysis Systems.