Towards a Framework for Abstractive Summarization of Multimodal Documents

We propose a framework for generating an abstractive summary from a semantic model of a multimodal document. We discuss the type of model required, the means by which it can be constructed, how the content of the model is rated and selected, and the method of realizing novel sentences for the summary. To this end, we introduce a metric called information density used for gauging the importance of content obtained from text and graphical sources.

[1]  Francine Chen,et al.  A trainable document summarizer , 1995, SIGIR '95.

[2]  Vibhu O. Mittal,et al.  Ultra-summarization (poster abstract): a statistical approach to generating highly condensed non-extractive summaries , 1999, SIGIR '99.

[3]  Vibhu O. Mittal,et al.  Ultra-Summarization: A Statistical Approach to Generating Highly Condensed Non-Extractive Summaries (poster abstract). , 1998, SIGIR 1999.

[4]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[5]  Stéfan Jacques Darmoni,et al.  Natural language processing versus content-based image analysis for medical document retrieval , 2009, J. Assoc. Inf. Sci. Technol..

[6]  Kathleen R. McKeown,et al.  Understanding the process of multi-document summarization: content selection, rewriting and evaluation , 2006 .

[7]  Kathleen F. McCoy,et al.  Interactive SIGHT into information graphics , 2010, W4A.

[8]  Dragomir R. Radev,et al.  Introduction to the Special Issue on Summarization , 2002, CL.

[9]  Lisa F. Rau,et al.  Information extraction and text summarization using linguistic knowledge acquisition , 1989, Inf. Process. Manag..

[10]  David D. McDonald.  An Efficient Chart-based Algorithm for Partial-Parsing of Unrestricted Texts , 1992, ANLP.

[11]  Anja Belz,et al.  Comparing Rating Scales and Preference Judgements in Language Evaluation , 2010, INLG.

[12]  Stephanie Elzer Schwartz,et al.  Information graphics: an untapped resource for digital libraries , 2006, SIGIR.

[13]  Regina Barzilay,et al.  Using Lexical Chains for Text Summarization , 1997 .

[14]  David McDonald,et al.  'If you've heard it, you can say it' - Towards an Account of Expressibility , 2010, INLG.

[15]  Udo Hahn,et al.  Text condensation as knowledge base abstraction , 1988, [1988] Proceedings. The Fourth Conference on Artificial Intelligence Applications.

[16]  David D. McDonald.  Issues in the representation of real texts: the design of KRISP , 2000 .

[17]  Kathleen McKeown,et al.  The decomposition of human-written summary sentences , 1999, SIGIR '99.

[18]  Estevam R. Hruschka,et al.  Toward an Architecture for Never-Ending Language Learning , 2010, AAAI.

[19]  Kam-Fai Wong,et al.  Extractive Summarization Using Supervised and Semi-Supervised Learning , 2008, COLING.

[20]  Chin-Yew Lin.  Training a selection function for extraction , 1999, CIKM '99.

[21]  Daniel Marcu,et al.  The rhetorical parsing, summarization, and generation of natural language texts , 1998 .

[22]  Kathleen F. McCoy,et al.  A Discourse-Aware Graph-Based Content-Selection Framework , 2010, INLG.

[23]  Shibamouli Lahiri,et al.  Generating synopses for document-element search , 2009, CIKM.