Cross-Domain Sentence Compression with Auxiliary Tasks

In this paper, we study how to improve sentence compression using sequence-to-sequence models in a cross-domain setting. Hypothesizing that syntax plays an important role in cross-domain sentence compression, we adopt an existing domain adaptation method and explore three auxiliary tasks closely related to syntax. Our experiment results demonstrate the effectiveness of our model.

[1]  Lukasz Kaiser,et al.  Sentence Compression by Deletion with LSTMs , 2015, EMNLP.

[2]  J. Clarke,et al.  Global inference for sentence compression : an integer linear programming approach , 2008, J. Artif. Intell. Res..

[3]  Mirella Lapata,et al.  Constraint-Based Sentence Compression: An Integer Programming Approach , 2006, ACL.

[4]  Hongyan Jing,et al.  Sentence Reduction for Automatic Text Summarization , 2000, ANLP.

[5]  Michael Strube,et al.  Dependency Tree Based Sentence Compression , 2008, INLG.

[6]  John Blitzer,et al.  Domain Adaptation with Structural Correspondence Learning , 2006, EMNLP.

[7]  Sigrid Klerke,et al.  Improving sentence compression by learning to predict gaze , 2016, NAACL.

[8]  Jimmy J. Lin,et al.  Multi-candidate reduction: Sentence compression as a tool for document summarization tasks , 2007, Inf. Process. Manag..

[9]  Hiroshi Nakagawa,et al.  Structural Correspondence Learning for Dependency Parsing , 2007, EMNLP-CoNLL.

[10]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[11]  Prasenjit Mitra,et al.  Multi-Document Abstractive Summarization Using ILP Based Multi-Sentence Compression , 2015, IJCAI.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Fei Liu,et al.  Document Summarization via Guided Sentence Compression , 2013, EMNLP.

[14]  Jianfei Yu,et al.  Recurrent Neural Networks with Auxiliary Labels for Cross-Domain Opinion Target Extraction , 2017, AAAI.

[15]  Rong Pan,et al.  Automatic Emphatic Information Extraction from Aligned Acoustic Data and Its Application on Sentence Compression , 2017, AAAI.

[16]  Ryan T. McDonald.  Discriminative Sentence Compression with Soft Syntactic Evidence , 2006, EACL.

[17]  Daniel Marcu,et al.  Summarization beyond sentence extraction: A probabilistic approach to sentence compression , 2002, Artif. Intell..

[18]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[19]  Jianfei Yu,et al.  Learning Sentence Embeddings with Auxiliary Tasks for Cross-Domain Sentiment Classification , 2016, EMNLP.