Abstractive Spoken Document Summarization Using Hierarchical Model with Multi-Stage Attention Diversity Optimization

ive Spoken Document Summarization using Hierarchical Model with Multi-stage Attention Diversity Optimization Potsawee Manakul, Mark J. F. Gales, Linlin Wang Engineering Department, University of Cambridge, UK pm574@cam.ac.uk, mjfg@eng.cam.ac.uk, lw519@cam.ac.uk

[1]  Bowen Zhou,et al.  SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents , 2016, AAAI.

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Yoshua Bengio,et al.  Professor Forcing: A New Algorithm for Training Recurrent Networks , 2016, NIPS.

[4]  Bowen Zhou,et al.  Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond , 2016, CoNLL.

[5]  Samy Bengio,et al.  Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks , 2015, NIPS.

[6]  Yun-Nung Chen,et al.  Abstractive Dialogue Summarization with Sentence-Gated Modeling Optimized by Dialogue Acts , 2018, 2018 IEEE Spoken Language Technology Workshop (SLT).

[7]  Mark J. F. Gales,et al.  Attention Forcing for Sequence-to-sequence Model Training , 2019, ArXiv.

[8]  Visar Berisha,et al.  Investigating the Effects of Word Substitution Errors on Sentence Embeddings , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Dilek Z. Hakkani-Tür,et al.  Integrating prosodic features in extractive meeting summarization , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[10]  Omer Levy,et al.  BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension , 2019, ACL.

[11]  Lin-Shan Lee,et al.  Supervised spoken document summarization based on structured support vector machine with utterance clusters as hidden variables , 2013, INTERSPEECH.

[12]  Gokhan Tur,et al.  Spoken Language Understanding: Systems for Extracting Semantic Information from Speech , 2011 .

[13]  Zhenglu Yang,et al.  Attention Optimization for Abstractive Document Summarization , 2019, EMNLP.

[14]  Daniel Povey,et al.  The Kaldi Speech Recognition Toolkit , 2011 .

[15]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[16]  Yejin Choi,et al.  The Curious Case of Neural Text Degeneration , 2019, ICLR.

[17]  Fei Liu,et al.  Towards Abstractive Speech Summarization: Exploring Unsupervised and Supervised Approaches for Spoken Utterance Compression , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[18]  Yen-Chun Chen,et al.  Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting , 2018, ACL.

[19]  David Miller,et al.  The Fisher Corpus: a Resource for the Next Generations of Speech-to-Text , 2004, LREC.

[20]  Yang Liu,et al.  Modeling Coverage for Neural Machine Translation , 2016, ACL.

[21]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[22]  Zhou Yu,et al.  Abstractive Dialog Summarization with Semantic Scaffolds , 2019, ArXiv.

[23]  Qing Li,et al.  Multi-Task Learning for Abstractive and Extractive Summarization , 2019, Data Science and Engineering.

[24]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[25]  Jean-Pierre Lorré,et al.  Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximization , 2018, ACL.

[26]  Heng Ji,et al.  Keep Meeting Summaries on Topic: Abstractive Multi-Modal Meeting Summarization , 2019, ACL.

[27]  Jean Carletta,et al.  The AMI Meeting Corpus: A Pre-announcement , 2005, MLMI.

[28]  Florian Metze,et al.  Two-layer mutually reinforced random walk for improved multi-party meeting summarization , 2012, 2012 IEEE Spoken Language Technology Workshop (SLT).

[29]  Christopher D. Manning,et al.  Get To The Point: Summarization with Pointer-Generator Networks , 2017, ACL.

[30]  Min Yang,et al.  Abstractive Meeting Summarization via Hierarchical Adaptive Segmental Network Learning , 2019, WWW.

[31]  Richard Socher,et al.  A Deep Reinforced Model for Abstractive Summarization , 2017, ICLR.

[32]  Yiming Wang,et al.  Semi-Orthogonal Low-Rank Matrix Factorization for Deep Neural Networks , 2018, INTERSPEECH.

[33]  Máté Ákos Tündik,et al.  Assessing the Semantic Space Bias Caused by ASR Error Propagation and its Effect on Spoken Document Summarization , 2019, INTERSPEECH.

[34]  Mirella Lapata,et al.  Text Summarization with Pretrained Encoders , 2019, EMNLP.