Automated Thematic and Emotional Modern Chinese Poetry Composition

Topic and emotion are two essential elements in poetry creation, and also have critical impact on the quality of poetry. Inspired by this motivation, we propose a novel model to inject rich topics and emotions into modern Chinese poetry generation simultaneously in this paper. For this purpose, our model leverages three novel mechanisms including (1) learning specific emotion embeddings and incorporate them into decoding process; (2) mining latent topics and encode them via a joint attention mechanism; and (3) enhancing content diversity by encouraging coverage scores in beam search process. Experimental results show that our proposed model can not only generate poems with rich topics and emotions, but can also improve the poeticness of generated poems significantly.

[1]  Mirella Lapata,et al.  Chinese Poetry Generation with Recurrent Neural Networks , 2014, EMNLP.

[2]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[3]  Long Jiang,et al.  Generating Chinese Classical Poems with Statistical Machine Translation Models , 2012, AAAI.

[4]  Wei-Ying Ma,et al.  Topic Augmented Neural Response Generation with a Joint Attention Mechanism , 2016, ArXiv.

[5]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[6]  Tomas Mikolov,et al.  Bag of Tricks for Efficient Text Classification , 2016, EACL.

[7]  Jingbo Zhu,et al.  A Simple and Effective Approach to Coverage-Aware Neural Machine Translation , 2018, ACL.

[8]  Jiebo Luo,et al.  Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media , 2018, CHI.

[9]  Rada Mihalcea,et al.  TextRank: Bringing Order into Text , 2004, EMNLP.

[10]  Quang Vu Bui,et al.  Combining Latent Dirichlet Allocation and K-Means for Documents Clustering: Effect of Probabilistic Based Distance Measures , 2017, ACIIDS.

[11]  Jianfeng Gao,et al.  A Persona-Based Neural Conversation Model , 2016, ACL.

[12]  Hugo Gonçalo Oliveira.  PoeTryMe : a versatile platform for poetry generation , 2012 .

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Tie-Yan Liu,et al.  LightLDA: Big Topic Models on Modest Computer Clusters , 2014, WWW.

[15]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[16]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[17]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[18]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[19]  Ruli Manurung,et al.  Using genetic algorithms to create meaningful poetic text , 2012, J. Exp. Theor. Artif. Intell..

[20]  Yang Liu,et al.  Modeling Coverage for Neural Machine Translation , 2016, ACL.

[21]  Maosong Sun,et al.  Stylistic Chinese Poetry Generation via Unsupervised Style Disentanglement , 2018, EMNLP.

[22]  Enhong Chen,et al.  Chinese Poetry Generation with Planning based Neural Network , 2016, COLING.

[23]  Xiaoyan Zhu,et al.  Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory , 2017, AAAI.

[24]  Xing Shi,et al.  Hafez: an Interactive Poetry Generation System , 2017, ACL.

[25]  Xing Xie,et al.  Image Inspired Poetry Generation in XiaoIce , 2018, ArXiv.