Plan-And-Write: Towards Better Automatic Storytelling

Automatic storytelling is challenging since it requires generating long, coherent natural language to describes a sensible sequence of events. Despite considerable efforts on automatic story generation in the past, prior work either is restricted in plot planning, or can only generate stories in a narrow domain. In this paper, we explore open-domain story generation that writes stories given a title (topic) as input. We propose a plan-and-write hierarchical generation framework that first plans a storyline, and then generates a story based on the storyline. We compare two planning strategies. The dynamic schema interweaves story planning and its surface realization in text, while the static schema plans out the entire storyline before generating stories. Experiments show that with explicit storyline planning, the generated stories are more diverse, coherent, and on topic than those generated without creating a full plan, according to both automatic and human evaluations.

[1]  James R. Meehan,et al.  TALE-SPIN, An Interactive Program that Writes Stories , 1977, IJCAI.

[2]  Stephen John Turner,et al.  The Creative Process: A Computer Model of Storytelling and Creativity , 1994 .

[3]  Rafael Pérez y Pérez,et al.  MEXICA: A computer model of a cognitive account of creative writing , 2001, J. Exp. Theor. Artif. Intell..

[4]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[5]  Raquel Hervás,et al.  Story plot generation based on CBR , 2004, Knowl. Based Syst..

[6]  Nick Montfort.  Natural Language Generation and Narrative Variation in Interactive Fiction , 2006 .

[7]  Marc Cavazza,et al.  Controlling Narrative Generation with Planning Trajectories: The Role of Constraints , 2009, ICIDS.

[8]  Marc Cavazza,et al.  Applying planning to interactive storytelling: Narrative control using state constraints , 2010, TIST.

[9]  Stuart J. Rose,et al.  1 Automatic keyword extraction from individual documents , 2010 .

[10]  Robert Michael Young,et al.  Narrative Planning: Balancing Plot and Character , 2010, J. Artif. Intell. Res..

[11]  Nick Cramer,et al.  Automatic Keyword Extraction from Individual Documents , 2010 .

[12]  Daniel Alarcón.  The Secret Miracle: The Novelist's Handbook , 2010 .

[13]  Reid Swanson,et al.  Say Anything: Using Textual Case-Based Reasoning to Enable Open-Domain Interactive Storytelling , 2012, TIIS.

[14]  Boyang Li,et al.  Story Generation with Crowdsourced Plot Graphs , 2013, AAAI.

[15]  Marilyn A. Walker,et al.  Generating Different Story Tellings from Semantic Representations of Narrative , 2013, ICIDS.

[16]  Sanja Fidler,et al.  Skip-Thought Vectors , 2015, NIPS.

[17]  Hang Li,et al.  Neural Responding Machine for Short-Text Conversation , 2015, ACL.

[18]  Nathanael Chambers,et al.  CaTeRS: Causal and Temporal Relation Scheme for Semantic Annotation of Event Structures , 2016, EVENTS@HLT-NAACL.

[19]  Tao Mei,et al.  Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network , 2016, ArXiv.

[20]  Enhong Chen,et al.  Chinese Poetry Generation with Planning based Neural Network , 2016, COLING.

[21]  Jianfeng Gao,et al.  Deep Reinforcement Learning for Dialogue Generation , 2016, EMNLP.

[22]  Joelle Pineau,et al.  How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation , 2016, EMNLP.

[23]  Marilyn A. Walker,et al.  M2D: Monolog to Dialog Generation for Conversational Story Telling , 2016, ICIDS.

[24]  Raymond J. Mooney,et al.  Learning Statistical Scripts with LSTM Recurrent Neural Networks , 2016, AAAI.

[25]  Nathanael Chambers,et al.  A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories , 2016, NAACL.

[26]  Francis Ferraro,et al.  Visual Storytelling , 2016, NAACL.

[27]  Rui Yan,et al.  Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation , 2016, COLING.

[28]  Anirban Laha,et al.  Story Generation from Sequence of Independent Short Descriptions , 2017, ArXiv.

[29]  Julian Togelius,et al.  DeepTingle , 2017, ICCC.

[30]  Elahe Rahimtoroghi,et al.  Inference of Fine-Grained Event Causality from Blogs and Films , 2017, NEWS@ACL.

[31]  Dilek Z. Hakkani-Tür,et al.  To Plan or not to Plan? Discourse Planning in Slot-Value Informed Sequence to Sequence Models for Language Generation , 2017, INTERSPEECH.

[32]  Nathanael Chambers,et al.  Event Ordering with a Generalized Model for Sieve Prediction Ranking , 2017, IJCNLP.

[33]  Dongyan Zhao,et al.  Towards Implicit Content-Introducing for Generative Short-Text Conversation Systems , 2017, EMNLP.

[34]  Xin Wang,et al.  No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling , 2018, ACL.

[35]  Yann Dauphin,et al.  Hierarchical Neural Story Generation , 2018, ACL.

[36]  Mark O. Riedl,et al.  Event Representations for Automated Story Generation with Deep Neural Nets , 2017, AAAI.

[37]  Richard Socher,et al.  Regularizing and Optimizing LSTM Language Models , 2017, ICLR.

[38]  Xu Sun,et al.  A Skeleton-Based Model for Promoting Coherence Among Sentences in Narrative Story Generation , 2018, EMNLP.

[39]  Nanyun Peng,et al.  Towards Controllable Story Generation , 2018 .

[40]  Minlie Huang,et al.  Story Ending Generation with Incremental Encoding and Commonsense Knowledge , 2018, AAAI.