Enhancing the Expression of Contrast in the SPaRKy Restaurant Corpus

We show that Nakatsu & White’s (2010) proposed enhancements to the SPaRKy Restaurant Corpus (SRC; Walker et al., 2007) for better expressing contrast do indeed make it possible to generate better texts, including ones that make effective and varied use of contrastive connectives and discourse adverbials. After first presenting a validation experiment for naturalness ratings of SRC texts gathered using Amazon’s Mechanical Turk, we present an initial experiment suggesting that such ratings can be used to train a realization ranker that enables higher-rated texts to be selected when the ranker is trained on a sample of generated restaurant recommendations with the contrast enhancements than without them. We conclude with a discussion of possible ways of improving the ranker in future work.

[1]  Kevin Knight,et al.  The Practical Value of N-Grams Is in Generation , 1998, INLG.

[2]  William C. Mann,et al.  Rhetorical Structure Theory: Toward a functional theory of text organization , 1988 .

[3]  Michael White,et al.  Perceptron Reranking for CCG Realization , 2009, EMNLP.

[4]  Marilyn A. Walker,et al.  Training a sentence planner for spoken dialogue using boosting , 2002, Comput. Speech Lang..

[5]  Crystal Nakatsu,et al.  Learning Contrastive Connectives in Sentence Realization Ranking , 2008, SIGDIAL Workshop.

[6]  Martin Kay,et al.  Syntactic Process , 1979, ACL.

[7]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[8]  Bonnie L. Webber,et al.  D-LTAG: extending lexicalized TAG to discourse , 2004, Cogn. Sci..

[9]  Chris Mellish,et al.  Experiments Using Stochastic Search for Text Planning , 1998, INLG.

[10]  Manfred Stede,et al.  Ma(r)king concessions in English and German , 1995, ArXiv.

[11]  Johanna D. Moore,et al.  Generation and evaluation of user tailored responses in multimodal dialogue , 2004, Cogn. Sci..

[12]  Marilyn A. Walker,et al.  Individual and Domain Adaptation in Sentence Planning for Dialogue , 2007, J. Artif. Intell. Res..

[13]  Matthew Stone,et al.  Anaphora and Discourse Structure , 2001, CL.

[14]  Michael White,et al.  Generating with Discourse Combinatory Categorial Grammar , 2010 .

[15]  Michael White,et al.  Learning to Say It Well: Reranking Realizations by Predicted Synthesis Quality , 2006, ACL.

[16]  Johanna D. Moore,et al.  Generating Tailored, Comparative Descriptions with Contextually Appropriate Intonation , 2010, CL.

[17]  Michael White,et al.  Efficient Realization of Coordinate Structures in Combinatory Categorial Grammar , 2006 .