Word Ordering Without Syntax The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters

Recent work on word ordering has argued that syntactic structure is important, or even re-quired, for effectively recovering the order of a sentence. We find that, in fact, an n-gram language model with a simple heuristic gives strong results on this task. Furthermore, we show that a long short-term memory (LSTM) language model is even more effective at recovering order, with our basic model outperforming a state-of-the-art syntactic model by 11.5 BLEU points. Additional data and larger beams yield further gains, at the expense of training and search time. order in

[1]  Yue Zhang,et al.  An Empirical Comparison Between N-gram and Syntactic Language Models for Word Ordering , 2015, EMNLP.

[2]  Stephen Clark,et al.  Discriminative Syntax-Based Word Ordering for Text Generation , 2015, CL.

[3]  Mohammad Sadegh Rasooli,et al.  Yara Parser: A Fast and Accurate Dependency Parser , 2015, ArXiv.

[4]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[5]  William J. Byrne,et al.  A Graph-Based Approach to String Regeneration , 2014, EACL.

[6]  Alex Graves Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[7]  Stephen Clark,et al.  Syntax-Based Word Ordering Incorporating a Large-Scale Language Model , 2012, EACL.

[8]  Stephen Clark,et al.  Syntax-Based Grammaticality Improvement using CCG and Guided Search , 2011, EMNLP.

[9]  Philip Koehn,et al.  Statistical Machine Translation , 2010, EAMT.

[10]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[13]  Chris Brew,et al.  Letting the Cat Out of the Bag: Generation for Shake-and-Bake MT , 1992, COLING.

[14]  John Cocke,et al.  A Statistical Approach to Machine Translation , 1990, CL.

[15]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[16]  Yue Zhang,et al.  Transition-Based Syntactic Linearization , 2015, NAACL.