Prefix Probability for Probabilistic Synchronous Context-Free Grammars

We present a method for the computation of prefix probabilities for synchronous context-free grammars. Our framework is fairly general and relies on the combination of a simple, novel grammar transformation and standard techniques to bring grammars into normal forms.

[1]  Dekai Wu,et al.  Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora , 1997, CL.

[2]  Fernando Pereira,et al.  Relating Probabilistic Grammars and Automata , 1999, ACL.

[3]  Giorgio Satta,et al.  Computation of Probabilities for an Island-Driven Parser , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Giorgio Satta,et al.  Computing Partition Functions of PCFGs , 2009, Research on Language and Computation.

[5]  Mark Hopkins,et al.  SCFG Decoding Without Binarization , 2010, EMNLP.

[6]  Stuart M. Shieber,et al.  Principles and Implementation of Deductive Parsing , 1994, J. Log. Program..

[7]  Daniel Gildea,et al.  Worst-Case Synchronous Grammar Rules , 2007, HLT-NAACL.

[8]  Alfred V. Aho,et al.  Syntax Directed Translations and the Pushdown Assembler , 1969, J. Comput. Syst. Sci..

[9]  Andreas Stolcke,et al.  An Efficient Probabilistic Context-Free Parsing Algorithm that Computes Prefix Probabilities , 1994, CL.

[10]  Daniel Marcu,et al.  What’s in a translation rule? , 2004, NAACL.

[11]  David A. McAllester.  On the complexity analysis of static analyses , 1999, JACM.

[12]  Giorgio Satta,et al.  Some Computational Complexity Results for Synchronous Context-Free Grammars , 2005, HLT/EMNLP.

[13]  John D. Lafferty,et al.  Computation of the Probability of Initial Substring Generation by Stochastic Context-Free Grammars , 1991, Comput. Linguistics.

[14]  David Chiang,et al.  Hierarchical Phrase-Based Translation , 2007, CL.

[15]  Zhiyi Chi,et al.  Statistical Properties of Probabilistic Context-Free Grammars , 1999, CL.

[16]  George F. Foster,et al.  User-Friendly Text Prediction For Translators , 2002, EMNLP.

[17]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[18]  Daniel Gildea,et al.  Synchronous Binarization for Machine Translation , 2006, NAACL.

[19]  Michael Luttenberger,et al.  On the convergence of Newton's method for monotone systems of polynomial equations , 2007, STOC '07.