Weighted parsing for grammar-based language models

We develop a general framework for weighted parsing which is built on top of grammar-based language models and employs flexible weight algebras. It generalizes previous work in that area (semiring parsing, weighted deductive parsing) and also covers applications outside the classical scope of parsing, e.g., algebraic dynamic programming. We show an algorithm which terminates and is correct for a large class of weighted grammar-based language models.

[1]  G. Karner.  On limits in complete semirings , 1992 .

[2]  Joseph A. Goguen,et al.  Initial Algebra Semantics and Continuous Algebras , 1977, J. ACM.

[3]  S. Shieber,et al.  40 40 08 v 1 2 6 A pr 1 99 4 Principles and Implementation of Deductive Parsing , .

[4]  Nabil A. Khabbaz.  Control Sets on Linear Grammars , 1974, Inf. Control..

[5]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[6]  Alexander Koller,et al.  Decomposing TAG Algorithms Using Simple Algebraizations , 2012, TAG.

[7]  Heiko Vogler,et al.  Tree parsing for tree-adjoining machine translation , 2014, J. Log. Comput..

[8]  Bernd Mahr,et al.  Iteration and summability in semirings , 1984 .

[9]  Joshua Goodman,et al.  Semiring Parsing , 1999, CL.

[10]  R Bellman,et al.  On the Theory of Dynamic Programming. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Mehryar Mohri,et al.  Semiring Frameworks and Algorithms for Shortest-Distance Problems , 2002, J. Autom. Lang. Comb..

[12]  Walter S. Brainerd,et al.  Tree Generating Regular Systems , 1969, Inf. Control..

[13]  Donald E. Knuth,et al.  A Generalization of Dijkstra's Algorithm , 1977, Inf. Process. Lett..

[14]  Jerome David Sable,et al.  LANGUAGE AND INFORMATION STRUCTURE IN INFORMATION SYSTEMS , 1963 .

[15]  Samuel Eilenberg,et al.  Automata, languages, and machines. A , 1974, Pure and applied mathematics.

[16]  Heiko Vogler,et al.  EM-Training for Weighted Aligned Hypergraph Bimorphisms , 2016, ACL 2016.

[17]  Robert Giegerich,et al.  A discipline of dynamic programming over sequence data , 2004, Sci. Comput. Program..

[18]  Wolfgang Wechler,et al.  Universal Algebra for Computer Scientists , 1992, EATCS Monographs on Theoretical Computer Science.

[19]  Laura Kallmeyer,et al.  Parsing Beyond Context-Free Grammars , 2010, Cognitive Technologies.

[20]  Zoltán Fülöp,et al.  A Kleene Theorem for Weighted Tree Automata over Distributive Multioperator Monoids , 2007, Theory of Computing Systems.

[21]  Mark-Jan Nederhof,et al.  Squibs and Discussions: Weighted Deductive Parsing and Knuth’s Algorithm , 2003, CL.

[22]  M. Nederhof.  Squibs and Discussions: Weighted Deductive Parsing and Knuth’s Algorithm , 2003, CL.