Semantic Parsing with Bayesian Tree Transducers

Many semantic parsing models use tree transformations to map between natural language and meaning representation. However, while tree transformations are central to several state-of-the-art approaches, little use has been made of the rich literature on tree automata. This paper makes the connection concrete with a tree transducer based semantic parsing model and suggests that other models can be interpreted in a similar framework, increasing the generality of their contributions. In particular, this paper further introduces a variational Bayesian inference algorithm that is applicable to a wide class of tree transducers, producing state-of-the-art semantic parsing results while remaining applicable to any domain employing probabilistic tree transducers.

[1]  Kevin Knight,et al.  An Overview of Probabilistic Tree Transducers for Natural Language Processing , 2005, CICLing.

[2]  Kevin Knight,et al.  A Syntax-based Statistical Translation Model , 2001, ACL.

[3]  Dan Klein,et al.  Learning Dependency-Based Compositional Semantics , 2011, CL.

[4]  Kevin Knight,et al.  Tiburon: A Weighted Tree Automata Toolkit , 2006, CIAA.

[5]  Raymond J. Mooney,et al.  A Statistical Semantic Parser that Integrates Syntax and Semantics , 2005, CoNLL.

[6]  William C. Rounds,et al.  Mappings and grammars on trees , 1970, Mathematical systems theory.

[7]  Mark Steedman,et al.  Inducing Probabilistic CCG Grammars from Logical Form with Higher-Order Unification , 2010, EMNLP.

[8]  Mark Johnson,et al.  Reducing Grounded Learning Tasks To Grammatical Inference , 2011, EMNLP.

[9]  Daniel Marcu,et al.  What’s in a translation rule? , 2004, NAACL.

[10]  Kevin Knight,et al.  Training Tree Transducers , 2004, NAACL.

[11]  Rohit J. Kate,et al.  Using String-Kernels for Learning Semantic Parsers , 2006, ACL.

[12]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[13]  Hwee Tou Ng,et al.  A Generative Model for Parsing Natural Language to Meaning Representations , 2008, EMNLP.

[14]  Kenichi Kurihara,et al.  Variational Bayesian Grammar Induction for Natural Language , 2006, ICGI.

[15]  T. Minka Estimating a Dirichlet distribution , 2012 .

[16]  Kevin Knight,et al.  Bayesian Inference for Finite-State Transducers , 2010, HLT-NAACL.

[17]  James W. Thatcher,et al.  Generalized Sequential Machine Maps , 1970, J. Comput. Syst. Sci..

[18]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[19]  Raymond J. Mooney,et al.  Learning for Semantic Parsing with Statistical Machine Translation , 2006, NAACL.

[20]  Mark Hopkins,et al.  The Power of Extended Top-Down Tree Transducers , 2009, SIAM J. Comput..

[21]  Stuart M. Shieber,et al.  Synchronous Grammars as Tree Transducers , 2004, TAG+.