Semantic graph parsing with recurrent neural network DAG grammars

Semantic parses are directed acyclic graphs (DAGs), so semantic parsing should be modeled as graph prediction. But predicting graphs presents difficult technical challenges, so it is simpler and more common to predict the *linearized* graphs found in semantic parsing datasets using well-understood sequence models. The cost of this simplicity is that the predicted strings may not be well-formed graphs. We present recurrent neural network DAG grammars, a graph-aware sequence model that generates only well-formed graphs while sidestepping many difficulties in graph prediction. We test our model on the Parallel Meaning Bank—a multilingual semantic graphbank. Our approach yields competitive results in English and establishes the first results for German, Italian and Dutch.

[1]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[2]  Giorgio Satta,et al.  An Incremental Parser for Abstract Meaning Representation , 2016, EACL.

[3]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[4]  Mirella Lapata,et al.  Discourse Representation Structure Parsing , 2018, ACL.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[7]  Percy Liang,et al.  Data Recombination for Neural Semantic Parsing , 2016, ACL.

[8]  Mark Johnson,et al.  AMR dependency parsing with a typed semantic algebra , 2018, ACL.

[9]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[10]  Paul Portner,et al.  Formal Semantics: The Essential Readings , 2002 .

[11]  Phil Blunsom,et al.  Robust Incremental Neural Semantic Graph Parsing , 2017, ACL.

[12]  Noah A. Smith,et al.  Recurrent Neural Network Grammars , 2016, NAACL.

[13]  Henrik Björklund,et al.  Between a Rock and a Hard Place - Uniform Parsing for Hyperedge Replacement DAG Grammars , 2016, LATA.

[14]  Johan Bos,et al.  Towards Universal Semantic Tagging , 2017, IWCS.

[15]  Dan Klein,et al.  Learning Dependency-Based Compositional Semantics , 2011, CL.

[16]  Razvan Pascanu,et al.  Learning Deep Generative Models of Graphs , 2018, ICLR 2018.

[17]  Xianpei Han,et al.  Sequence-to-Action: End-to-End Semantic Graph Generation for Semantic Parsing , 2018, ACL.

[18]  Johan Bos,et al.  The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representations , 2017, EACL.

[19]  Kevin Knight,et al.  Smatch: an Evaluation Metric for Semantic Feature Structures , 2013, ACL.

[20]  Hang Li,et al.  “ Tony ” DNN Embedding for “ Tony ” Selective Read for “ Tony ” ( a ) Attention-based Encoder-Decoder ( RNNSearch ) ( c ) State Update s 4 SourceVocabulary Softmax Prob , 2016 .

[21]  Richard Montague,et al.  The Proper Treatment of Quantification in Ordinary English , 1973 .

[22]  H. Kamp A Theory of Truth and Semantic Representation , 2008 .

[23]  Dan Flickinger,et al.  Minimal Recursion Semantics: An Introduction , 2005 .

[24]  Ivan Titov,et al.  AMR Parsing as Graph Prediction with Latent Alignment , 2018, ACL.

[25]  Philipp Koehn,et al.  Abstract Meaning Representation for Sembanking , 2013, LAW@ACL.

[26]  David Yarowsky,et al.  A Representation Learning Framework for Multi-Source Transfer Parsing , 2016, AAAI.

[27]  Antonio Toral,et al.  Exploring Neural Methods for Parsing Discourse Representation Structures , 2018, TACL.