QANom: Question-Answer driven SRL for Nominalizations

We propose a new semantic scheme for capturing predicate-argument relations for nominalizations, termed QANom. This scheme extends the QA-SRL formalism (He et al., 2015), modeling the relations between nominalizations and their arguments via natural language question-answer pairs. We construct the first QANom dataset using controlled crowdsourcing, analyze its quality and compare it to expertly annotated nominal-SRL annotations, as well as to other QA-driven annotations. In addition, we train a baseline QANom parser for identifying nominalizations and labeling their arguments with question-answer pairs. Finally, we demonstrate the extrinsic utility of our annotations for downstream tasks using both indirect supervision and zero-shot settings.

[1]  Hwee Tou Ng,et al.  Towards Robust Linguistic Analysis using OntoNotes , 2013, CoNLL.

[2]  Marie-Francine Moens,et al.  Improving Implicit Semantic Role Labeling by Predicting Semantic Frame Arguments , 2017, IJCNLP.

[3]  Heng Ji,et al.  Joint Event Extraction via Structured Prediction with Global Features , 2013, ACL.

[4]  Luke S. Zettlemoyer,et al.  AllenNLP: A Deep Semantic Natural Language Processing Platform , 2018, ArXiv.

[5]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[6]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[7]  Artemis Alexiadou,et al.  Nominalizations: A Probe into the Architecture of Grammar Part I: The Nominalization Puzzle , 2010, Lang. Linguistics Compass.

[8]  Timothy Dozat,et al.  Simpler but More Accurate Semantic Dependency Parsing , 2018, ACL.

[9]  Katrin Erk,et al.  Implicit Argument Prediction with Event Knowledge , 2018, NAACL.

[10]  Ido Dagan,et al.  Revisiting Joint Modeling of Cross-document Entity and Event Coreference Resolution , 2019, ACL.

[11]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[12]  Yidong Chen,et al.  Deep Semantic Role Labeling with Self-Attention , 2017, AAAI.

[13]  Caroline Sporleder,et al.  Semantic Role Assignment for Event Nominalisations by Leveraging Verbal Data , 2008, COLING.

[14]  Ido Dagan,et al.  Controlled Crowdsourcing for High-Quality QA-SRL Annotation , 2019, ACL.

[15]  Martha Palmer,et al.  From TreeBank to PropBank , 2002, LREC.

[16]  Ivan Titov,et al.  Unsupervised Transfer of Semantic Role Models from Verbal to Nominal Domain , 2020, ArXiv.

[17]  Ralph Grishman,et al.  The NomBank Project: An Interim Report , 2004, FCP@NAACL-HLT.

[18]  Nizar Habash,et al.  A Categorial Variation Database for English , 2003, NAACL.

[19]  David A. McAllester,et al.  Machine Comprehension with Syntax, Frames, and Semantics , 2015, ACL.

[20]  Stephan Oepen,et al.  Broad-Coverage Semantic Dependency Parsing , 2014 .

[21]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[22]  Ido Dagan,et al.  Creating a Large Benchmark for Open Information Extraction , 2016, EMNLP.

[23]  Liliana Mamani Sánchez,et al.  DEVERBAL NOUN COMPLEMENTATION RULES APPLIED TO SEMANTIC ROLE LABELING , 2017 .

[24]  Omer Levy,et al.  Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling , 2018, ACL.

[25]  Hwee Tou Ng,et al.  Semantic Role Labeling of NomBank: A Maximum Entropy Approach , 2006, EMNLP.

[26]  Alexander I. Rudnicky,et al.  Unsupervised induction and filling of semantic slots for spoken dialogue systems using frame-semantic parsing , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[27]  Jimmy J. Lin,et al.  Simple BERT Models for Relation Extraction and Semantic Role Labeling , 2019, ArXiv.

[28]  Ido Dagan,et al.  Supervised Open Information Extraction , 2018, NAACL.

[29]  Dan Roth,et al.  Incidental Supervision from Question-Answering Signals , 2019, ArXiv.

[30]  Yusuke Miyao,et al.  SemEval 2015 Task 18: Broad-Coverage Semantic Dependency Parsing , 2015, *SEMEVAL.

[31]  Ralph Grishman,et al.  NOMLEX: a lexicon of nominalizations , 1998 .

[32]  Luke S. Zettlemoyer,et al.  Large-Scale QA-SRL Parsing , 2018, ACL.

[33]  Joyce Yue Chai,et al.  Semantic Role Labeling of Implicit Arguments for Nominal Predicates , 2012, CL.

[34]  Leo Wanner,et al.  The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results , 2018 .

[35]  Ralph Grishman,et al.  Annotating Noun Argument Structure for NomBank , 2004, LREC.

[36]  Richard Johansson,et al.  The CoNLL-2009 Shared Task: Syntactic and Semantic Dependencies in Multiple Languages , 2009, CoNLL Shared Task.

[37]  Diana Trandabat,et al.  Using semantic roles to improve summaries , 2011, ENLG.

[38]  Luke S. Zettlemoyer,et al.  Question-Answer Driven Semantic Role Labeling: Using Natural Language to Annotate Natural Language , 2015, EMNLP.

[39]  Percy Liang,et al.  Know What You Don’t Know: Unanswerable Questions for SQuAD , 2018, ACL.