Abstract Meaning Representation Guided Graph Encoding and Decoding for Joint Information Extraction

The tasks of Rich Semantic Parsing, such as Abstract Meaning Representation (AMR), share similar goals with Information Extraction (IE) to convert natural language texts into structured semantic representations. To take advantage of such similarity, we propose a novel AMR-guided framework for joint information extraction to discover entities, relations, and events with the help of a pre-trained AMR parser. Our framework consists of two novel components: 1) an AMR based semantic graph aggregator to let the candidate entity and event trigger nodes collect neighborhood information from AMR graph for passing message among related knowledge elements; 2) an AMR guided graph decoder to extract knowledge elements based on the order decided by the hierarchical structures in AMR. Experiments on multiple datasets have shown that the AMR graph encoder and decoder have provided significant gains and our approach has achieved new state-of-the-art performance on all IE subtasks.

[1]  Akinori Yonezawa,et al.  Overview of Genia Event Task in BioNLP Shared Task 2011 , 2011, BioNLP@ACL.

[2]  Peng Zhou,et al.  Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme , 2017, ACL.

[3]  Heng Ji,et al.  Biomedical Event Extraction based on Knowledge-driven Tree-LSTM , 2019, NAACL.

[4]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[5]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[6]  Xin Luna Dong,et al.  ZeroShotCeres: Zero-Shot Relation Extraction from Semi-Structured Webpages , 2020, ACL.

[7]  Heng Ji,et al.  Constructing Information Networks Using One Single Model , 2014, EMNLP.

[8]  Shuang Zeng,et al.  Double Graph Based Reasoning for Document-level Relation Extraction , 2020, EMNLP.

[9]  Ramón Fernández Astudillo,et al.  Transition-based Parsing with Stack-Transformers , 2020, FINDINGS.

[10]  Regina Barzilay,et al.  GraphIE: A Graph-Based Framework for Information Extraction , 2018, NAACL.

[11]  Gary Geunbae Lee,et al.  A Graph-based Cross-lingual Projection Approach for Weakly Supervised Relation Extraction , 2012, ACL.

[12]  Ricardo Campos,et al.  Joint Event Extraction along Shortest Dependency Paths using Graph Convolutional Networks , 2020, Knowl. Based Syst..

[13]  松本 裕治,et al.  Abstract Meaning Representationを用いた名詞句の意味構造解析 , 2015 .

[14]  Nanyun Peng,et al.  Biomedical Event Extraction on Graph Edge-conditioned Attention Networks with Hierarchical Knowledge Graphs , 2020, FINDINGS.

[15]  Xiao Liu,et al.  Jointly Multiple Events Extraction via Attention-based Graph Information Aggregation , 2018, EMNLP.

[16]  Lifu Huang,et al.  Zero-Shot Transfer Learning for Event Extraction , 2017, ACL.

[17]  Daniel Marcu,et al.  Biomedical Event Extraction using Abstract Meaning Representation , 2017, BioNLP.

[18]  Heng Ji,et al.  Joint Entity and Event Extraction with Generative Adversarial Imitation Learning , 2019, Data Intelligence.

[19]  Zhiyuan Liu,et al.  Graph Neural Networks with Generated Parameters for Relation Extraction , 2019, ACL.

[20]  Tom M. Mitchell,et al.  Joint Extraction of Events and Entities within a Document Context , 2016, NAACL.

[21]  Qi He,et al.  Syntax grounded graph convolutional network for joint entity and event extraction , 2021, Neurocomputing.

[22]  Makoto Miwa,et al.  End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures , 2016, ACL.

[23]  Philipp Koehn,et al.  Abstract Meaning Representation for Sembanking , 2013, LAW@ACL.

[24]  Wei Lu,et al.  Attention Guided Graph Convolutional Networks for Relation Extraction , 2019, ACL.

[25]  Heng Ji,et al.  Incremental Joint Extraction of Entity Mentions and Relations , 2014, ACL.

[26]  Ido Dagan,et al.  Creating a Large Benchmark for Open Information Extraction , 2016, EMNLP.

[27]  Franck Dernoncourt,et al.  Exploiting the Syntax-Model Consistency for Neural Relation Extraction , 2020, ACL.

[28]  Christopher D. Manning,et al.  Graph Convolution over Pruned Dependency Trees Improves Relation Extraction , 2018, EMNLP.

[29]  Xi Chen,et al.  Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks , 2019, NAACL.

[30]  Ying Lin,et al.  A Joint Neural Model for Information Extraction with Global Features , 2020, ACL.

[31]  Mari Ostendorf,et al.  A general framework for information extraction using dynamic span graphs , 2019, NAACL.

[32]  Sophia Ananiadou,et al.  Inter-sentence Relation Extraction with Document-level Graph Convolutional Neural Network , 2019, ACL.

[33]  Amir Pouran Ben Veyseh,et al.  Graph Transformer Networks with Syntactic and Semantic Structures for Event Argument Extraction , 2020, FINDINGS.

[34]  Wei-Yun Ma,et al.  GraphRel: Modeling Text as Relational Graphs for Joint Entity and Relation Extraction , 2019, ACL.

[35]  Richong Zhang,et al.  Relation Extraction with Convolutional Network over Learnable Syntax-Transport Graph , 2020, AAAI.

[36]  Yue Wang,et al.  The Genia Event Extraction Shared Task, 2013 Edition - Overview , 2013, BioNLP@ACL.

[37]  Thomas Demeester,et al.  Adversarial training for multi-context joint entity and relation extraction , 2018, EMNLP.

[38]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[39]  Sunil Kumar Sahu,et al.  Relation Extraction with Self-determined Graph Convolutional Network , 2020, CIKM.

[40]  Shiliang Sun,et al.  Joint Type Inference on Entities and Relations via Graph Convolutional Networks , 2019, ACL.

[41]  Heng Ji,et al.  Liberal Event Extraction and Event Schema Induction , 2016, ACL.

[42]  Eric Nichols,et al.  Named Entity Recognition with Bidirectional LSTM-CNNs , 2015, TACL.

[43]  Hannaneh Hajishirzi,et al.  Entity, Relation, and Event Extraction with Contextualized Span Representations , 2019, EMNLP.

[44]  Claire Cardie,et al.  Going out on a limb: Joint Extraction of Entity Mentions and Relations without Dependency Trees , 2017, ACL.

[45]  Heng Ji,et al.  Cross-media Structured Common Space for Multimedia Event Extraction , 2020, ACL.