Exploiting Unary Relations with Stacked Learning for Relation Extraction

Relation extraction models typically cast the problem of determining whether there is a relation between a pair of entities as a single decision. However, these models can struggle with long or complex language constructions in which two entities are not directly linked, as is often the case in scientific publications. We propose a novel approach that decomposes a binary relation into two unary relations that capture each argument’s role in the relation separately. We create a stacked learning model that incorporates information from unary and binary relation extractors to determine whether a relation holds between two entities. We present experimental results showing that this approach outperforms several competitive relation extractors on a new corpus of planetary science publications as well as a benchmark dataset in the biology domain.

[1]  J. Leskovec,et al.  LinkBERT: Pretraining Language Models with Document Links , 2022, ACL.

[2]  Zexuan Zhong,et al.  A Frustratingly Easy Approach for Joint Entity and Relation Extraction , 2020, ArXiv.

[3]  Ying Lin,et al.  A Joint Neural Model for Information Extraction with Global Features , 2020, ACL.

[4]  Akihiro Tamura,et al.  Multi-Task Learning for Chemical Named Entity Recognition with Chemical Compound Paraphrasing , 2019, EMNLP.

[5]  Hannaneh Hajishirzi,et al.  Entity, Relation, and Event Extraction with Contextualized Span Representations , 2019, EMNLP.

[6]  Yue Wang,et al.  A Novel Cascade Binary Tagging Framework for Relational Triple Extraction , 2019, ACL.

[7]  Yaser Al-Onaizan,et al.  Span-Level Model for Relation Extraction , 2019, ACL.

[8]  Mari Ostendorf,et al.  A general framework for information extraction using dynamic span graphs , 2019, NAACL.

[9]  Iz Beltagy,et al.  SciBERT: A Pretrained Language Model for Scientific Text , 2019, EMNLP.

[10]  Mo Yu,et al.  Extracting Multiple-Relations in One-Pass with Pre-Trained Transformers , 2019, ACL.

[11]  Christopher D. Manning,et al.  Graph Convolution over Pruned Dependency Trees Improves Relation Extraction , 2018, EMNLP.

[12]  Sophia Ananiadou,et al.  A Walk-based Model on Entity Graphs for Relation Extraction , 2018, ACL.

[13]  Andrew McCallum,et al.  Simultaneously Self-Attending to All Mentions for Full-Abstract Biological Relation Extraction , 2018, NAACL.

[14]  Ellen Riloff,et al.  Mars Target Encyclopedia: Rock and Soil Composition Extracted From the Literature , 2018, AAAI.

[15]  Kiri L. Wagstaff,et al.  Mars Target Encyclopedia - LPSC abstracts labeled data set , 2017 .

[16]  Yue Zhang,et al.  End-to-End Neural Relation Extraction with Global Optimization , 2017, EMNLP.

[17]  Fei Li,et al.  A neural joint model for entity and relation extraction from biomedical text , 2017, BMC Bioinformatics.

[18]  Zhiyong Lu,et al.  BioCreative V CDR task corpus: a resource for chemical disease relation extraction , 2016, Database J. Biol. Databases Curation.

[19]  Makoto Miwa,et al.  End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures , 2016, ACL.

[20]  Dong Wang,et al.  Relation Classification via Recurrent Neural Network , 2015, ArXiv.

[21]  Yusuke Miyao,et al.  Annotation of Computer Science Papers for Semantic Relation Extrac-tion , 2014, LREC.

[22]  Gourab Kundu,et al.  Concept-based analysis of scientific literature , 2013, CIKM.

[23]  Christopher Ré,et al.  GeoDeepDive: statistical inference using familiar data-processing languages , 2013, SIGMOD '13.

[24]  Andrew Y. Ng,et al.  Semantic Compositionality through Recursive Matrix-Vector Spaces , 2012, EMNLP.

[25]  Christopher D. Manning,et al.  Analyzing the Dynamics of Research by Extracting Key Aspects of Scientific Papers , 2011, IJCNLP.

[26]  Dan Roth,et al.  Exploiting Syntactico-Semantic Structures for Relation Extraction , 2011, ACL.

[27]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[28]  Tudor I. Oprea,et al.  ChemProt: a disease chemical biology database , 2010, Nucleic Acids Res..

[29]  Razvan C. Bunescu,et al.  A Shortest Path Dependency Kernel for Relation Extraction , 2005, HLT.

[30]  Nanda Kambhatla,et al.  Combining Lexical, Syntactic, and Semantic Features with Maximum Entropy Models for Information Extraction , 2004, ACL.

[31]  Dmitry Zelenko,et al.  Kernel Methods for Relation Extraction , 2002, J. Mach. Learn. Res..

[32]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[33]  Ralph Grishman,et al.  Semantic Representations for Domain Adaptation: A Case Study on the Tree Kernel-based Method for Relation Extraction , 2015, ACL.

[34]  Claudio Giuliano,et al.  Exploiting Shallow Linguistic Information for Relation Extraction from Biomedical Literature , 2006, EACL.