CoRelatE: Learning the correlation in multi-fold relations for knowledge graph embedding

Abstract Existing approaches for knowledge graph embedding usually represent knowledge as triples of binary relations between entities and embed them into continuous vector space, which are not practical for the complex facts in the form of multi-fold relations in real life. In this work, we address the problem of multi-fold relation embedding in knowledge graph and propose a new framework CoRelatE that learns correlations between entities, facts and relations from the instances. We first model the entity-relation correlation directly via combinational operator, then utilize a graph convolutional network to model the correlation between entities and their related facts. Finally, the facts are forced to embed close to their corresponding relations to learn the fact-relation correlation. We formulate the objective as a joint optimization problem and introduce an efficient algorithm to solve it. We compare the proposed CoRelatE model with several state-of-the-art models including HypE, NaLP and RAE, m-TransH. Experimental results on four datasets of multi-fold relations and two datasets of binary relations for link prediction and instance classification tasks validate the effectiveness and merits of our model.

[1]  Seyed Mehran Kazemi,et al.  SimplE Embedding for Link Prediction in Knowledge Graphs , 2018, NeurIPS.

[2]  Jian-Yun Nie,et al.  RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space , 2018, ICLR.

[3]  Siamak Ravanbakhsh,et al.  Improved Knowledge Graph Embedding using Background Taxonomic Information , 2018, AAAI.

[4]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[5]  Gerard de Melo,et al.  FrameBase: Representing N-Ary Relations Using Semantic Frames , 2015, ESWC.

[6]  Heng Ji,et al.  CoType: Joint Extraction of Typed Entities and Relations with Knowledge Bases , 2016, WWW.

[7]  Jianfeng Gao,et al.  Embedding Entities and Relations for Learning and Inference in Knowledge Bases , 2014, ICLR.

[8]  Wei Zhang,et al.  Active Transfer Learning , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[10]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[11]  Guillaume Bouchard,et al.  Complex Embeddings for Simple Link Prediction , 2016, ICML.

[12]  Yuxin Peng,et al.  Object-Aware Aggregation With Bidirectional Temporal Graph for Video Captioning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Praveen Paritosh,et al.  Freebase: a collaboratively created graph database for structuring human knowledge , 2008, SIGMOD Conference.

[14]  D. Poole,et al.  Knowledge Hypergraphs: Prediction Beyond Binary Relations , 2019, IJCAI.

[15]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[16]  Xueqi Cheng,et al.  A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations , 2015, AAAI.

[17]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[18]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[19]  Jianxin Li,et al.  On the Representation and Embedding of Knowledge Bases beyond Binary Relations , 2016, IJCAI.

[20]  Pasquale Minervini,et al.  Convolutional 2D Knowledge Graph Embeddings , 2017, AAAI.

[21]  Zhen Wang,et al.  Knowledge Graph and Text Jointly Embedding , 2014, EMNLP.

[22]  Richong Zhang,et al.  Scalable Instance Reconstruction in Knowledge Bases via Relatedness Affiliated Embedding , 2018, WWW.

[23]  Tim Weninger,et al.  ProjE: Embedding Projection for Knowledge Graph Completion , 2016, AAAI.

[24]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[25]  Seung-won Hwang,et al.  KBQA: Learning Question Answering over QA Corpora and Knowledge Bases , 2019, Proc. VLDB Endow..

[26]  Amit P. Sheth,et al.  Don't like RDF reification?: making statements about statements using singleton property , 2014, WWW.

[27]  Zhiyuan Liu,et al.  Representation Learning of Knowledge Graphs with Entity Descriptions , 2016, AAAI.

[28]  Lorenzo Rosasco,et al.  Holographic Embeddings of Knowledge Graphs , 2015, AAAI.

[29]  Yuanzhuo Wang,et al.  Link Prediction on N-ary Relational Data , 2019, WWW.