RE-GCN: Relation Enhanced Graph Convolutional Network for Entity Alignment in Heterogeneous Knowledge Graphs

Entity alignment is a fundamental task of matching synonymous entities from different knowledge graphs (KGs). Most of the existing methods perform this task by evaluating the similarity among entity embeddings learned from heterogeneous KGs, where Graph Convolutional Network (GCN) based embedding is widely adopted for capturing complex network structure. However, the semantics and directional information of relations are ignored in previous GCN based efforts, which affect the integrality of embedding definitely and decrease the efficiency consequently. To overcome this shortcoming, this paper proposes a Relation-Enhanced Graph Convolutional Network (RE-GCN) method for entity alignment including two stages. First, to take advantage of the semantics of the relations, a novel triadic graph is designed to integrate relation nodes into the primal graph by using triadic closure. In a triadic graph, both relations and entities nodes could be organized in a unified network. The corresponding triadic graph convolution is utilized together with the primal one to learn the relation and entity embeddings, simultaneously. Second, in order to make use of direction information of the relations, a bidirectional context aggregation mechanism is proposed to aggregate the embeddings from the first stage. The final aggregation embeddings are utilized for entity alignment. On three real-world multilingual datasets, experimental results demonstrate that RE-GCN produces a more excellent performance compared with some state-of-the-art entity alignment methods.

[1]  Jun Zhao,et al.  A Joint Embedding Method for Entity Alignment of Knowledge Bases , 2016, CCKS.

[2]  Zhigang Chen,et al.  Unsupervised Entity Alignment Using Attribute Triples and Relation Triples , 2019, DASFAA.

[3]  Zhichun Wang,et al.  Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks , 2018, EMNLP.

[4]  Xiu-Shen Wei,et al.  Multi-Label Image Recognition With Graph Convolutional Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Yuan Luo,et al.  Graph Convolutional Networks for Text Classification , 2018, AAAI.

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Chengjiang Li,et al.  Semi-supervised Entity Alignment via Joint Knowledge Embedding Model and Cross-graph Model , 2019, EMNLP.

[8]  G. Simmel The sociology of Georg Simmel , 1950 .

[9]  Carlo Zaniolo,et al.  Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignment , 2016, IJCAI.

[10]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[11]  Wei Hu,et al.  Bootstrapping Entity Alignment with Knowledge Graph Embedding , 2018, IJCAI.

[12]  Si Zhang,et al.  Multilevel Network Alignment , 2019, WWW.

[13]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[14]  Zhiyuan Liu,et al.  Iterative Entity Alignment via Joint Knowledge Embeddings , 2017, IJCAI.

[15]  Gerhard Weikum,et al.  YAGO: A Large Ontology from Wikipedia and WordNet , 2008, J. Web Semant..

[16]  Fabian M. Suchanek,et al.  YAGO3: A Knowledge Base from Multilingual Wikipedias , 2015, CIDR.

[17]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[18]  Yuting Wu,et al.  Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphs , 2019, IJCAI.

[19]  Xiaofei Zhou,et al.  Neighborhood-Aware Attentional Representation for Multilingual Knowledge Graphs , 2019, IJCAI.

[20]  Yansong Feng,et al.  Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network , 2019, ACL.

[21]  Yuzhong Qu,et al.  Multi-view Knowledge Graph Embedding for Entity Alignment , 2019, IJCAI.

[22]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[23]  Jens Lehmann,et al.  DBpedia - A crystallization point for the Web of Data , 2009, J. Web Semant..

[24]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[25]  Wei Hu,et al.  Cross-Lingual Entity Alignment via Joint Attribute-Preserving Embedding , 2017, SEMWEB.