Dynamic Knowledge Graph Completion with Jointly Structural and Textual Dependency

Knowledge Graph Completion (KGC) aims to fill the missing facts in Knowledge Graphs (KGs). Due to the most real-world KGs evolve quickly with new entities and relations being added by the minute, the dynamic KGC task is more practical than static KGC task because it can be easily to scale up the KGs by add new entities and relations. Most existing dynamic KGC models are ignore the dependency between multi-source information and topology-structure so that they lose very much semantic information in KGs. In this paper, we proposed a novel dynamic KGC model with jointly structural and textual dependency based on deep recurrent neural network (DKGC-JSTD). This model learns embedding of entity’s name and parts of its text-description to connect unseen entities to KGs. In order to establish the relevance between text description information and topology information, DKGC-JSTD uses deep memory network and association matching mechanism to extract relevant semantic feature information between entity and relations from entity text-description. And then using deep recurrent neural network to model the dependency between topology-structure and text-description. Experiments on large data sets, both old and new, show that DKGC-JSTD performs well in the dynamic KGC task.

[1]  Pasquale Minervini,et al.  Convolutional 2D Knowledge Graph Embeddings , 2017, AAAI.

[2]  Minlie Huang,et al.  SSP: Semantic Space Projection for Knowledge Graph Embedding with Text Descriptions , 2016, AAAI.

[3]  Dai Quoc Nguyen,et al.  A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization , 2018, NAACL.

[4]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[5]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[6]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[7]  Zhifang Sui,et al.  Towards Time-Aware Knowledge Graph Completion , 2016, COLING.

[8]  Zhiyuan Liu,et al.  Representation Learning of Knowledge Graphs with Entity Descriptions , 2016, AAAI.

[9]  Ryutaro Ichise,et al.  TorusE: Knowledge Graph Embedding on a Lie Group , 2017, AAAI.

[10]  Steven Skiena,et al.  Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignment , 2018, IJCAI.

[11]  Praveen Paritosh,et al.  Freebase: a collaboratively created graph database for structuring human knowledge , 2008, SIGMOD Conference.

[12]  Juan-Zi Li,et al.  Text-Enhanced Representation Learning for Knowledge Graph , 2016, IJCAI.

[13]  Kan Chen,et al.  Knowledge Graph Representation with Jointly Structural and Textual Encoding , 2016, IJCAI.

[14]  Jun Zhao,et al.  Knowledge Graph Embedding via Dynamic Mapping Matrix , 2015, ACL.

[15]  Tim Weninger,et al.  Open-World Knowledge Graph Completion , 2017, AAAI.

[16]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[17]  Yanchun Liang,et al.  Learning Entity and Relation Embeddings with Entity Description for Knowledge Graph Completion , 2018 .

[18]  Bo An,et al.  Accurate Text-Enhanced Knowledge Graph Representation Learning , 2018, NAACL.

[19]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Jens Lehmann,et al.  DBpedia: A Nucleus for a Web of Open Data , 2007, ISWC/ASWC.

[21]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[22]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.