Structure-augmented knowledge graph embedding for sparse data with rule learning

Abstract In recent years, knowledge graphs have received considerable attention because of their ability to express rich information and their potential for use in knowledge-based reasoning. For example, they can assist in-depth knowledge discovery related to user associations, switching policies, and traffic content in mobile services. Knowledge graph embeddings project the entities and relations of knowledge graphs into vectors that are dense and low dimensional, thus allowing the complex semantic information and relations between these entities to be measured efficiently. However, traditional knowledge graph embedding methods consider only direct facts, making it difficult to achieve reasonable embedding learning of entities and relations when faced with sparse data. To settle this issue, this paper proposes a novel knowledge graph embedding method based on tensor decomposition combined with rule learning. First, rules are inferred and scored based on the initial embeddings of entities and relations. Then, new triples for sparse entities are inferred from rules with high scores. Finally, these new triples are iteratively embedded into the model. Experimental results obtained on the WN18 and FB15k datasets indicate that the proposed model achieves significantly better performance than other state-of-the-art knowledge graph embedding models when faced with sparse data.

[1]  Volker Tresp,et al.  Type-Constrained Representation Learning in Knowledge Graphs , 2015, SEMWEB.

[2]  Evgeny Kharlamov,et al.  Rule Learning from Knowledge Graphs Guided by Embedding Models , 2018, SEMWEB.

[3]  Guilin Qi,et al.  Hybrid reasoning in knowledge graphs: Combing symbolic reasoning and statistical reasoning , 2020, Semantic Web.

[4]  Juan-Zi Li,et al.  RDF2Rules: Learning Rules from RDF Knowledge Bases by Mining Frequent Predicate Cycles , 2015, ArXiv.

[5]  Yixue Hao,et al.  Label-less Learning for Emotion Cognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[6]  F. L. Hitchcock The Expression of a Tensor or a Polyadic as a Sum of Products , 1927 .

[7]  Qing Liu,et al.  SWARM: An Approach for Mining Semantic Association Rules from Semantic Web Data , 2016, PRICAI.

[8]  James Allan,et al.  Entity query feature expansion using knowledge base links , 2014, SIGIR.

[9]  Wei Zhang,et al.  Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning , 2019, WWW.

[10]  Jun Zhao,et al.  Knowledge Graph Embedding via Dynamic Mapping Matrix , 2015, ACL.

[11]  Tom M. Mitchell,et al.  Random Walk Inference and Learning in A Large Scale Knowledge Base , 2011, EMNLP.

[12]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[13]  Fabian M. Suchanek,et al.  AMIE: association rule mining under incomplete evidence in ontological knowledge bases , 2013, WWW.

[14]  Wenhan Xiong,et al.  DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning , 2017, EMNLP.

[15]  Seyed Mehran Kazemi,et al.  SimplE Embedding for Link Prediction in Knowledge Graphs , 2018, NeurIPS.

[16]  Jianfeng Gao,et al.  Embedding Entities and Relations for Learning and Inference in Knowledge Bases , 2014, ICLR.