An Embedding-Based Approach to Rule Learning in Knowledge Graphs

It is natural and effective to use rules for representing explicit knowledge in knowledge graphs. However, it is challenging to learn rules automatically from very large knowledge graphs such as Freebase and YAGO. This paper presents a new approach, RLvLR (Rule Learning via Learning Representations), to learning rules from large knowledge graphs by using the technique of embedding in representation learning together with a new sampling method. Based on RLvLR, a new method RLvLR-Stream is developed for learning rules from streams of knowledge graphs. Both RLvLR and RLvLR-Stream have been implemented and experiments conducted to validate the proposed methods regarding the tasks of rule learning and link prediction. Experimental results show that our systems are able to handle the task of rule learning from large knowledge graphs with high accuracy and outperform some state-of-the-art systems. Specifically, for massive knowledge graphs with hundreds of predicates and over 10M facts, RLvLR is much faster and can learn much more quality rules than major systems for rule learning in knowledge graphs such as AMIE+. In the setting of knowledge graph streams, RLvLR-Stream significantly improved RLvLR for both rule learning and link prediction.

[1]  Stephen Muggleton,et al.  Learning from Positive Data , 1996, Inductive Logic Programming Workshop.

[2]  Gerhard Weikum,et al.  WWW 2007 / Track: Semantic Web Session: Ontologies ABSTRACT YAGO: A Core of Semantic Knowledge , 2022 .

[3]  Miguel E. Rodríguez,et al.  Temporal Reasoning Over Event Knowledge Graphs , 2018 .

[4]  Heiner Stuckenschmidt,et al.  Marrying Uncertainty and Time in Knowledge Graphs , 2017, AAAI.

[5]  Kewen Wang,et al.  Scalable Rule Learning via Learning Representation , 2018, IJCAI.

[6]  Jianfeng Gao,et al.  Embedding Entities and Relations for Learning and Inference in Knowledge Bases , 2014, ICLR.

[7]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[8]  Jignesh M. Patel,et al.  QuickFOIL: Scalable Inductive Logic Programming , 2014, Proc. VLDB Endow..

[9]  Paolo Papotti,et al.  RuDiK: Rule Discovery in Knowledge Bases , 2018, Proc. VLDB Endow..

[10]  Evgeniy Gabrilovich,et al.  A Review of Relational Machine Learning for Knowledge Graphs , 2015, Proceedings of the IEEE.

[11]  Praveen Paritosh,et al.  Freebase: a collaboratively created graph database for structuring human knowledge , 2008, SIGMOD Conference.

[12]  Daisy Zhe Wang,et al.  ScaLeKB: scalable learning and inference over large knowledge bases , 2016, The VLDB Journal.

[13]  Johannes Fürnkranz,et al.  Foundations of Rule Learning , 2012, Cognitive Technologies.

[14]  Tom M. Mitchell,et al.  Efficient and Expressive Knowledge Base Completion Using Subgraph Feature Extraction , 2015, EMNLP.

[15]  Le Song,et al.  Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphs , 2017, ICML.

[16]  Jon A. Willits,et al.  Models of Semantic Memory , 2015 .

[17]  Stephen Muggleton,et al.  Inverse entailment and progol , 1995, New Generation Computing.

[18]  Markus Krötzsch,et al.  Wikidata , 2014, Commun. ACM.

[19]  Boris Motik,et al.  Stream Reasoning in Temporal Datalog , 2017, AAAI.

[20]  Markus Krötzsch,et al.  Wikidata , 2014 .

[21]  Markus Krötzsch,et al.  Logic on MARS: Ontologies for Generalised Property Graphs , 2017, IJCAI.

[22]  Ming-Wei Chang,et al.  Traversing Knowledge Graph in Vector Space without Symbolic Space Guidance , 2016 .

[23]  Danqi Chen,et al.  Observed versus latent features for knowledge base and text inference , 2015, CVSC.

[24]  Alexander Artikis,et al.  Incremental learning of event definitions with Inductive Logic Programming , 2014, Machine Learning.

[25]  Fan Yang,et al.  Differentiable Learning of Logical Rules for Knowledge Base Reasoning , 2017, NIPS.

[26]  Jens Lehmann,et al.  DBpedia: A Nucleus for a Web of Open Data , 2007, ISWC/ASWC.

[27]  Thomas Eiter,et al.  LARS: A Logic-Based Framework for Analyzing Reasoning over Streams , 2015, AAAI.

[28]  Hans-Peter Kriegel,et al.  A Three-Way Model for Collective Learning on Multi-Relational Data , 2011, ICML.

[29]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[30]  Evgeny Kharlamov,et al.  Rule Learning from Knowledge Graphs Guided by Embedding Models , 2018, SEMWEB.

[31]  Juan-Zi Li,et al.  RDF2Rules: Learning Rules from RDF Knowledge Bases by Mining Frequent Predicate Cycles , 2015, ArXiv.

[32]  Qing Liu,et al.  SWARM: An Approach for Mining Semantic Association Rules from Semantic Web Data , 2016, PRICAI.

[33]  Fabian M. Suchanek,et al.  Fast rule mining in ontological knowledge bases with AMIE+\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$+$$\end{docu , 2015, The VLDB Journal.

[34]  Lorenzo Rosasco,et al.  Holographic Embeddings of Knowledge Graphs , 2015, AAAI.

[35]  Andrew McCallum,et al.  Compositional Vector Space Models for Knowledge Base Inference , 2015, AAAI Spring Symposia.