Building Rule Hierarchies for Efficient Logical Rule Learning from Knowledge Graphs

Many systems have been developed in recent years to mine logical rules from large-scale Knowledge Graphs (KGs), on the grounds that representing regularities as rules enables both the interpretable inference of new facts, and the explanation of known facts. Among these systems, the walk-based methods that generate the instantiated rules containing constants by abstracting sampled paths in KGs demonstrate strong predictive performance and expressivity. However, due to the large volume of possible rules, these systems do not scale well where computational resources are often wasted on generating and evaluating unpromising rules. In this work, we address such scalability issues by proposing new methods for pruning unpromising rules using rule hierarchies. The approach consists of two phases. Firstly, since rule hierarchies are not readily available in walk-based methods, we have built a Rule Hierarchy Framework (RHF), which leverages a collection of subsumption frameworks to build a proper rule hierarchy from a set of learned rules. And secondly, we adapt RHF to an existing rule learner where we design and implement two methods for Hierarchical Pruning (HPMs), which utilize the generated hierarchies to remove irrelevant and redundant rules. Through experiments over four public benchmark datasets, we show that the application of HPMs is effective in removing unpromising rules, which leads to significant reductions in the runtime as well as in the number of learned rules, without compromising the predictive performance.

[1]  Pasquale Minervini,et al.  Convolutional 2D Knowledge Graph Embeddings , 2017, AAAI.

[2]  Paolo Papotti,et al.  Robust Discovery of Positive and Negative Rules in Knowledge Bases , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[3]  Heiner Stuckenschmidt,et al.  Fine-Grained Evaluation of Rule- and Embedding-Based Systems for Knowledge Graph Completion , 2018, SEMWEB.

[4]  Le Song,et al.  Variational Reasoning for Question Answering with Knowledge Graph , 2017, AAAI.

[5]  Heiner Stuckenschmidt,et al.  Anytime Bottom-Up Rule Learning for Knowledge Graph Completion , 2019, IJCAI.

[6]  Heiko Paulheim,et al.  Feature Selection in Hierarchical Feature Spaces , 2014, Discovery Science.

[7]  Yang Chen,et al.  Ontological Pathfinding : Mining First-Order Knowledge from Large Knowledge Bases , 2016 .

[8]  Fabian M. Suchanek,et al.  Fast rule mining in ontological knowledge bases with AMIE+\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$+$$\end{docu , 2015, The VLDB Journal.

[9]  Michèle Sebag,et al.  Fast Theta-Subsumption with Constraint Satisfaction Algorithms , 2004, Machine Learning.

[10]  Paolo Rosso,et al.  Knowledge Graph Embeddings , 2019, Encyclopedia of Big Data Technologies.

[11]  Danqi Chen,et al.  Observed versus latent features for knowledge base and text inference , 2015, CVSC.

[12]  Yulong Gu,et al.  Towards Learning Instantiated Logical Rules from Knowledge Graphs , 2020 .

[13]  Wenhan Xiong,et al.  DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning , 2017, EMNLP.

[14]  Ni Lao,et al.  Learning Relational Features with Backward Random Walks , 2015, ACL.

[15]  Praveen Paritosh,et al.  Freebase: a collaboratively created graph database for structuring human knowledge , 2008, SIGMOD Conference.

[16]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[17]  Matthias Samwald,et al.  OpenBioLink: a benchmarking framework for large-scale biomedical link prediction , 2020, Bioinform..

[18]  Evgeny Kharlamov,et al.  Rule Learning from Knowledge Graphs Guided by Embedding Models , 2018, SEMWEB.

[19]  Jignesh M. Patel,et al.  QuickFOIL: Scalable Inductive Logic Programming , 2014, Proc. VLDB Endow..

[20]  Gerhard Weikum,et al.  ExFaKT: A Framework for Explaining Facts over Knowledge Graphs and Text , 2019, WSDM.