A Three-Way Model for Collective Learning on Multi-Relational Data

Relational learning is becoming increasingly important in many areas of application. Here, we present a novel approach to relational learning based on the factorization of a three-way tensor. We show that unlike other tensor approaches, our method is able to perform collective learning via the latent components of the model and provide an efficient algorithm to compute the factorization. We substantiate our theoretical considerations regarding the collective learning capabilities of our model by the means of experiments on both a new dataset and a dataset commonly used in entity resolution. Furthermore, we show on common benchmark datasets that our approach achieves better or on-par results, if compared to current state-of-the-art relational learning solutions, while it is significantly faster to compute.

[1]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[2]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[3]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[4]  Andrew McCallum,et al.  Introduction to Statistical Relational Learning , 2007 .

[5]  Tamara G. Kolda,et al.  Temporal Analysis of Semantic Graphs Using ASALSAN , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[6]  Thomas L. Griffiths,et al.  Learning Systems of Concepts with an Infinite Relational Model , 2006, AAAI.

[7]  Pedro M. Domingos,et al.  Statistical predicate invention , 2007, ICML '07.

[8]  Pedro M. Domingos,et al.  Entity Resolution with Markov Logic , 2006, Sixth International Conference on Data Mining (ICDM'06).

[9]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[10]  Joshua B. Tenenbaum,et al.  Modelling Relational Data using Bayesian Clustered Tensor Factorization , 2009, NIPS.

[11]  Steffen Staab,et al.  TripleRank: Ranking Semantic Web Data by Tensor Decomposition , 2009, SEMWEB.

[12]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[13]  R. Harshman,et al.  PARAFAC: parallel factor analysis , 1994 .

[14]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[15]  Hans-Peter Kriegel,et al.  Infinite Hidden Relational Models , 2006, UAI.

[16]  Jimeng Sun,et al.  Beyond streams and graphs: dynamic tensor analysis , 2006, KDD '06.

[17]  Ben Taskar,et al.  Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) , 2007 .

[18]  Hans-Peter Kriegel,et al.  Multivariate Prediction for Learning on the Semantic Web , 2010, ILP.

[19]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.