Parameter learning for relational Bayesian networks

We present a method for parameter learning in relational Bayesian networks (RBNs). Our approach consists of compiling the RBN model into a computation graph for the likelihood function, and to use this likelihood graph to perform the necessary computations for a gradient ascent likelihood optimization procedure. The method can be applied to all RBN models that only contain differentiable combining rules. This includes models with non-decomposable combining rules, as well as models with weighted combinations or nested occurrences of combining rules. Experimental results on artificial random graph data explores the feasibility of the approach both for complete and incomplete data.

[1]  Luc De Raedt,et al.  Probabilistic logic learning , 2003, SKDD.

[2]  G. Unter Rote.  Path Problems in Graphs , 1989 .

[3]  Taisuke Sato,et al.  A Statistical Learning Method for Logic Programs with Distribution Semantics , 1995, ICLP.

[4]  Luc De Raedt,et al.  Towards Combining Inductive Logic Programming with Bayesian Networks , 2001, ILP.

[5]  S. Muggleton.  Stochastic Logic Programs , 1996 .

[6]  Stuart J. Russell,et al.  BLOG: Probabilistic Models with Unknown Objects , 2005, IJCAI.

[7]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[8]  Thomas G. Dietterich,et al.  Learning first-order probabilistic models with combining rules , 2005, Annals of Mathematics and Artificial Intelligence.

[9]  Daphne Koller,et al.  Probabilistic reasoning for complex systems , 1999 .

[10]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[11]  Manfred Jaeger,et al.  Relational Bayesian Networks , 1997, UAI.

[12]  Kristian Kersting,et al.  An inductive logic programming approach to statistical relational learning , 2006, AI Commun..

[13]  Avi Pfeffer,et al.  Learning Probabilities for Noisy First-Order Rules , 1997, IJCAI.

[14]  G. Rote.  Path Problems in Graphs , 1990 .

[15]  Peter Haddawy,et al.  Probabilistic Logic Programming and Bayesian Networks , 1995, ASIAN.

[16]  Manfred Jaeger,et al.  Complex Probabilistic Modeling with Recursive Relational Bayesian Networks , 2001, Annals of Mathematics and Artificial Intelligence.

[17]  Stuart J. Russell,et al.  Adaptive Probabilistic Networks with Hidden Variables , 1997, Machine Learning.