Lifted inference for probabilistic logic programs

First-order model counting emerged recently as a novel reasoning task, at the core of efficient algorithms for probabilistic logics such as MLNs. For certain subsets of first-order logic, lifted model counters were shown to run in time polynomial in the number of objects in the domain of discourse, where propositional model counters require exponential time. However, these guarantees apply only to Skolem normal form theories (i.e., no existential quantifiers). Since textbook Skolemization is not sound for model counting, these restrictions precluded efficient model counting for directed models, such as probabilistic logic programs, which rely on existential quantification. Recently, we presented a novel Skolemization algorithm for model counting problems that eliminates existential quantifiers from a first-order logic theory without changing its weighted model count. Our Skolemization procedure extends the applicability of first-order model counters to probabilistic logic programming. For the first time, this enables lifted inference with these representations.

[1]  Andrew McCallum,et al.  Introduction to Statistical Relational Learning , 2007 .

[2]  Tomi Janhunen,et al.  Representing Normal Programs with Clauses , 2004, ECAI.

[3]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[4]  Luc De Raedt,et al.  Lifted Probabilistic Inference by First-Order Knowledge Compilation , 2011, IJCAI.

[5]  Fabio Gagliardi Cozman,et al.  Axiomatizing Noisy-OR , 2004, ECAI.

[6]  Pedro M. Domingos,et al.  Probabilistic theorem proving , 2011, UAI.

[7]  Taisuke Sato,et al.  A Statistical Learning Method for Logic Programs with Distribution Semantics , 1995, ICLP.

[8]  Guy Van den Broeck,et al.  Liftability of Probabilistic Inference: Upper and Lower Bounds , 2012 .

[9]  Guy Van den Broeck,et al.  Skolemization for Weighted First-Order Model Counting , 2013, KR.

[10]  Guy Van den Broeck,et al.  Lifted Generative Parameter Learning , 2013, StarAI@AAAI.

[11]  David Poole,et al.  First-order probabilistic inference , 2003, IJCAI.

[12]  Keith L. Clark,et al.  Negation as Failure , 1987, Logic and Data Bases.

[13]  Guy Van den Broeck On the Completeness of First-Order Knowledge Compilation for Lifted Probabilistic Inference , 2011, NIPS.

[14]  Francisco Javier Díez,et al.  Efficient computation for the noisy MAX , 2003, Int. J. Intell. Syst..

[15]  Luc De Raedt,et al.  Inference in Probabilistic Logic Programs using Weighted CNF's , 2011, UAI.

[16]  Manfred Jaeger,et al.  Relational Bayesian Networks , 1997, UAI.

[17]  Manfred Jaeger,et al.  Compiling relational Bayesian networks for exact inference , 2006, Int. J. Approx. Reason..

[18]  Luc De Raedt,et al.  Inference and learning in probabilistic logic programs using weighted Boolean formulas , 2013, Theory and Practice of Logic Programming.

[19]  Henry A. Kautz,et al.  Solving Bayesian Networks by Weighted Model Counting , 2005 .

[20]  David Poole,et al.  Lifted Aggregation in Directed First-Order Probabilistic Models , 2009, IJCAI.

[21]  Luc De Raedt,et al.  Probabilistic Inductive Logic Programming - Theory and Applications , 2008, Probabilistic Inductive Logic Programming.

[22]  Luc De Raedt,et al.  ProbLog: A Probabilistic Prolog and its Application in Link Discovery , 2007, IJCAI.

[23]  Adnan Darwiche,et al.  A Logical Approach to Factoring Belief Networks , 2002, KR.