Lifted Inference Seen from the Other Side : The Tractable Features

Lifted Inference algorithms for representations that combine first-order logic and graphical models have been the focus of much recent research. All lifted algorithms developed to date are based on the same underlying idea: take a standard probabilistic inference algorithm (e.g., variable elimination, belief propagation etc.) and improve its efficiency by exploiting repeated structure in the first-order model. In this paper, we propose an approach from the other side in that we use techniques from logic for probabilistic inference. In particular, we define a set of rules that look only at the logical representation to identify models for which exact efficient inference is possible. Our rules yield new tractable classes that could not be solved efficiently by any of the existing techniques.

[1]  Rina Dechter,et al.  Bucket Elimination: A Unifying Framework for Reasoning , 1999, Artif. Intell..

[2]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[3]  Ben Taskar,et al.  Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) , 2007 .

[4]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[5]  Pedro M. Domingos,et al.  Markov Logic: An Interface Layer for Artificial Intelligence , 2009, Markov Logic: An Interface Layer for Artificial Intelligence.

[6]  Pedro M. Domingos,et al.  Lifted First-Order Belief Propagation , 2008, AAAI.

[7]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[8]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[9]  Matthew Richardson,et al.  Markov Logic , 2008, Probabilistic Inductive Logic Programming.

[10]  David Poole,et al.  First-order probabilistic inference , 2003, IJCAI.

[11]  Dan Suciu,et al.  Management of probabilistic data: foundations and challenges , 2007, PODS '07.

[12]  Ben Taskar,et al.  Introduction to statistical relational learning , 2007 .

[13]  John W. Lloyd,et al.  Probabilistic modelling, inference and learning using logical theories , 2008, Annals of Mathematics and Artificial Intelligence.

[14]  Nevin L. Zhang,et al.  A simple approach to Bayesian network computations , 1994 .

[15]  Leslie Pack Kaelbling,et al.  Lifted Probabilistic Inference with Counting Formulas , 2008, AAAI.

[16]  Dan Suciu,et al.  Computing query probability with incidence algebras , 2010, PODS '10.

[17]  Dan Roth,et al.  Lifted First-Order Probabilistic Inference , 2005, IJCAI.