How to Exploit Parametric Uniformity for Maximum Entropy Reasoning in a Relational Probabilistic Logic

The relational probabilistic conditional logic FO-PCL employs the principle of maximum entropy (ME). We show that parametric uniformity of an FO-PCL knowledge base $\mathcal R$ can be exploited for solving the optimization problem required for ME reasoning more efficiently. The original ME optimization problem containing a large number of linear constraints, one for each ground instance of a conditional, can be replaced by an optimization problem containing just one linear constraint for each conditional. We show that both optimization problems have the same ME distribution as solution. An implementation employing Generalized Iterative Scaling illustrates the benefits of our approach

[1]  Marc Finthammer,et al.  An integrated development environment for probabilistic relational reasoning , 2012, Log. J. IGPL.

[2]  Ofer Meshi,et al.  Template Based Inference in Symmetric Relational Markov Random Fields , 2007, UAI.

[3]  Leslie Pack Kaelbling,et al.  Lifted Probabilistic Inference with Counting Formulas , 2008, AAAI.

[4]  Gabriele Kern-Isberner,et al.  Conditionals in Nonmonotonic Reasoning and Belief Revision: Considering Conditionals as Agents , 2001 .

[5]  Gabriele Kern-Isberner,et al.  Characterizing the Principle of Minimum Cross-Entropy Within a Conditional-Logical Framework , 1998, Artif. Intell..

[6]  Jens Fisseler,et al.  First-order probabilistic conditional logic and maximum entropy , 2012, Log. J. IGPL.

[7]  Christoph Beierle,et al.  On Lifted Inference for a Relational Probabilistic Conditional Logic with Maximum Entropy Semantics , 2012, FoIKS.

[8]  J. Darroch,et al.  Generalized Iterative Scaling for Log-Linear Models , 1972 .

[9]  Thomas Lukasiewicz,et al.  Combining probabilistic logic programming with the power of maximum entropy , 2004, Artif. Intell..

[10]  J. Paris The Uncertain Reasoner's Companion: A Mathematical Perspective , 1994 .

[11]  Joseph Y. Halpern Reasoning about uncertainty , 2003 .

[12]  Gabriele Kern-Isberner,et al.  Conditionals in Nonmonotonic Reasoning and Belief Revision , 2001, Lecture Notes in Computer Science.

[13]  Christoph Beierle,et al.  Using Equivalences of Worlds for Aggregation Semantics of Relational Conditionals , 2012, KI.

[14]  James P. Delgrande,et al.  On First-Order Conditional Logics , 1998, Artif. Intell..

[15]  David Poole,et al.  First-order probabilistic inference , 2003, IJCAI.

[16]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[17]  Gabriele Kern-Isberner,et al.  Novel Semantical Approaches to Relational Probabilistic Conditionals , 2010, KR.

[18]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Dan Roth,et al.  Lifted First-Order Probabilistic Inference , 2005, IJCAI.

[20]  Marc Finthammer An Iterative Scaling Algorithm for Maximum Entropy Reasoning in Relational Probabilistic Conditional Logic , 2012, SUM.

[21]  Thomas Lukasiewicz Proceedings of the 7th International Symposium on the Foundations of Information and Knowledge Systems‚ FoIKS 2012‚ Kiel‚ Germany‚ March 5−9‚ 2012 , 2000 .