Probabilistic Sentential Decision Diagrams

We propose the Probabilistic Sentential Decision Diagram (PSDD): A complete and canonical representation of probability distributions defined over the models of a given propositional theory. Each parameter of a PSDD can be viewed as the (conditional) probability of making a decision in a corresponding Sentential Decision Diagram (SDD). The SDD itself is a recently proposed complete and canonical representation of propositional theories. We explore a number of interesting properties of PSDDs, including the independencies that underlie them. We show that the PSDD is a tractable representation. We further show how the parameters of a PSDD can be efficiently estimated, in closed form, from complete data. We empirically evaluate the quality of PS-DDs learned from data, when we have knowledge, a priori, of the domain logical constraints.

[1]  Adnan Darwiche,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence SDD: A New Canonical Representation of Propositional Knowledge Bases , 2022 .

[2]  Adnan Darwiche,et al.  Basing Decisions on Sentences in Decision Diagrams , 2012, AAAI.

[3]  Manfred Jaeger,et al.  Probabilistic Decision Graphs - Combining Verification And Ai Techniques For Probabilistic Inference , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[4]  Adnan Darwiche,et al.  A Logical Approach to Factoring Belief Networks , 2002, KR.

[5]  Pedro M. Domingos,et al.  Bottom-Up Learning of Markov Network Structure , 2010, ICML.

[6]  Vibhav Gogate,et al.  SampleSearch: A Scheme that Searches for Consistent Samples , 2007, AISTATS.

[7]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[8]  Ben Taskar,et al.  Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) , 2007 .

[9]  Daniel Lowd,et al.  Learning Markov Networks With Arithmetic Circuits , 2013, AISTATS.

[10]  R. I. Bahar,et al.  Algebraic decision diagrams and their applications , 1993, Proceedings of 1993 International Conference on Computer Aided Design (ICCAD).

[11]  Andrew McCallum,et al.  Introduction to Statistical Relational Learning , 2007 .

[12]  Rina Dechter,et al.  Mixed deterministic and probabilistic networks , 2008, Annals of Mathematics and Artificial Intelligence.

[13]  Pedro M. Domingos,et al.  Sum-product networks: A new deep architecture , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[14]  Adnan Darwiche,et al.  Modeling and Reasoning with Bayesian Networks , 2009 .

[15]  Luc De Raedt,et al.  Lifted Probabilistic Inference by First-Order Knowledge Compilation , 2011, IJCAI.

[16]  Adnan Darwiche,et al.  Dynamic Minimization of Sentential Decision Diagrams , 2013, AAAI.

[17]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[18]  David Poole,et al.  First-order probabilistic inference , 2003, IJCAI.

[19]  Ben Taskar,et al.  Introduction to statistical relational learning , 2007 .

[20]  Nils J. Nilsson,et al.  Probabilistic Logic * , 2022 .

[21]  Ming-Wei Chang,et al.  Learning and Inference with Constraints , 2008, AAAI.

[22]  Craig Boutilier,et al.  Context-Specific Independence in Bayesian Networks , 1996, UAI.

[23]  Scott Sanner,et al.  Affine Algebraic Decision Diagrams (AADDs) and their Application to Structured Probabilistic Inference , 2005, IJCAI.

[24]  Manfred Jaeger,et al.  Compiling relational Bayesian networks for exact inference , 2006, Int. J. Approx. Reason..

[25]  Yung-Te Lai,et al.  Edge-valued binary decision diagrams for multi-level hierarchical verification , 1992, DAC '92.

[26]  Luc De Raedt,et al.  Probabilistic Inductive Logic Programming - Theory and Applications , 2008, Probabilistic Inductive Logic Programming.

[27]  Luc De Raedt,et al.  Inference in Probabilistic Logic Programs using Weighted CNF's , 2011, UAI.

[28]  Oded Maler,et al.  On the Representation of Probabilities over Structured Domains , 1999, CAV.

[29]  Joseph Y. Halpern.  An Analysis of First-Order Logics of Probability , 1989, IJCAI.

[30]  Manfred Jaeger,et al.  Learning probabilistic decision graphs , 2006, Int. J. Approx. Reason..

[31]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[32]  Adnan Darwiche,et al.  New Compilation Languages Based on Structured Decomposability , 2008, AAAI.

[33]  Pedro M. Domingos,et al.  Sound and Efficient Inference with Probabilistic and Deterministic Dependencies , 2006, AAAI.