Ordering Variables for Weighted Model Integration

State-of-the-art probabilistic inference algorithms, such as variable elimination and search-based approaches, rely heavily on the order in which variables are marginalized. Finding the optimal ordering is an NPcomplete problem. This computational hardness has led to heuristics to find adequate variable orderings. However, these heuristics have mostly been targeting discrete random variables. We show how variable ordering heuristics from the discrete domain can be ported to the discrete-continuous domain. We equip the state-of-the-art F-XSDD(BR) solver for discrete-continuous problems with such heuristics. Additionally, we propose a novel heuristic called bottom-up min-fill (BU-MiF), yielding a solver capable of determining good variable orderings without having to rely on the user to provide such an ordering. We empirically demonstrate its performance on a set of benchmark problems.

[1]  Adnan Darwiche,et al.  Modeling and Reasoning with Bayesian Networks , 2009 .

[2]  Jean-Louis Imbert About Redundant Inequalities Generated by Fourier's Algorithm , 1990, AIMSA.

[3]  Luc De Raedt,et al.  How to Exploit Structure while Solving Weighted Model Integration Problems , 2019, UAI.

[4]  Leslie G. Valiant,et al.  The Complexity of Computing the Permanent , 1979, Theor. Comput. Sci..

[5]  Andrea Passerini,et al.  Efficient Weighted Model Integration via SMT-Based Predicate Abstraction , 2017, IJCAI.

[6]  Uue Kjjrull Triangulation of Graphs { Algorithms Giving Small Total State Space Triangulation of Graphs { Algorithms Giving Small Total State Space , 1990 .

[7]  Rina Dechter,et al.  Bucket Elimination: A Unifying Framework for Reasoning , 1999, Artif. Intell..

[8]  Sagar Chaki,et al.  Decision diagrams for linear arithmetic , 2009, 2009 Formal Methods in Computer-Aided Design.

[9]  Andrew Gelfand,et al.  Pushing the Power of Stochastic Greedy Ordering Schemes for Inference in Graphical Models , 2011, AAAI.

[10]  Adnan Darwiche,et al.  On probabilistic inference by weighted model counting , 2008, Artif. Intell..

[11]  Guy Van den Broeck,et al.  Efficient Search-Based Weighted Model Integration , 2019, UAI.

[12]  Adnan Darwiche,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence SDD: A New Canonical Representation of Propositional Knowledge Bases , 2022 .

[13]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[14]  Pierre Marquis,et al.  A Knowledge Compilation Map , 2002, J. Artif. Intell. Res..

[15]  Judea Pearl,et al.  Reverend Bayes on Inference Engines: A Distributed Hierarchical Approach , 1982, AAAI.

[16]  Adnan Darwiche,et al.  New Compilation Languages Based on Structured Decomposability , 2008, AAAI.

[17]  Nevin L. Zhang,et al.  A simple approach to Bayesian network computations , 1994 .

[18]  Rina Dechter Reasoning with Probabilistic and Deterministic Graphical Models: Exact Algorithms , 2013, Reasoning with Probabilistic and Deterministic Graphical Models: Exact Algorithms.

[19]  Stefan Arnborg,et al.  Efficient algorithms for combinatorial problems on graphs with bounded decomposability — A survey , 1985, BIT.

[20]  Randal E. Bryant,et al.  Graph-Based Algorithms for Boolean Function Manipulation , 1986, IEEE Transactions on Computers.

[21]  Guy Van den Broeck,et al.  Probabilistic Inference in Hybrid Domains by Weighted Model Integration , 2015, IJCAI.

[22]  Luc De Raedt,et al.  The pywmi Framework and Toolbox for Probabilistic Inference using Weighted Model Integration , 2019, IJCAI.

[23]  Scott Sanner,et al.  Efficient Symbolic Integration for Probabilistic Inference , 2018, IJCAI.

[24]  Luc De Raedt,et al.  Exact and Approximate Weighted Model Integration with Probability Density Functions Using Knowledge Compilation , 2019, AAAI.