On Conditioning in Multidimensional Probabilistic Models

Graphical Markov models, and above all Bayesian networks have become a very popular tool for multidimensional probability distribution representation and processing. The technique making computation with several hundred dimensional probability distribution possible was suggested by Lauritzen and Spiegelhalter. However, to employ it one has to transform a Bayesian network into a decomposable model. This is because decomposable models (or more precisely their building blocks, i.e., their low-dimensional marginals) can be reordered in many ways, so that each variable can be placed at the beginning of the model. It is not difficult to show that there is a much wider class of models possessing this property. In compositional models theory we call these models flexible. It is the widest class of models for which one can always restructure the model in the way that any variable can appear at the beginning of the model. But until recently it had been an open problem whether this class of models is closed under conditioning; i.e., whether a conditional of a flexible model is again flexible. In the paper we will show that this property holds true, which proves the importance of flexible models for practical applications.

[1]  Radim Jiroušek,et al.  Brief Introduction to Probabilistic Compositional Models , 2013 .

[2]  Anders L. Madsen,et al.  The Hugin Tool for Probabilistic Graphical Models , 2005, Int. J. Artif. Intell. Tools.

[3]  Radim Jirousek Decomposition of Multidimensional Distributions Represented by Perfect Sequences , 2004, Annals of Mathematics and Artificial Intelligence.

[4]  Judea Pearl,et al.  Reverend Bayes on Inference Engines: A Distributed Hierarchical Approach , 1982, AAAI.

[5]  Prakash P. Shenoy,et al.  Axioms for probability and belief-function proagation , 1990, UAI.

[6]  Francesco M. Malvestuto,et al.  Equivalence of compositional expressions and independence relations in compositional models , 2014, Kybernetika.

[7]  Anders L. Madsen,et al.  Hugin - The Tool for Bayesian Networks and Influence Diagrams , 2002, Probabilistic Graphical Models.

[8]  Catriel Beeri,et al.  On the Desirability of Acyclic Database Schemes , 1983, JACM.

[9]  Václav Kratochvíl,et al.  Foundations of compositional models: structural properties , 2015, Int. J. Gen. Syst..

[10]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[11]  Radim Jirousek,et al.  Marginalization in multidimensional compositional models , 2006, Kybernetika.

[12]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[13]  Ross D. Shachter Probabilistic Inference and Influence Diagrams , 1988, Oper. Res..

[14]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[15]  Radim Jirousek Brief Introduction to Causal Compositional Models , 2016, Causal Inference in Econometrics.

[16]  Francesco M. Malvestuto,et al.  Marginalization in models generated by compositional expressions , 2015, Kybernetika.

[17]  Radim Jirousek,et al.  Local computations in Dempster-Shafer theory of evidence , 2012, Int. J. Approx. Reason..

[18]  Radim Jirousek,et al.  Foundations of compositional model theory , 2011, Int. J. Gen. Syst..

[19]  A. P. Dawid,et al.  Applications of a general propagation algorithm for probabilistic expert systems , 1992 .

[20]  Radim Jirousek,et al.  On computations with causal compositional models , 2015, Kybernetika.

[21]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.