Approximating Conditional MTE Distributions by Means of Mixed Trees

Mixtures of truncated exponential (MTE) distributions have been shown to be a powerful alternative to discretisation within the framework of Bayesian networks. One of the features of the MTE model is that standard propagation algorithms as Shenoy-Shafer and Lazy propagation can be used. Estimating conditional MTE densities from data is a rather difficult problem since, as far as we know, such densities cannot be expressed in parametric form in the general case. In the univariate case, regression-based estimators have been successfully employed. In this paper, we propose a method to estimate conditional MTE densities using mixed trees, which are graphical structures similar to classification trees. Criteria for selecting the variables during the construction of the tree and for pruning the leaves are defined in terms of the mean square error and entropy-like measures.

[1]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Michael Clarke,et al.  Symbolic and Quantitative Approaches to Reasoning and Uncertainty , 1991, Lecture Notes in Computer Science.

[3]  Daphne Koller,et al.  Nonuniform Dynamic Discretization in Hybrid Networks , 1997, UAI.

[4]  Anders L. Madsen,et al.  LAZY Propagation: A Junction Tree Inference Algorithm Based on Lazy Evaluation , 1999, Artif. Intell..

[5]  S. Lauritzen.  Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models , 1992 .

[6]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[7]  Serafín Moral,et al.  Estimating Mixtures of Truncated Exponentials from Data , 2002, Probabilistic Graphical Models.

[8]  A. Salmerón,et al.  Importance sampling in Bayesian networks using probability trees , 2000 .

[9]  Serafín Moral,et al.  Penniless propagation in join trees , 2000 .

[10]  Steffen L. Lauritzen,et al.  Bayesian updating in causal probabilistic networks by local computations , 1990 .

[11]  Kristian G. Olesen,et al.  Causal Probabilistic Networks with Both Discrete and Continuous Variables , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Serafín Moral,et al.  Mixtures of Truncated Exponentials in Hybrid Bayesian Networks , 2001, ECSQARU.

[13]  Prakash P. Shenoy,et al.  Axioms for probability and belief-function proagation , 1990, UAI.

[14]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.