Error Estimation in Approximate Bayesian Belief Network Inference

We can perform inference in Bayesian belief networks by enumerating instantiations with high probability thus approximating the marginals. In this paper, we present a method for determining the fraction of instantiations that has to be considered such that the absolute error in the marginals does not exceed a predefined value. The method is based on extreme value theory. Essentially, the proposed method uses the reversed generalized Pareto distribution to model probabilities of instantiations below a given threshold. Based on this distribution, an estimate of the maximal absolute error if instantiations with probability smaller than u are disregarded can be made.

[1]  Joseph L. Gastwirth,et al.  A General Definition of the Lorenz Curve , 1971 .

[2]  G F Cooper,et al.  Algorithms for Bayesian Belief-Network Precomputation , 1991, Methods of Information in Medicine.

[3]  P. Rousseeuw.  Least Median of Squares Regression , 1984 .

[4]  Marek J. Druzdzel,et al.  Some Properties of joint Probability Distributions , 1994, UAI.

[5]  Duangkamon Chotikapanich,et al.  A comparison of alternative functional forms for the Lorenz curve , 1993 .

[6]  J. Pickands.  Statistical Inference Using Extreme Order Statistics , 1975 .

[7]  C. Robertson,et al.  Generating Ordered Families of Lorenz Curves by Strongly Unimodal Distributions , 1987 .

[8]  Enrique F. Castillo,et al.  A modified simulation scheme for inference in Bayesian networks , 1996, Int. J. Approx. Reason..

[9]  A. Hadi,et al.  A method for estimating parameters and quantiles of distributions of continuous random variables , 1995 .

[10]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[11]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[12]  J. Angus.  Extreme Value Theory in Engineering , 1990 .

[13]  Remco R. Bouckaert,et al.  A Stratified Simulation Scheme for Inference in Bayesian Belief Networks , 1994, UAI.

[14]  Ali S. Hadi,et al.  Parameter and quantile estimation for the generalized extreme‐value distribution , 1994 .

[15]  Uffe Kjærulff,et al.  Reduction of Computational Complexity in Bayesian Networks Through Removal of Weak Dependences , 1994, UAI.

[16]  Eugene Santos,et al.  Belief Updating by Enumerating High-Probability Independence-based Assignments , 1994, UAI.

[17]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .