On state-space abstraction for anytime evaluation of Bayesian networks

Despite the increasing popularity of Bayesian networks for representing and reasoning about uncertain situations, the complexity of inference in this formalism remains a significant concern. A viable approach to relieving the problem is trading off accuracy for computational efficiency. To this end, varying the granularity of state space of state variables appears to be a feasible strategy for controlling the evaluation process. We consider an anytime procedure for approximate evaluation of Bayesian networks based on this idea. On application to some simple networks, the procedure exhibits a smooth improvement in approximation quality as computation time increases. With the aim of developing principled control techniques, we also conduct a theoretical analysis of the quality of approximation. Our main result demonstrates that the error induced by state-space abstraction deceases with the distance from the abstracted nodes, where "distance" is defined in terms of d-separation. While the empirical results suggest that incremental state-space abstraction offers a viable performance profile, the theoretical results represent a starting point for the deliberation scheduling of our anytime approximation method.

[1]  Kuo-Chu Chang,et al.  Refinement and coarsening of Bayesian networks , 1990, UAI.

[2]  A. Saffiotti,et al.  Inference-Driven Construction of Valuation Systems from First-Order Clauses , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[3]  Eric Horvitz,et al.  Bounded Conditioning: Flexible Inference for Decisions under Scarce Resources , 2013, UAI 1989.

[4]  Robert P. Goldman,et al.  From knowledge bases to decision models , 1992, The Knowledge Engineering Review.

[5]  Max Henrion,et al.  Efficient Estimation of the Value of Information in Monte Carlo Models , 1994, UAI.

[6]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[7]  Ann E. Nicholson,et al.  Dynamic Belief Networks for Discrete Monitoring , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[8]  Gregory M. Provan,et al.  Abstraction in Belief Networks: The Role of Intermediate States in Diagnostic Reasoning , 1995, UAI.

[9]  Eric Horvitz,et al.  Ideal reformulation of belief networks , 1990, UAI.

[10]  Gregory Provan,et al.  Tradeoffs in Knowledge-Based Construction of Probabilistic Models , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[11]  J. N. R. Jeffers,et al.  Graphical Models in Applied Multivariate Statistics. , 1990 .

[12]  Richard E. Neapolitan,et al.  Probabilistic reasoning in expert systems - theory and algorithms , 2012 .

[13]  Eric Horvitz,et al.  Utility-Based Abstraction and Categorization , 1993, UAI.

[14]  Robert P. Goldman,et al.  A Language for Construction of Belief Networks , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  John S. Breese,et al.  CONSTRUCTION OF BELIEF AND DECISION NETWORKS , 1992, Comput. Intell..

[16]  Michael P. Wellman,et al.  State-Space Abstraction for Anytime Evaluation of Probabilistic Networks , 1994, UAI.

[17]  Mark S. Boddy,et al.  Deliberation Scheduling for Problem Solving in Time-Constrained Environments , 1994, Artif. Intell..

[18]  Uffe Kjærulff,et al.  Reduction of Computational Complexity in Bayesian Networks Through Removal of Weak Dependences , 1994, UAI.

[19]  Bruce D'Ambrosio,et al.  Incremental Probabilistic Inference , 1993, UAI.

[20]  Frank Jensen,et al.  Approximations in Bayesian Belief Universe for Knowledge Based Systems , 2013, UAI 1990.

[21]  Denise Draper,et al.  Localized Partial Evaluation of Belief Networks , 1994, UAI.

[22]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[23]  R. Martin Chavez,et al.  Approximating Probabilistic Inference in Bayesian Belief Networks , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Eugene Charniak,et al.  Bayesian Networks without Tears , 1991, AI Mag..

[25]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.