Performance modeling for dynamic Bayesian networks

In recent decades, Bayesian Network (BN) has shown its power to solve probabilistic inference problems because of its expressive representation of dependence relationships among random variables and the dramatic development of inference algorithms. They have been applied for decision under uncertainty in many areas such as data fusion, target recognition, and medical diagnosis, etc. In general, the problem of probabilistic inference for a dynamic BN is to compute the posterior probability distribution of a specific variable of interest given a set of observations cumulated over time. The accuracy of the resulting posterior probability distribution is essential since the correct decision in any partially observable environment depends on this distribution. However, there is no general evaluation methodology available to predict the inference performance for a BN other than extensive Monte Carlo simulation methods. In this paper, we first present a method to model the inference performance for a static BN. This approximate method is designed to predict the inference performance analytically without extensive simulation. We then propose a sequential simulation method based on the particle filter concept to evaluate the inference performance for a dynamic BN. The specific model we deal with is the hybrid partial dynamic BN consists of discrete and continuous variables with arbitrary relationships. Since no exact inference algorithm available for such a model, we use likelihood weighting (LW) method on an unrolled DBN to estimate its true performance bound for comparison with the predicted performance. Comparison and analysis of the experimental results show the potential capability of the sequential simulation method for evaluating the performance of dynamic Bayesian networks.

[1]  Stuart J. Russell,et al.  Stochastic simulation algorithms for dynamic probabilistic networks , 1995, UAI.

[2]  Max Henrion,et al.  Propagating uncertainty in bayesian networks by probabilistic logic sampling , 1986, UAI.

[3]  Uri Lerner,et al.  Hybrid Bayesian networks for reasoning about complex systems , 2002 .

[4]  Bruce D'Ambrosio,et al.  Real-Time Inference with Large-Scale Temporal Bayes Nets , 2002, UAI.

[5]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Daphne Koller,et al.  Nonuniform Dynamic Discretization in Hybrid Networks , 1997, UAI.

[7]  Ian T. Nabney,et al.  Netlab: Algorithms for Pattern Recognition , 2002 .

[8]  Uri Lerner,et al.  Inference in Hybrid Networks: Theoretical Limits and Practical Algorithms , 2001, UAI.

[9]  Xavier Boyen,et al.  Tractable Inference for Complex Stochastic Processes , 1998, UAI.

[10]  Kuo-Chu Chang,et al.  Weighing and Integrating Evidence for Stochastic Simulation in Bayesian Networks , 2013, UAI.

[11]  Ross D. Shachter,et al.  Simulation Approaches to General Probabilistic Inference on Belief Networks , 2013, UAI.

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[13]  S. Lauritzen Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models , 1992 .

[14]  Uffe Kjærulff,et al.  A Computational Scheme for Reasoning in Dynamic Probabilistic Networks , 1992, UAI.

[15]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[16]  A. Doucet On sequential Monte Carlo methods for Bayesian filtering , 1998 .