Efficient inference for hybrid dynamic Bayesian networks

This paper is a revision of a paper presented at the SPIE conference on Signal Processing, Senior Fusion, and Target Recognition XII, Aug. 2004, Orlando, Florida. The paper presented there appears (unrefereed) in SPIE Proceedings Vol. 5429. Bayesian networks for static as well as for dynamic cases have been the subject of a great deal of theoretical analysis and practical inference-algorithm development in the research community of artificial intelligence, machine learning, and pattern recognition. After summarizing the well-known theory of discrete and continuous Bayesian networks, we introduce an efficient reasoning scheme into hybrid Bayesian networks. In addition to illustrating the similarities between the dynamic Bayesian networks and the Kalman filter, we present a computationally efficient approach for the inference problem of hybrid dynamic Bayesian networks (HDBNs). The proposed method is based on the separation of the dynamic and static nodes, and subsequent hypercubic partitions via the decision tree algorithm. Experiments show that with high statistical confidence the novel algorithm used in the HDBN performs favorably in the trade-offs of computational complexity and accuracy performance, compared to other exact and approximate methods for applications with uncertainty in a dynamic system.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Uffe Kjærulff,et al.  A Computational Scheme for Reasoning in Dynamic Probabilistic Networks , 1992, UAI.

[3]  Wei Sun,et al.  Comparing probabilistic inference for mixed Bayesian networks , 2003, SPIE Defense + Commercial Sensing.

[4]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Xavier Boyen,et al.  Tractable Inference for Complex Stochastic Processes , 1998, UAI.

[6]  Michael P. Wellman,et al.  Real-world applications of Bayesian networks , 1995, CACM.

[7]  Gonzalo Martínez-Muñoz,et al.  Using all data to generate decision tree ensembles , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[9]  Ross D. Shachter,et al.  Mixtures of Gaussians and Minimum Relative Entropy Techniques for Modeling Continuous Uncertainties , 1993, UAI.

[10]  Daphne Koller,et al.  Nonuniform Dynamic Discretization in Hybrid Networks , 1997, UAI.