Efficient Representation and Fusion of Hybrid Joint Densities for Clusters in Nonlinear Hybrid Bayesian Networks

Undirected cycles in Bayesian networks are often treated by using clustering methods. This results in networks with nodes characterized by joint probability densities instead of marginal densities. An efficient representation of these hybrid joint densities is essential especially in nonlinear hybrid net works containing continuous as well as discrete variables. In this article we present a unified representation of continuous, discrete, and hybrid joint densities. This representation is based on Gaussian and Dirac mixtures and allows for analytic evaluation of arbitrary hybrid networks without loosing structural in formation, even for networks containing clusters. Furthermore we derive update formulae for marginal and joint densities from a system theoretic point of view by treating a Bayesian network as a system of cascaded subsystems. Together with the presented mixture representation of densities this yields an exact analytic updating scheme

[1]  Kevin P. Murphy,et al.  A Variational Approximation for Bayesian Networks with Discrete and Continuous Latent Variables , 1999, UAI.

[2]  Bayesian network model for data incest in a distributed sensor network , 2004 .

[3]  Uri Lerner,et al.  Exact Inference in Networks with Discrete Children of Continuous Parents , 2001, UAI.

[4]  Darryl Morrell,et al.  Implementation of Continuous Bayesian Networks Using Sums of Weighted Gaussians , 1995, UAI.

[5]  Uwe D. Hanebeck,et al.  A New Approach for Hybrid Bayesian Networks Using Full Densities , 2004 .

[6]  Qiang Ji,et al.  Active information fusion for decision making under uncertainty , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[7]  Michael I. Jordan.  Graphical Models , 2003 .

[8]  N. Wermuth,et al.  Graphical Models for Associations between Variables, some of which are Qualitative and some Quantitative , 1989 .

[9]  Clayton T. Morrison,et al.  A Bayesian Blackboard for Information Fusion , 2004 .

[10]  H. Loeliger.  An Introduction to factor graphs - Signal Processing Magazine, IEEE , 2001 .

[11]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[12]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Process. Mag..

[13]  O. C. Schrempf,et al.  Evaluation of hybrid Bayesian networks using analytical density representations , 2005 .

[14]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.