Propagation in CLG Bayesian networks based on semantic modeling

In this paper, we propose a new algorithm based on semantic model for inference in CLG Bayesian networks which is strongly inspired by the architecture of Madsen (in, Int J Approx Reason 49:503–521, 2008). By performing semantic modeling before physical computation, the proposed algorithm takes advantage of the semantic knowledge induced by the structure of the graph and the evidence. Thus, iteration between semantic modeling and physical computation can be avoided. Also,the presented architecture can exploit some remaining independencies in the relevant potentials which were ignored by the previous architecture. The correctness of the proposed algorithm has been proved and the resulting benefits are illustrated by examples. The results indicate a significant potential in semantic knowledge.

[1]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[2]  Anders L. Madsen,et al.  LAZY Propagation: A Junction Tree Inference Algorithm Based on Lazy Evaluation , 1999, Artif. Intell..

[3]  A.L. Madsen,et al.  Variations over the message computation algorithm of lazy propagation , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Rafael Rumí,et al.  Approximate probability propagation with mixtures of truncated exponentials , 2007, Int. J. Approx. Reason..

[5]  Uri Lerner,et al.  Exact Inference in Networks with Discrete Children of Continuous Parents , 2001, UAI.

[6]  Rafael Rumí,et al.  Aalborg Universitet Inference in hybrid Bayesian networks , 2016 .

[7]  Prakash P. Shenoy.  Inference in Hybrid Bayesian Networks Using Mixtures of Gaussians , 2006, UAI.

[8]  Yan Wu,et al.  VC dimension and inner product space induced by Bayesian networks , 2009, Int. J. Approx. Reason..

[9]  Prakash P. Shenoy,et al.  Operations for inference in continuous Bayesian networks with linear deterministic variables , 2006, Int. J. Approx. Reason..

[10]  Dan Wu,et al.  On the implication problem for probabilistic conditional independency , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[11]  Steffen L. Lauritzen,et al.  Stable local computation with conditional Gaussian distributions , 2001, Stat. Comput..

[12]  Anders L. Madsen,et al.  Belief update in CLG Bayesian networks with lazy propagation , 2006, Int. J. Approx. Reason..

[13]  S. Lauritzen.  Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models , 1992 .

[14]  James F. Baldwin,et al.  An approach to hybrid probabilistic models , 2008, Int. J. Approx. Reason..

[15]  Cory J. Butz,et al.  A simple graphical approach for understanding probabilistic inference in Bayesian networks , 2009, Inf. Sci..

[16]  Prakash P. Shenoy,et al.  Inference in hybrid Bayesian networks with mixtures of truncated exponentials , 2006, Int. J. Approx. Reason..

[17]  Rafael Rumí,et al.  Learning hybrid Bayesian networks using mixtures of truncated exponentials , 2006, Int. J. Approx. Reason..

[18]  Robert G. Cowell,et al.  Local Propagation in Conditional Gaussian Bayesian Networks , 2005, J. Mach. Learn. Res..

[19]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[20]  F. J. Díez,et al.  Operating with potentials of discrete variables , 2007, Int. J. Approx. Reason..

[21]  Cory J. Butz,et al.  A join tree probability propagation architecture for semantic modeling , 2009, Journal of Intelligent Information Systems.

[22]  Judea Pearl,et al.  Chapter 2 – BAYESIAN INFERENCE , 1988 .

[23]  Youlong Yang,et al.  Inner Product Space and Concept Classes Induced by Bayesian Networks , 2009 .