Belief updating in Bayesian networks by using a criterion of minimum time

Variable elimination (VE) and clustering algorithms (CAs) are two widely used algorithms for exact inference in Bayesian networks. Both the problem of finding an optimal variable elimination ordering in VE and the problem of finding an optimal graph triangulation in CAs are NP-complete, although greedy algorithms work well in practice. Usually, VE selects the next variable to be eliminated such that a new potential of minimum size is generated during the elimination process. CAs create a variable elimination sequence in order to triangulate the moral graph; usually, the next variable to be eliminated is selected such that a new clique of minimum size is created during the elimination process. This paper presents an approach which makes use of a criterion of minimum time (CMT) for the selection of the next variable to be eliminated in VE or in CAs, and compares its performance with that of the traditional approaches using a criterion of minimum size. The results show that, in general, the CMT introduced in this paper allows inference time to be reduced. Results regarding memory requirements are also reported.

[1]  Adnan Darwiche,et al.  Inference in belief networks: A procedural guide , 1996, Int. J. Approx. Reason..

[2]  Pedro Larrañaga,et al.  Decomposing Bayesian networks: triangulation of the moral graph with genetic algorithms , 1997, Stat. Comput..

[3]  Kristian G. Olesen,et al.  HUGIN - a Shell for Building Belief Universes for Expert Systems , 1989, IJCAI 1989.

[4]  Anders L. Madsen,et al.  Lazy Propagation in Junction Trees , 1998, UAI.

[5]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[6]  Serafín Moral,et al.  Heuristic Algorithms for the Triangulation of Graphs , 1994, IPMU.

[7]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[8]  F. Cozman,et al.  Generalizing variable elimination in Bayesian networks , 2000 .

[9]  Prakash P. Shenoy,et al.  Valuation-Based Systems for Bayesian Decision Analysis , 1992, Oper. Res..

[10]  Anders L. Madsen,et al.  LAZY Propagation: A Junction Tree Inference Algorithm Based on Lazy Evaluation , 1999, Artif. Intell..

[11]  Ross D. Shachter Bayes-Ball: The Rational Pastime (for Determining Irrelevance and Requisite Information in Belief Networks and Influence Diagrams) , 1998, UAI.

[12]  Nevin Lianwen Zhang,et al.  Exploiting Causal Independence in Bayesian Network Inference , 1996, J. Artif. Intell. Res..

[13]  Rina Dechter,et al.  Bucket elimination: A unifying framework for probabilistic inference , 1996, UAI.

[14]  José Manuel Gutiérrez,et al.  Expert Systems and Probabiistic Network Models , 1996 .

[15]  Kristian G. Olesen,et al.  HUGIN - A Shell for Building Bayesian Belief Universes for Expert Systems , 1989, IJCAI.

[16]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[17]  Derek G. Corneil,et al.  Complexity of finding embeddings in a k -tree , 1987 .

[18]  Francisco Javier Díez,et al.  Efficient computation for the noisy MAX , 2003, Int. J. Intell. Syst..

[19]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[20]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[21]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[22]  Ronald A. Howard,et al.  Readings on the Principles and Applications of Decision Analysis , 1989 .

[23]  Jose Miguel Puerta,et al.  Searching for the best elimination sequence in Bayesian networks by using ant colony optimization , 2002, Pattern Recognit. Lett..

[24]  José A. Gámez,et al.  Triangulation of Bayesian networks by retriangulation , 2003, Int. J. Intell. Syst..

[25]  Dan Geiger,et al.  Identifying independence in bayesian networks , 1990, Networks.

[26]  Enrique F. Castillo,et al.  Expert Systems and Probabilistic Network Models , 1996, Monographs in Computer Science.

[27]  Uue Kjjrull Triangulation of Graphs { Algorithms Giving Small Total State Space Triangulation of Graphs { Algorithms Giving Small Total State Space , 1990 .