Generalized loopy 2U: A new algorithm for approximate inference in credal networks

Credal networks generalize Bayesian networks by relaxing the requirement of precision of probabilities. Credal networks are considerably more expressive than Bayesian networks, but this makes belief updating NP-hard even on polytrees. We develop a new efficient algorithm for approximate belief updating in credal networks. The algorithm is based on an important representation result we prove for general credal networks: that any credal network can be equivalently reformulated as a credal network with binary variables; moreover, the transformation, which is considerably more complex than in the Bayesian case, can be implemented in polynomial time. The equivalent binary credal network is then updated by L2U, a loopy approximate algorithm for binary credal networks. Overall, we generalize L2U to non-binary credal networks, obtaining a scalable algorithm for the general case, which is approximate only because of its loopy nature. The accuracy of the inferences with respect to other state-of-the-art algorithms is evaluated by extensive numerical tests.

[1]  F. Cozman,et al.  Inference in Credal Networks Through Integer Programming , 2007 .

[2]  Fabio Gagliardi Cozman,et al.  Inference in Polytrees with Sets of Probabilities , 2002, UAI.

[3]  Stuart J. Russell,et al.  Adaptive Probabilistic Networks with Hidden Variables , 1997, Machine Learning.

[4]  Fabio Gagliardi Cozman,et al.  The Inferential Complexity of Bayesian and Credal Networks , 2005, IJCAI.

[5]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[6]  Fabio Gagliardi Cozman,et al.  IPE and L2U: approximate algorithms for credal networks , 2004 .

[7]  Enrico Fagiuoli,et al.  2U: An Exact Interval Propagation Algorithm for Polytrees with Binary Variables , 1998, Artif. Intell..

[8]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[9]  Marco Zaffalon,et al.  Decision-theoretic specification of credal networks: A unified language for uncertain modeling with sets of Bayesian networks , 2008, Int. J. Approx. Reason..

[10]  Fabio Gagliardi Cozman,et al.  Binarization Algorithms for Approximate Updating in Credal Nets , 2006, STAIRS.

[11]  P. Walley Statistical Reasoning with Imprecise Probabilities , 1990 .

[12]  Fabio Gagliardi Cozman,et al.  Graphical models for imprecise probabilities , 2005, Int. J. Approx. Reason..

[13]  Serafín Moral,et al.  Hill-climbing and branch-and-bound algorithms for exact and approximate inference in credal networks , 2007, Int. J. Approx. Reason..

[14]  Janneke H. Bolt,et al.  Bayesian Networks: Aspects of Approximate Inference , 2008 .