Strategy Selection in Influence Diagrams using Imprecise Probabilities

This paper describes a new algorithm to solve the decision making problem in Influence Diagrams based on algorithms for credal networks. Decision nodes are associated to imprecise probability distributions and a reformulation is introduced that finds the global maximum strategy with respect to the expected utility. We work with Limited Memory Influence Diagrams, which generalize most Influence Diagram proposals and handle simultaneous decisions. Besides the global optimum method, we explore an anytime approximate solution with a guaranteed maximum error and show that imprecise probabilities are handled in a straightforward way. Complexity issues and experiments with random diagrams and an effects-based military planning problem are discussed.

[1]  F. Cozman,et al.  Inference in Credal Networks Through Integer Programming , 2007 .

[2]  Marco Zaffalon,et al.  Decision-theoretic specification of credal networks: A unified language for uncertain modeling with sets of Bayesian networks , 2008, Int. J. Approx. Reason..

[3]  David L. Poole,et al.  A NEW METHOD FOR INFLUENCE DIAGRAM EVALUATION , 1993, Comput. Intell..

[4]  Nevin Lianwen Zhang,et al.  Stepwise-Decomposable Influence Diagrams , 1992, KR.

[5]  Nevin Lianwen Zhang,et al.  Probabilistic Inference in Influence Diagrams , 1998, Comput. Intell..

[6]  Fabio Gagliardi Cozman,et al.  Inference in credal networks using multilinear programming , 2004 .

[7]  Fabio Gagliardi Cozman,et al.  Separation Properties of Sets of Probability Measures , 2000, UAI.

[8]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[9]  Frank Jensen,et al.  From Influence Diagrams to junction Trees , 1994, UAI.

[10]  Paul K. Davis,et al.  Effects-Based Operations (EBO): A Grand Challenge for the Analytical Community , 2006 .

[11]  D. Deptula Effects-Based Operations , 2006 .

[12]  Fabio Gagliardi Cozman,et al.  The Inferential Complexity of Bayesian and Credal Networks , 2005, IJCAI.

[13]  P. Walley,et al.  A survey of concepts of independence for imprecise probabilities , 2000 .

[14]  Qiang Ji,et al.  A factorization approach to evaluating simultaneous influence diagrams , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Steffen L. Lauritzen,et al.  Representing and Solving Decision Problems with Limited Information , 2001, Manag. Sci..

[16]  Luis M. de Campos,et al.  Independence Concepts for Convex Sets of Probabilities , 1995, UAI.

[17]  Fabio Gagliardi Cozman,et al.  Credal networks , 2000, Artif. Intell..

[18]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[19]  Enrico Fagiuoli,et al.  2U: An Exact Interval Propagation Algorithm for Polytrees with Binary Variables , 1998, Artif. Intell..

[20]  A. Darwiche,et al.  Complexity Results and Approximation Strategies for MAP Explanations , 2011, J. Artif. Intell. Res..