A New Bounding Scheme for Influence Diagrams

Influence diagrams provide a modeling and inference framework for sequential decision problems, representing the probabilistic knowledge by a Bayesian network and the preferences of an agent by utility functions over the random variables and decision variables. Computing the maximum expected utility (MEU) and the optimizing policy is exponential in the constrained induced width and therefore is notoriously difficult for larger models. In this paper, we develop a new bounding scheme for MEU that applies partitioning based approximations on top of the decomposition scheme called a multi-operator cluster DAG for influence diagrams that is more sensitive to the underlying structure of the model than the classical join-tree decomposition of influence diagrams. Our bounding scheme utilizes a cost-shifting mechanism to tighten the bound further. We demonstrate the effectiveness of the proposed scheme on various hard benchmarks.

[1]  Frank Jensen,et al.  From Influence Diagrams to junction Trees , 1994, UAI.

[2]  Denis Deratani Mauá,et al.  Solving Limited Memory Influence Diagrams , 2011, J. Artif. Intell. Res..

[3]  Rina Dechter,et al.  A New Perspective on Algorithms for Optimizing Policies under Uncertainty , 2000, AIPS.

[4]  Qiang Liu,et al.  Bounding the Partition Function using Holder's Inequality , 2011, ICML.

[5]  Rina Dechter,et al.  An Anytime Approximation For Optimizing Policies Under Uncertainty , 2000 .

[6]  Qiang Liu,et al.  Belief Propagation for Structured Decision Making , 2012, UAI.

[7]  Prakash P. Shenoy,et al.  Axioms for probability and belief-function proagation , 1990, UAI.

[8]  Rina Dechter,et al.  Join Graph Decomposition Bounds for Influence Diagrams , 2018, UAI.

[9]  Serafín Moral Divergence Measures and Approximate Algorithms for Valuation Based Systems , 2018, IPMU.

[10]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[11]  Wei Ping,et al.  Decomposition Bounds for Marginal MAP , 2015, NIPS.

[12]  Thomas Schiex,et al.  Sequential Decision-Making Problems - Representation and Solution , 2009 .

[13]  Thomas Schiex,et al.  From Influence Diagrams to Multi-operator Cluster DAGs , 2006, UAI.

[14]  Rina Dechter,et al.  A Weighted Mini-Bucket Bound for Solving Influence Diagram , 2019, UAI.

[15]  Rina Dechter,et al.  AND/OR Search for Marginal MAP , 2014, UAI.

[16]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[17]  Shobha Venkataraman,et al.  Efficient Solution Algorithms for Factored MDPs , 2003, J. Artif. Intell. Res..

[18]  Ross D. Shachter,et al.  Dynamic programming and influence diagrams , 1990, IEEE Trans. Syst. Man Cybern..

[19]  Rina Dechter,et al.  Mini-buckets: a general scheme for approximating inference , 2002 .

[20]  Lars Otten,et al.  Join-graph based cost-shifting schemes , 2012, UAI.

[21]  Prakash P. Shenoy,et al.  Valuation-Based Systems for Bayesian Decision Analysis , 1992, Oper. Res..

[22]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[23]  Michael C. Horsch,et al.  An Anytime Algorithm for Decision Making under Uncertainty , 1998, UAI.