Anytime Decision Making Based on Unconstrained Influence Diagrams

Unconstrained influence diagrams extend the language of influence diagrams to cope with decision problems in which the order of the decisions is unspecified. Thus, when solving an unconstrained influence diagram, we not only look for an optimal policy for each decision but also for a so‐called step policy specifying the next decision given the observations made so far. However, due to the complexity of the problem, temporal constraints can force the decision maker to act before the solution algorithm has finished and, in particular, before an optimal policy for the first decision has been computed. This paper addresses this problem by proposing an anytime algorithm that at any time provides a qualified recommendation for the first decisions of the problem. The algorithm performs a heuristic‐based search in a decision tree representation of the problem. We provide a framework for analyzing the performance of the algorithm, and experiments based on this framework indicate that the proposed algorithm performs significantly better under time constraints than dynamic programming.

[1]  David L. Poole,et al.  A NEW METHOD FOR INFLUENCE DIAGRAM EVALUATION , 1993, Comput. Intell..

[2]  Frank Jensen,et al.  From Influence Diagrams to junction Trees , 1994, UAI.

[3]  Ronald A. Howard,et al.  Readings on the Principles and Applications of Decision Analysis , 1989 .

[4]  F. Díez,et al.  A decision support-system for the mediastinal staging of non-small cell lung cancer , 2011 .

[5]  Eric Horvitz,et al.  Time-Critical Action: Representations and Application , 1997, UAI.

[6]  Changhe Yuan,et al.  Solving Multistage Influence Diagrams using Branch-and-Bound Search , 2010, UAI.

[7]  Michael C. Horsch,et al.  An Anytime Algorithm for Decision Making under Uncertainty , 1998, UAI.

[8]  Scott M. Olmsted.  On representing and solving decision problems , 1983 .

[9]  Radu Marinescu.  A New Approach to Influence Diagrams Evaluation , 2009, SGAI Conf..

[10]  Ross D. Shachter.  Evaluating Influence Diagrams , 1986, Oper. Res..

[11]  Elvira: An Environment for Creating and Using Probabilistic Graphical Models , 2002, Probabilistic Graphical Models.

[12]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Prakash P. Shenoy,et al.  Valuation-Based Systems for Bayesian Decision Analysis , 1992, Oper. Res..

[14]  Howard Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[15]  Anders L. Madsen,et al.  Lazy Evaluation of Symmetric Bayesian Decision Problems , 1999, UAI.

[16]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[17]  Ramón López de Mántaras,et al.  Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence (1994) , 2013, ArXiv.

[18]  Finn Verner Jensen,et al.  Unconstrained Influence Diagrams , 2002, UAI.

[19]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[20]  M. Gallego.  Probabilistic graphical models for decision making in medicine , 2009 .

[21]  Marek J. Druzdzel,et al.  An Efficient Exhaustive Anytime Sampling Algorithm for Influence Diagrams , 2007 .

[22]  C. Bielza,et al.  A Graphical Decision-Theoretic Model for Neonatal Jaundice , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.