An Algebraic Graphical Model for Decision with Uncertainties, Feasibilities, and Utilities

Numerous formalisms and dedicated algorithms have been designed in the last decades to model and solve decision making problems. Some formalisms, such as constraint networks, can express "simple" decision problems, while others are designed to take into account uncertainties, unfeasible decisions, and utilities. Even in a single formalism, several variants are often proposed to model different types of uncertainty (probability, possibility...) or utility (additive or not). In this article, we introduce an algebraic graphical model that encompasses a large number of such formalisms: (1) we first adapt previous structures from Friedman, Chu and Halpern for representing uncertainty, utility, and expected utility in order to deal with generic forms of sequential decision making; (2) on these structures, we then introduce composite graphical models that express information via variables linked by "local" functions, thanks to conditional independence; (3) on these graphical models, we finally define a simple class of queries which can represent various scenarios in terms of observabilities and controllabilities. A natural decision-tree semantics for such queries is completed by an equivalent operational semantics, which induces generic algorithms. The proposed framework, called the Plausibility-Feasibility-Utility (PFU) framework, not only provides a better understanding of the links between existing formalisms, but it also covers yet unpublished frameworks (such as possibilistic influence diagrams) and unifies formalisms such as quantified boolean formulas and influence diagrams. Our backtrack and variable elimination generic algorithms are a first step towards unified algorithms.

[1]  Wolfgang Spohn,et al.  A general non-probabilistic theory of inductive reasoning , 2013, UAI.

[2]  Rina Dechter,et al.  Hybrid Processing of Beliefs and Constraints , 2001, UAI.

[3]  Joseph Y. Halpern,et al.  Great Expectations. Part II: Generalized Expected Utility as a Universal Decision Rule , 2003, IJCAI.

[4]  Thomas Schiex,et al.  Semiring-Based CSPs and Valued CSPs: Frameworks, Properties, and Comparison , 1999, Constraints.

[5]  Pierre Ndilikilikesha,et al.  Potential influence diagrams , 1994, Int. J. Approx. Reason..

[6]  Robert P. Goldman,et al.  Expressive Planning and Explicit Knowledge , 1996, AIPS.

[7]  Thomas Schiex,et al.  Decision with Uncertainties, Feasibilities, and Utilities: Towards a Unified Algebraic Framework , 2006, ECAI.

[8]  Jürg Kohlas Information algebras - generic structures for inference , 2003, Discrete mathematics and theoretical computer science.

[9]  Prakash P. Shenoy,et al.  Conditional independence in valuation-based systems , 1994, Int. J. Approx. Reason..

[10]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[11]  Ronen I. Brafman,et al.  CP-nets: A Tool for Representing and Reasoning withConditional Ceteris Paribus Preference Statements , 2011, J. Artif. Intell. Res..

[12]  Phan Hong Giang,et al.  A Qualitative Linear Utility Theory for Spohn's Theory of Epistemic Beliefs , 2000, UAI.

[13]  D. Schmeidler Subjective Probability and Expected Utility without Additivity , 1989 .

[14]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[15]  Rina Dechter,et al.  Mixtures of Deterministic-Probabilistic Networks and their AND/OR Search Space , 2004, UAI.

[16]  Patrice Perny,et al.  Algebraic Markov Decision Processes , 2005, IJCAI.

[17]  Joseph Y. Halpern,et al.  Plausibility Measures: A User's Guide , 1995, UAI.

[18]  Joseph Y. Halpern Conditional Plausibility Measures and Bayesian Networks , 2000, UAI.

[19]  Adnan Darwiche,et al.  Recursive conditioning , 2001, Artif. Intell..

[20]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..

[21]  Nicholas Kushmerick,et al.  An Algorithm for Probabilistic Planning , 1995, Artif. Intell..

[22]  Prakash P. Shenoy,et al.  Sequential influence diagrams: A unified asymmetry framework , 2006, Int. J. Approx. Reason..

[23]  Finn Verner Jensen,et al.  Unconstrained Influence Diagrams , 2002, UAI.

[24]  Eric Monfroy,et al.  Beyond NP: Arc-Consistency for Quantified Constraints , 2002, CP.

[25]  Rina Dechter,et al.  Topological parameters for time-space tradeoff , 1996, Artif. Intell..

[26]  Prakash P. Shenoy,et al.  Valuation-Based Systems for Bayesian Decision Analysis , 1992, Oper. Res..

[27]  Philippe Jégou,et al.  Hybrid backtracking bounded by tree-decomposition of constraint networks , 2003, Artif. Intell..

[28]  Thomas Schiex,et al.  Decomposition of Multi-operator Queries on Semiring-Based Graphical Models , 2006, CP.

[29]  Emil Weydert,et al.  General Belief Measures , 1994, UAI.

[30]  Didier Dubois,et al.  Possibility Theory as a Basis for Qualitative Decision Theory , 1995, IJCAI.

[31]  Steffen L. Lauritzen,et al.  Representing and Solving Decision Problems with Limited Information , 2001, Manag. Sci..

[32]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[33]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[34]  Thomas Schiex,et al.  On the Complexity of Compact Coalitional Games , 2009, IJCAI.

[35]  Craig Boutilier,et al.  Context-Specific Independence in Bayesian Networks , 1996, UAI.

[36]  Riza Demirer,et al.  Sequential Valuation Networks: A New Graphical Technique for Asymmetric Decision Problems , 2001, ECSQARU.

[37]  Thomas Schiex,et al.  Mixed Constraint Satisfaction: A Framework for Decision Problems under Incomplete Knowledge , 1996, AAAI/IAAI, Vol. 1.

[38]  Thomas D. Nielsen,et al.  Representing and Solving Asymmetric Decision Problems , 2003, Int. J. Inf. Technol. Decis. Mak..

[39]  Henry A. Kautz,et al.  Performing Bayesian Inference by Weighted Model Counting , 2005, AAAI.

[40]  Henry A. Kautz,et al.  Solving Bayesian Networks by Weighted Model Counting , 2005 .

[41]  M. Frydenberg The chain graph Markov property , 1990 .

[42]  Alan K. Mackworth Consistency in Networks of Relations , 1977, Artif. Intell..

[43]  Hans L. Bodlaender,et al.  Treewidth: Algorithmic Techniques and Results , 1997, MFCS.

[44]  James E. Smith,et al.  Structuring Conditional Relationships in Influence Diagrams , 1993, Oper. Res..

[45]  Rina Dechter,et al.  Bucket Elimination: A Unifying Framework for Reasoning , 1999, Artif. Intell..

[46]  Enrico Macii,et al.  Algebraic decision diagrams and their applications , 1993, Proceedings of 1993 International Conference on Computer Aided Design (ICCAD).

[47]  Shlomo Zilberstein,et al.  Great Expectations. Part I: On the Customizability of Generalized Expected Utility , 2003, IJCAI.

[48]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[49]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[50]  Stefan Edelkamp,et al.  Automated Planning: Theory and Practice , 2007, Künstliche Intell..

[51]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[52]  Nic Wilson,et al.  An Order of Magnitude Calculus , 1995, UAI.

[53]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[54]  Fahiem Bacchus,et al.  Graphical models for preference and utility , 1995, UAI.

[55]  J. Neumann,et al.  The Theory of Games and Economic Behaviour , 1944 .

[56]  Phan Hong Giang,et al.  Two axiomatic approaches to decision making using possibility theory , 2005, Eur. J. Oper. Res..

[57]  Prakash P. Shenoy,et al.  Valuation network representation and solution of asymmetric decision problems , 2000, Eur. J. Oper. Res..

[58]  Joseph Y. Halpern Reasoning about uncertainty , 2003 .

[59]  Craig Boutilier,et al.  Stochastic dynamic programming with factored representations , 2000, Artif. Intell..

[60]  Prakash P. Shenoy Valuation-based systems for discrete optimisation , 1990, UAI.

[61]  Umberto Bertelè,et al.  Nonserial Dynamic Programming , 1972 .

[62]  Anil K. Jain,et al.  Markov random fields : theory and application , 1993 .

[63]  Patrice Perny,et al.  Qualitative Models for Decision Under Uncertainty without the Commensurability Assumption , 1999, UAI.

[64]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[65]  Régis Sabbadin,et al.  A Possibilistic Model for Qualitative Sequential Decision Problems under Uncertainty in Partially Observable Environments , 1999, UAI.

[66]  Toby Walsh,et al.  Stochastic Constraint Programming , 2002, ECAI.

[67]  Toniann Pitassi,et al.  Stochastic Boolean Satisfiability , 2001, Journal of Automated Reasoning.

[68]  Matthew L. Ginsberg,et al.  A Symbolic Generalization of Probability Theory , 1992, AAAI.

[69]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .