Modeling challenges with influence diagrams: Constructing probability and utility models

Influence diagrams have become a popular tool for representing and solving complex decision-making problems under uncertainty. In this paper, we focus on the task of building probability models from expert knowledge, and also on the challenging and less known task of constructing utility models in influence diagrams. Our goal is to review the state of the art and list some challenges. Similarly to probability models, which are embedded in influence diagrams as a Bayesian network, preferential/utility independence conditions can be used to factor the joint utility function into small factors and reduce the number of parameters needed to fully define the joint function. A number of graphical models have been recently proposed to factor the joint utility function, including the generalized additive independence networks, ceteris paribus networks, utility ceteris paribus networks, expected utility networks, and utility diagrams. Similarly to probability models, utility models can also be engineered from a domain expert or induced from data.

[1]  Khaled Mellouli,et al.  Qualitative possibilistic influence diagrams based on qualitative possibilistic utilities , 2009, Eur. J. Oper. Res..

[2]  Régis Sabbadin,et al.  Complexity results and algorithms for possibilistic influence diagrams , 2008, Artif. Intell..

[3]  Ronen I. Brafman,et al.  On Graphical Modeling of Preference and Importance , 2011, J. Artif. Intell. Res..

[4]  Thomas D. Nielsen,et al.  Sensitivity analysis in influence diagrams , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[5]  J. Wyatt Decision support systems. , 2000, Journal of the Royal Society of Medicine.

[6]  David Heckerman,et al.  Causal independence for probability assessment and inference using Bayesian networks , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Craig Boutilier,et al.  The Influence of Influence Diagrams on Artificial Intelligence , 2005, Decis. Anal..

[8]  Concha Bielza,et al.  Structural, elicitation and computational issues faced when solving complex decision making problems with influence diagrams , 2000, Comput. Oper. Res..

[9]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[10]  Francisco Javier Díez,et al.  Parameter adjustment in Bayes networks. The generalized noisy OR-gate , 1993, UAI.

[11]  Adrian F. M. Smith,et al.  Bayesian Statistics 5. , 1998 .

[12]  Daniel Zelterman,et al.  Bayesian Artificial Intelligence , 2005, Technometrics.

[13]  Peter Brusilovsky,et al.  Proceedings of the 9th international conference on User modeling , 2003 .

[14]  Max Henrion,et al.  Some Practical Issues in Constructing Belief Networks , 1987, UAI.

[15]  H. Kunreuther,et al.  Sources of Bias in Assessment Procedures for Utility Functions , 1982 .

[16]  Haiqin Wang,et al.  User Interface Tools for Navigation in Conditional Probability Tables and Elicitation of Probabilities in Bayesian Networks , 2000, UAI.

[17]  Yoav Shoham,et al.  Expected Utility Networks , 1999, UAI.

[18]  Andrés Cano,et al.  A forward-backward Monte Carlo method for solving influence diagrams , 2006, Int. J. Approx. Reason..

[19]  Rynson W. H. Lau,et al.  Knowledge and Data Engineering for e-Learning Special Issue of IEEE Transactions on Knowledge and Data Engineering , 2008 .

[20]  T. Maung on in C , 2010 .

[21]  Fahiem Bacchus,et al.  Graphical models for preference and utility , 1995, UAI.

[22]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Jon Doyle,et al.  Efficient utility functions for ceteris paribus preferences , 2002, AAAI/IAAI.

[24]  John S. Breese,et al.  Probability Intervals Over Influence Diagrams , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Peter Haddawy,et al.  Preference Elicitation via Theory Refinement , 2003, J. Mach. Learn. Res..

[26]  Leslie Pack Kaelbling,et al.  Sampling Methods for Action Selection in Influence Diagrams , 2000, AAAI/IAAI.

[27]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[28]  David Ríos Insua,et al.  Robust Bayesian analysis , 2000 .

[29]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[30]  Sampath Srinivas,et al.  A Generalization of the Noisy-Or Model , 1993, UAI.

[31]  John B. Kidd,et al.  Decisions with Multiple Objectives—Preferences and Value Tradeoffs , 1977 .

[32]  Prakash P. Shenoy,et al.  Multistage Monte Carlo Method for Solving Influence Diagrams Using Local Computation , 2004, Manag. Sci..

[33]  Silja Renooij,et al.  Probabilities for a probabilistic network: a case study in oesophageal cancer , 2002, Artif. Intell. Medicine.

[34]  Marek J. Druzdzel,et al.  A Probabilistic Causal Model for Diagnosis of Liver Disorders , 2005 .

[35]  Han-Ying Kao Diagnostic reasoning and medical decision-making with fuzzy influence diagrams , 2008, Comput. Methods Programs Biomed..

[36]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[37]  Concha Bielza,et al.  An Interactive Framework for Open Queries in Decision Support Systems , 2002, IBERAMIA.

[38]  Marek J. Druzdzel,et al.  Building Probabilistic Networks: "Where Do the Numbers Come From?" Guest Editors Introduction , 2000, IEEE Trans. Knowl. Data Eng..

[39]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[40]  Cari-Axel S Stael von Holstein,et al.  A Manual for Encoding Probability Distributions. , 1978 .

[41]  Michael C. Horsch,et al.  Estimating the Value of Computation in Flexible Information Refinement , 1999, UAI.

[42]  Eric J. Johnson,et al.  Bias in utility assessments: further evidence and explanations , 1989 .

[43]  Bill Ravens,et al.  An Introduction to Copulas , 2000, Technometrics.

[44]  C. Bielza,et al.  A Graphical Decision-Theoretic Model for Neonatal Jaundice , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[45]  Dennis M. Buede Influence Diagrams: A Practitioner's Perspective , 2005, Decis. Anal..

[46]  Fahiem Bacchus,et al.  Utility Independence in a Qualitative Decision Theory , 1996, KR.

[47]  Anders L. Madsen,et al.  Lazy Evaluation of Symmetric Bayesian Decision Problems , 1999, UAI.

[48]  Daphne Koller,et al.  Making Rational Decisions Using Adaptive Utility Elicitation , 2000, AAAI/IAAI.

[49]  Gregory F. Cooper,et al.  A Method for Using Belief Networks as Influence Diagrams , 2013, UAI 1988.

[50]  Ronen I. Brafman,et al.  Extended Semantics and Optimization Algorithms for CP‐Networks , 2004, Comput. Intell..

[51]  Daphne Koller,et al.  Utilities as Random Variables: Density Estimation and Structure Discovery , 2000, UAI.

[52]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[53]  Steffen L. Lauritzen,et al.  Representing and Solving Decision Problems with Limited Information , 2001, Manag. Sci..

[54]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[55]  Gregory M. Provan,et al.  Knowledge Engineering for Large Belief Networks , 1994, UAI.

[56]  Concha Bielza,et al.  Sensitivity Analysis in IctNeo , 2000 .

[57]  Ulrich Schmidt,et al.  A Measurement of the Certainty Effect. , 1998, Journal of mathematical psychology.

[58]  Mark R. McCord,et al.  Lottery Equivalents: Reduction of the Certainty Effect Problem in Utility Assessment , 1986 .

[59]  M. Kuppermann,et al.  Can Preference Scores for Discrete States Be Used to Derive Preference Scores for an Entire Path of Events? , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[60]  Jean-Yves Jaffray,et al.  Some experimental findings on decision making under risk and their implications , 1989 .

[61]  Ross D. Shachter,et al.  Representation and Analysis of Medical Decision Problems with Influence Diagrams , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[62]  Gordon B. Hazen,et al.  Sensitivity Analysis and the Expected Value of Perfect Information , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[63]  Stuart I. Herbert,et al.  Computer Methods and Programs in Biomedicine 48 (1995) 21-26 , 1995 .

[64]  Yacov Y. Haimes,et al.  Influence diagrams with multiple objectives and tradeoff analysis , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[65]  Ronen I. Brafman,et al.  UCP-Networks: A Directed Graphical Representation of Conditional Utilities , 2001, UAI.

[66]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[67]  A. Rosenfeld,et al.  IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS , 2022 .

[68]  Nic Wilson,et al.  Extending CP-Nets with Stronger Conditional Preference Statements , 2004, AAAI.

[69]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[70]  Peter A. Flach,et al.  Proceedings of the 28th International Conference on Machine Learning , 2011 .

[71]  Ross D. Shachter,et al.  Using Potential Influence Diagrams for Probabilistic Inference and Decision Making , 1993, UAI.

[72]  Blaz Zupan,et al.  A function-decomposition method for development of hierarchical multi-attribute decision models , 2004, Decis. Support Syst..

[73]  Ross D. Shachter,et al.  Dynamic programming and influence diagrams , 1990, IEEE Trans. Syst. Man Cybern..

[74]  Michael C. Horsch,et al.  An Anytime Algorithm for Decision Making under Uncertainty , 1998, UAI.

[75]  Patrice Perny,et al.  GAI Networks for Utility Elicitation , 2004, KR.

[77]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[78]  Nevin Lianwen Zhang,et al.  Probabilistic Inference in Influence Diagrams , 1998, Comput. Intell..

[79]  P. Farquhar State of the Art—Utility Assessment Methods , 1984 .

[80]  D K Owens,et al.  Use of Influence Diagrams to Structure Medical Decisions , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[81]  Yuval Shahar,et al.  Utility Elicitation as a Classification Problem , 1998, UAI.

[82]  Ronen I. Brafman,et al.  CP-nets: A Tool for Representing and Reasoning withConditional Ceteris Paribus Preference Statements , 2011, J. Artif. Intell. Res..

[83]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[84]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[85]  Piotr J. Gmytrasiewicz,et al.  Learning models of other agents using influence diagrams , 1999 .

[86]  D. Timmermans,et al.  The Roles of Experience and Domain of Expertise in Using Numerical and Verbal Probability Terms in Medical Decisions , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[87]  Anthony G. Cohn,et al.  Proceedings of the 19th national conference on Artifical intelligence , 2004 .

[88]  M. D. Wilkinson,et al.  Management science , 1989, British Dental Journal.

[89]  Silja Renooij,et al.  How to Elicit Many Probabilities , 1999, UAI.

[90]  Frank Jensen,et al.  From Influence Diagrams to junction Trees , 1994, UAI.

[91]  Thomas D. Nielsen,et al.  Learning a decision maker's utility function from (possibly) inconsistent behavior , 2004, Artif. Intell..

[92]  Gebhard Geiger,et al.  An axiomatic account of status quo-dependent non-expected utility: Pragmatic constraints on rational choice under risk , 2008, Math. Soc. Sci..

[93]  Prakash P. Shenoy,et al.  Valuation-Based Systems for Bayesian Decision Analysis , 1992, Oper. Res..

[94]  Carolyn M. Hall,et al.  Encyclopedia of Library and Information Science , 1971 .

[95]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[96]  Harold Borko,et al.  Encyclopedia of library and information science , 1970 .

[97]  Ali E. Abbas,et al.  Attribute Dominance Utility , 2005, Decis. Anal..

[98]  Ronald A. Howard,et al.  Readings on the Principles and Applications of Decision Analysis , 1989 .

[99]  Scott M. Olmsted On representing and solving decision problems , 1983 .

[100]  H. Brachinger,et al.  Decision analysis , 1997 .

[101]  Ross D. Shachter Efficient Value of Information Computation , 1999, UAI.

[102]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[103]  L. Goddard,et al.  Operations Research (OR) , 2007 .

[104]  Concha Bielza,et al.  A list-based compact representation for large decision tables management , 2005, Eur. J. Oper. Res..

[105]  Ralph L. Keeney,et al.  Selecting Attributes to Measure the Achievement of Objectives , 2005, Oper. Res..

[106]  Michael C. Horsch,et al.  Flexible Policy Construction by Information Refinement , 1996, UAI.

[107]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[108]  Concha Bielza,et al.  Node deletion sequences in influence diagrams using genetic algorithms , 2004, Stat. Comput..

[109]  Daphne Koller,et al.  Learning an Agent's Utility Function by Observing Behavior , 2001, ICML.

[110]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[111]  John B. Wong,et al.  The Influence of Influence Diagrams in Medicine , 2005, Decis. Anal..

[112]  Katta G. Murty,et al.  On KΔ , 1986, Discret. Appl. Math..

[113]  Kim-Leng Poh,et al.  Time-Critical Dynamic Decision Making , 1999, UAI.

[114]  Judea Pearl,et al.  Influence Diagrams - Historical and Personal Perspectives , 2005, Decis. Anal..

[115]  G. Chapman,et al.  [Medical decision making]. , 1976, Lakartidningen.

[116]  Marek J. Druzdzel,et al.  Learning Bayesian network parameters from small data sets: application of Noisy-OR gates , 2001, Int. J. Approx. Reason..