A Myopic Approach to Ordering Nodes for Parameter Elicitation in Bayesian Belief Networks

Building Bayesian belief networks in the absence of data involves the challenging task of eliciting conditional probabilities from experts to parameterize the model. In this paper, we develop an analytical method for determining the optimal order for eliciting these probabilities. Our method uses prior distributions on network parameters and a novel expected proximity criteria, to propose an order that maximizes information gain per unit elicitation time. We present analytical results when priors are uniform Dirichlet; for other priors, we find through experiments that the optimal order is strongly affected by which variables are of primary interest to the analyst. Our results should prove useful to researchers and practitioners involved in belief network model building and elicitation.

[1]  Enrique F. Castillo,et al.  Sensitivity analysis in discrete Bayesian networks , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[2]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[3]  J. Eric Bickel,et al.  Optimal Sequential Exploration: A Binary Learning Model , 2006, Decis. Anal..

[4]  Leo A. Goodman,et al.  The Variance of the Product of K Random Variables , 1962 .

[5]  David J. Spiegelhalter,et al.  Sequential updating of conditional probabilities on directed graphical structures , 1990, Networks.

[6]  Ali E. Abbas,et al.  Entropy methods for joint distributions in decision analysis , 2006, IEEE Transactions on Engineering Management.

[7]  Adnan Darwiche,et al.  Sensitivity Analysis in Bayesian Networks: From Single to Multiple Parameters , 2004, UAI.

[8]  Ronald A. Howard,et al.  Readings on the Principles and Applications of Decision Analysis , 1989 .

[9]  M. W. Merkhofer,et al.  Quantifying judgmental uncertainty: Methodology, experiences, and insights , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Silja Renooij,et al.  Talking probabilities: communicating probabilistic information with words and numbers , 1999, Int. J. Approx. Reason..

[11]  Ronald A. Howard,et al.  Information Value Theory , 1966, IEEE Trans. Syst. Sci. Cybern..

[12]  L. C. van der Gaag,et al.  Building probabilistic networks: Where do the numbers come from? - a guide to the literature , 2000 .

[13]  Daphne Koller,et al.  Making Rational Decisions Using Adaptive Utility Elicitation , 2000, AAAI/IAAI.

[14]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[15]  Kathryn B. Laskey Sensitivity analysis for probability assessments in Bayesian networks , 1995, IEEE Trans. Syst. Man Cybern..

[16]  Marek J. Druzdzel,et al.  Elicitation of Probabilities for Belief Networks: Combining Qualitative and Quantitative Information , 1995, UAI.

[17]  Silja Renooij,et al.  Probability elicitation for belief networks: issues to consider , 2001, The Knowledge Engineering Review.

[18]  Adnan Darwiche,et al.  A differential approach to inference in Bayesian networks , 2000, JACM.

[19]  Marek J. Druzdzel,et al.  Building Probabilistic Networks: "Where Do the Numbers Come From?" Guest Editors Introduction , 2000, IEEE Trans. Knowl. Data Eng..

[20]  Ali Balaid,et al.  Knowledge maps: A systematic literature review and directions for future research , 2016, Int. J. Inf. Manag..

[21]  Ronald A. Howard,et al.  Influence Diagram Retrospective , 2005, Decis. Anal..

[22]  Haiqin Wang,et al.  User Interface Tools for Navigation in Conditional Probability Tables and Elicitation of Probabilities in Bayesian Networks , 2000, UAI.

[23]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[24]  Carl-Axel S. Staël von Holstein,et al.  Exceptional Paper---Probability Encoding in Decision Analysis , 1975 .

[25]  Silja Renooij,et al.  How to Elicit Many Probabilities , 1999, UAI.

[26]  Paul Whitney,et al.  Parameterizing bayesian network representations of social-behavioral models by expert elicitation , 2010, 2010 IEEE International Conference on Intelligence and Security Informatics.

[27]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[28]  Ronald A. Howard Uncertainty about Probability: A Decision Analysis Perspective , 1988 .

[29]  Norman E. Fenton,et al.  Using Ranked Nodes to Model Qualitative Judgments in Bayesian Networks , 2007, IEEE Transactions on Knowledge and Data Engineering.

[30]  Ross D. Shachter,et al.  Individualizing generic decision models using assessments as evidence , 2005, J. Biomed. Informatics.

[31]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[32]  Max Henrion,et al.  Some Practical Issues in Constructing Belief Networks , 1987, UAI.