Impact of Quality of Bayesian Network Parameters on Accuracy of Medical Diagnostic Systems

While most knowledge engineers believe that the quality of results obtained by means of Bayesian networks is not too sensitive to imprecision in probabilities, this remains a conjecture with only modest empirical support. We summarize the results of several previously presented experiments involving Hepar II model, in which we manipulated the quality of the model’s numerical parameters and checked the impact of these manipulations on the model’s accuracy. The chief contribution of this paper are results of replicating our experiments on several medical diagnostic models derived from data sets available at the Irvine Machine Learning Repository. We show that the results of our experiments are qualitatively identical to those obtained earlier with Hepar II.

[1]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[2]  Russell G. Almond,et al.  Modeling Diagnostic Assessments with Bayesian Networks , 2007 .

[3]  Marek J. Druzdzel,et al.  Learning Bayesian network parameters from small data sets: application of Noisy-OR gates , 2001, Int. J. Approx. Reason..

[4]  Gregory M. Provan,et al.  The Sensitivity of Belief Networks to Imprecise Probabilities: An Experimental Investigation , 1996, Artif. Intell..

[5]  Eric Horvitz,et al.  Decision Analysis and Expert Systems , 1991, AI Mag..

[6]  Bruce G. Buchanan,et al.  The MYCIN Experiments of the Stanford Heuristic Programming Project , 1985 .

[7]  J. Czerniak,et al.  Application of rough sets in the presumptive diagnosis of urinary system diseases , 2003 .

[8]  Frank Rijmen,et al.  Bayesian networks with a logistic regression model for the conditional probabilities , 2008, Int. J. Approx. Reason..

[9]  D. Heckerman,et al.  Probabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base. II. Evaluation of diagnostic performance. , 1991, Methods of information in medicine.

[10]  Marek J. Druzdzel,et al.  Are Bayesian Networks Sensitive to Precision of Their Parameters , 2008 .

[11]  Silja Renooij,et al.  Analysing Sensitivity Data from Probabilistic Networks , 2001, UAI.

[12]  L. C. van der Gaag,et al.  Practicable sensitivity analysis of Bayesian belief networks , 1998 .

[13]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[14]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[15]  Adnan Darwiche,et al.  When do Numbers Really Matter? , 2001, UAI.

[16]  Marek J. Druzdzel,et al.  The impact of overconfidence bias on practical accuracy of Bayesian network models: an empirical study , 2008, BMA.

[17]  D. Heckerman,et al.  ,81. Introduction , 2022 .

[18]  Linda C. van der Gaag,et al.  Making Sensitivity Analysis Computationally Efficient , 2000, UAI.

[19]  A. Onisko.  Effect of Imprecision in Probabilities on Bayesian Network Models : An Empirical Study , 2003 .

[20]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[21]  Linda C. van der Gaag,et al.  Properties of Sensitivity Analysis of Bayesian Belief Networks , 2002, Annals of Mathematics and Artificial Intelligence.

[22]  Russell G. Almond,et al.  Models for Conditional Probability Tables in Educational Assessment , 2001, AISTATS.