Probabilities for a Probabilistic Network : A Case-study in Oesophageal Carcinoma

With the help of two experts in gastrointestinal oncology from the Netherlands Cancer Institute, Antoni van Leeuwenhoekhuis, a decision-support system is being developed for patient-specific therapy selection for oesophageal carcinoma. The kernel of the system is a probabilistic network that describes the characteristics of oesophageal carcinoma and the pathophysiological processes of invasion and metastasis. While the construction of the graphical structure of the network was relatively straightforward, probability elicitation with existing methods proved to be a major obstacle. We designed a new method for eliciting probabilities from experts that combines the ideas of transcribing probabilities as fragments of text and of using a scale with both numerical and verbal anchors for marking assessments. The method allowed us to elicit the many probabilities required for our network in little time. Using data from 185 patients, we conducted an evaluation study to assess the quality of the probabilities obtained. We found that for 85% of the patients, our probabilistic network yielded the correct outcome.

[1]  Silja Renooij,et al.  Talking probabilities: communicating probabilistic information with words and numbers , 1999, Int. J. Approx. Reason..

[2]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[3]  Wibecke Brun,et al.  Verbal probabilities: Ambiguous, context-dependent, or both? , 1988 .

[4]  Marek J Druzdzel,et al.  Verbal Expressions of Probability in Informed Consent Litigation , 1991, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  Linda C. van der Gaag,et al.  Sensitivity analysis: an aid for belief-network quantification , 2000, The Knowledge Engineering Review.

[6]  Rami Zwick,et al.  Comparing the calibration and coherence of numerical and verbal probability judgments , 1993 .

[7]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[8]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[9]  Marek J. Druzdzel,et al.  Elicitation of Probabilities for Belief Networks: Combining Qualitative and Quantitative Information , 1995, UAI.

[10]  David V. Budescu,et al.  Decisions based on numerically and verbally expressed uncertainties. , 1988 .

[11]  A. L. Baker,et al.  Performance of four computer-based diagnostic systems. , 1994, The New England journal of medicine.

[12]  L. C. van der Gaag,et al.  Building probabilistic networks: Where do the numbers come from? - a guide to the literature , 2000 .

[13]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .