Evaluation of a verbal-numerical probability scale

For purposes such as the development of decision support systems, the probabilities that model the uncertainties in the domain of application are usually elicited from domain experts. A number of elicitation methods is available. While constructing a real-life system, we however found none of these methods to be quite usable: they turned out to be too time-consuming and difficult for experts. In an earlier paper we described a verbal?numerical response scale we developed to facilitate elicitation of a large number of probabilities. In this paper we describe a study that justifies our claim that use of this verbal?numerical scale generally facilitates the assessment process.

[1]  David V. Budescu,et al.  A review of human linguistic probability processing: General principles and empirical evidence , 1995, The Knowledge Engineering Review.

[2]  Silja Renooij,et al.  How to Elicit Many Probabilities , 1999, UAI.

[3]  Gary L. Wells,et al.  Measuring psychological uncertainty: Verbal versus numeric methods , 1996 .

[4]  Elke U. Weber,et al.  The Interpretation of 'Likely' Depends on the Context, But 70% is 70% - Right? The Influence of Associative Processes on Perceived Certainty , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Linda C. van der Gaag,et al.  Sensitivity analysis: an aid for belief-network quantification , 2000, The Knowledge Engineering Review.

[6]  Wibecke Brun,et al.  Ambiguous probabilities: when doesp=0.3 reflect a possibility, and when does it express a doubt? , 2000 .

[7]  Silja Renooij,et al.  Probability elicitation for belief networks: issues to consider , 2001, The Knowledge Engineering Review.

[8]  Gary L. Wells,et al.  Measuring Psychological Uncertainty : Verbal Versus Numeric Methods , 2004 .

[9]  Carla P. Gomes,et al.  Artificial intelligence and operations research: challenges and opportunities in planning and scheduling , 2000, The Knowledge Engineering Review.

[10]  Silja Renooij,et al.  Talking probabilities: communicating probabilistic information with words and numbers , 1999, Int. J. Approx. Reason..

[11]  Silja Renooij,et al.  Probabilities for a probabilistic network: a case study in oesophageal cancer , 2002, Artif. Intell. Medicine.

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[13]  D. Budescu,et al.  Processing Linguistic Probabilities: General Principles and Empirical Evidence , 1995 .

[14]  Wibecke Brun,et al.  Verbal probabilities: Ambiguous, context-dependent, or both? , 1988 .

[15]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[16]  RenooijSilja.  Probability elicitation for belief networks: issues to consider , 2001 .

[17]  Carl-Axel S. Staël von Holstein,et al.  Exceptional Paper---Probability Encoding in Decision Analysis , 1975 .