Bias in Aggregations of Subjective Probability and Utility

Subjective estimates of probability or utility are prone to two kinds of error: random and systematic (bias). The usual approach to reducing random error is averaging. How to reduce systematic error is not clear. This paper deals with the question of bias propagation when the estimates that are averaged are bias prone. Both simple and weighted averages are examined. The idea of using averaging as a bias reduction technique is explored. When the weights used in the averaging process are themselves biased, the random error in the average is also affected, possibly adversely. A balance has to be struck between bias reduction requirements and random error reduction requirements.

[1]  H. Kunreuther,et al.  Decision Making: SOURCES OF BIAS IN ASSESSMENT PROCEDURES FOR UTILITY FUNCTIONS , 1982 .

[2]  Robert L. Winkler,et al.  The Consensus of Subjective Probability Distributions , 1968 .

[3]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[4]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[5]  R. L. Winkler,et al.  Averages of Forecasts: Some Empirical Results , 1983 .

[6]  Carl-Axel S. Staël von Holstein,et al.  Exceptional Paper---Probability Encoding in Decision Analysis , 1975 .

[7]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[8]  B. Fischhoff,et al.  Fault trees: Sensitivity of estimated failure probabilities to problem representation. , 1978 .

[9]  Handanhal Ravinder,et al.  Random error in additive decompositions of multiattribute utility , 1991 .

[10]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  George P. Huber,et al.  METHODS FOR QUANTIFYING SUBJECTIVE PROBABILITIES AND MULTI‐ATTRIBUTE UTILITIES*† , 1974 .

[12]  D. A. Seaver Assessing Probability with Multiple Individuals: Group Interaction Versus Mathematical Aggregation. , 1978 .

[13]  H. Raiffa,et al.  Judgment under uncertainty: A progress report on the training of probability assessors , 1982 .

[14]  R. Hogarth Methods for Aggregating Opinions , 1977 .

[15]  Robin M. Hogarth,et al.  Cognitive Processes and the Assessment of Subjective Probability Distributions , 1975 .

[16]  Dennis V. Lindley,et al.  Reconciliation of Probability Distributions , 1983, Oper. Res..

[17]  Peter A. Morris,et al.  Combining Expert Judgments: A Bayesian Approach , 1977 .

[18]  David V. Budescu,et al.  Encoding subjective probabilities: A psychological and psychometric review , 1983 .