A set of mutually exclusive and exhaustive outcomes are assumed to have in some sense ‘true’ probabilities p i (i = 1,2,...n) and a forecaster estimates these probabilities as q i . After the outcome is known, the forecaster’s client pays him a fee f i (q 1,..., q n; π1,..., π n ) = f i (q; π) where π denotes the client’s estimates of the probabilities. If this fee has the property that its ‘true’ expectation is maximized when q = p it is called an ‘accuracy incentive’. (When p denotes the forecaster’s true attainable subjective probabilities, the fee is also an ‘honesty incentive’.) A brief historical survey of the problem of finding accuracy incentives is given, together with a recommendation that a forecaster should not be the same person as a valuer of the outcomes. One form of accuracy incentive (which depends on a parameter β ≥ 1) is analogous to a generalized surprise index. It has the merit of being ‘splitative’, that is, it is unaffected if an outcome is arbitrarily split up into more than one outcome. It is conjectured that there are no other splitative accuracy incentives, but β remains to be chosen. When β = 1 the fee has an additive property that seems fairly desirable.
[1]
W. Weaver,et al.
Probability, rarity, interest, and surprise.
,
1948,
The Scientific monthly.
[2]
Irving John Good,et al.
The Surprise Index for the Multivariate Normal Distribution
,
1956
.
[3]
J McCarthy,et al.
MEASURES OF THE VALUE OF INFORMATION.
,
1956,
Proceedings of the National Academy of Sciences of the United States of America.
[4]
A. Rényi.
On Measures of Entropy and Information
,
1961
.
[5]
L. Stein,et al.
Probability and the Weighing of Evidence
,
1950
.
[6]
A. H. Murphy,et al.
“Good” Probability Assessors
,
1968
.
[7]
G. Brier.
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
,
1950
.
[8]
I. Good,et al.
Utility of a Distribution
,
1968,
Nature.
[9]
I. Good.
Corroboration, Explanation, Evolving Probability, Simplicity and a Sharpened Razor
,
1968,
The British Journal for the Philosophy of Science.
[10]
I. J. Good,et al.
Some statistical methods in machine intelligence research
,
1970
.
[11]
Irving John Good,et al.
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
,
1965
.