Comment on Cooke's classical method

Abstract Several of the papers in this special issue are in one way or another linked to Cooke's “classical” method for combining expert probability distributions. This comment focuses on characteristics of that method. In particular, I consider two questions: does the weighting scheme give the experts a positive incentive to report their beliefs honestly for each variable? How does Cooke's method perform when evaluated out-of-sample?

[1]  Christian Genest,et al.  Allocating the weights in the linear opinion pool , 1990 .

[2]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[3]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[4]  J. Frank Yates,et al.  Subjective probability accuracy analysis. , 1994 .

[5]  R. Cooke.  Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[6]  Yogendra P. Chaubey,et al.  Resampling Methods: A Practical Guide to Data Analysis , 2000, Technometrics.

[7]  R. L. Winkler,et al.  Scoring Rules for Continuous Probability Distributions , 1976 .

[8]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[9]  Spyros Makridakis,et al.  The M3-Competition1 , 2000 .

[10]  S. Gupta,et al.  Statistical decision theory and related topics IV , 1988 .

[11]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[12]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[13]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[14]  Stephen C. Hora,et al.  Probability Judgments for Continuous Quantities: Linear Combinations and Calibration , 2004, Manag. Sci..

[15]  M. Degroot,et al.  Assessing Probability Assessors: Calibration and Refinement. , 1981 .

[16]  A. H. Murphy,et al.  Scalar and Vector Partitions of the Probability Score: Part I. Two-State Situation , 1972 .

[17]  M. Schervish.  A General Method for Comparing Probability Assessors , 1989 .

[18]  Robert L. Winkler,et al.  Combining Probability Distributions From Experts in Risk Analysis , 1999 .

[19]  C. Chatfield,et al.  The M2-competition: A real-time judgmentally based forecasting study , 1993 .

[20]  J. Frank Yates,et al.  Analyzing the accuracy of probability judgments for multiple events: An extension of the covariance decomposition , 1988 .