The Effect of Forecast Redundancy on Judgments of a Consensus Forecast's Expected Accuracy

This paper examines the effect of redundancy among multiple individual forecasts on a decision maker's assessment of the expected accuracy of a consensus forecast. In the paper, forecast redundancy is defined as the existence of positive correlation among the errors of individual forecasts. Statistical theory indicates that the accuracy of a consensus forecast is a function of two factors: (1) the accuracy of individual forecasts composing the consensus, measured by their forecast error variances, and (2) the correlation among errors of these forecasts. Positive correlation among forecast errors reduces the accuracy of the consensus forecast. In this paper, I address the issue of whether decision makers' expected accuracy judgments reflect the negative impact of forecast redundancy. In addition, tests examine whether expected accuracy judgments are more likely to reflect the effect of individual forecast accuracy than forecast redundancy. Decision makers face two types of expected accuracy judgments when

[1]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[2]  Robert H. Ashton,et al.  Combining the judgments of experts: How many and which ones? , 1986 .

[3]  Maya Bar-Hillel,et al.  The role of sample size in sample evaluation , 1979 .

[4]  R. L. Winkler.  Combining Probability Distributions from Dependent Information Sources , 1981 .

[5]  David F. Lancy,et al.  Likeness and Likelihood in Everyday Thought: Magical Thinking in Judgments About Personality [and Comments and Reply] , 1977, Current Anthropology.

[6]  E. Fama,et al.  The Theory of Finance , 1974 .

[7]  B. Fischhoff,et al.  Subjective sensitivity analysis. , 1979 .

[8]  Robert H. Ashton,et al.  Aggregating Subjective Forecasts: Some Empirical Results , 1985 .

[9]  Lola L. Lopes.  Risk and Distributional Inequality. , 1984 .

[10]  Robin M. Hogarth,et al.  A note on aggregating opinions , 1978 .

[11]  Dan Givoly,et al.  Financial analysts' forecasts of earnings: A better surrogate for market expectations , 1982 .

[12]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[13]  A. H. Ashton,et al.  Does consensus imply accuracy in accounting studies of decision making?: Alison Hubbard Ashton, Accounting Review 60 (185) 173–85 , 1986 .

[14]  D. Schum,et al.  Formal and empirical research on cascaded inference in jurisprudence. , 1982 .

[15]  J. Smedslund,et al.  Note on learning, contingency, and clinical experience. , 1966, Scandinavian journal of psychology.

[16]  John T. Mentzer,et al.  Familiarity, application, and performance of sales forecasting techniques , 1984 .

[17]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[18]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[19]  Roy L. Crum,et al.  Managerial Risk Preferences for Below-Target Returns , 1980 .

[20]  S. Oskamp.  OVERCONFIDENCE IN CASE-STUDY JUDGMENTS. , 1965, Journal of consulting psychology.

[21]  A. Tversky,et al.  Contingent weighting in judgment and choice , 1988 .