Simple robust averages of forecasts: Some empirical results

An extensive body of literature has shown that combining forecasts can improve forecast accuracy, and that a simple average of the forecasts (the mean) often does better than more complex combining schemes. The fact that the mean is sensitive to extreme values suggests that deleting such values or reducing their extremity might be worthwhile. We study the performance of two simple robust methods, trimmed and Winsorized means, which are easy to use and understand. For the data sets we consider, they provide forecasts which are slightly more accurate than the mean, and reduce the risk of high errors. Our results suggest that moderate trimming of 10-30% or Winsorizing of 15-45% of the forecasts can provide improved combined forecasts, with more trimming or Winsorizing being indicated when there is more variability among the individual forecasts. There are some differences in the performance of the trimmed and Winsorized means, but overall such differences are not large.

[1]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[2]  Ilan Yaniv ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, VOLUME 69, ISSUE 3 , 1997 .

[3]  Robert L. Winkler,et al.  Sensitivity of Weights in Combining Forecasts , 1992, Oper. Res..

[4]  N. Harvey,et al.  Combining Advice: The Weight of a Dissenting Opinion in the Consensus , 2004 .

[5]  J. Armstrong,et al.  PRINCIPLES OF FORECASTING 1 Principles of Forecasting : A Handbook for Researchers and Practitioners , 2006 .

[6]  Victor Zarnowitz The Accuracy of Individual and Group Forecasts from Business Outlook Surveys , 1984 .

[7]  C. E. Agnew,et al.  Bayesian consensus forecasts of macroeconomic variables , 1985 .

[8]  Spyros Makridakis,et al.  Accuracy measures: theoretical and practical concerns☆ , 1993 .

[9]  J. Graham Is a Group of Economists Better than One? Than None? , 1996 .

[10]  Stephen K. McNees The uses and abuses of ‘consensus’ forecasts , 1992 .

[11]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[12]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[13]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[14]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[15]  Dean Croushore,et al.  Introducing: The Survey of Professional Forecasters , 1993 .

[16]  R. L. Winkler,et al.  Combining Economic Forecasts , 1986 .

[17]  J. Stock,et al.  Combination forecasts of output growth in a seven-country data set , 2004 .