A Simple Explanation of the Forecast Combination Puzzle

This article presents a formal explanation of the forecast combination puzzle, that simple combinations of point forecasts are repeatedly found to outperform sophisticated weighted combinations in empirical applications. The explanation lies in the effect of finite-sample error in estimating the combining weights. A small Monte Carlo study and a reappraisal of an empirical study by Stock and Watson ["Federal Reserve Bank of Richmond Economic Quarterly" (2003) Vol. 89/3, pp. 71-90] support this explanation. The Monte Carlo evidence, together with a large-sample approximation to the variance of the combining weight, also supports the popular recommendation to ignore forecast error covariances in estimating the weight. Copyright (c) Blackwell Publishing Ltd and the Department of Economics, University of Oxford, 2009.

[1]  J. Stock,et al.  A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series , 1998 .

[2]  Stephen Taylor,et al.  Forecasting Economic Time Series , 1979 .

[3]  M. Bartlett,et al.  An Introduction to Stochastic Processes with Special Reference to Methods and Applications. , 1955 .

[4]  J. Stock,et al.  Combination forecasts of output growth in a seven-country data set , 2004 .

[5]  M. Bartlett.  On the Theoretical Specification and Sampling Properties of Autocorrelated Time‐Series , 1946 .

[6]  Mark Bartlett,et al.  An Introduction to Stochastic Processes with Special Reference to Methods and Applications. , 1955 .

[7]  Todd E. Clark,et al.  Tests of Equal Forecast Accuracy and Encompassing for Nested Models , 1999 .

[8]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[9]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[10]  J. Stock,et al.  How Did Leading Indicator Forecasts Perform during the 2001 Recession? , 2003 .

[11]  A. Timmermann.  Forecast Combinations , 2005 .

[12]  A. Timmermann.  Chapter 4 Forecast Combinations , 2006 .

[13]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[14]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[15]  E. Liski,et al.  Linear constraints and the efficiency of combined forecasts , 1986 .

[16]  Kenneth F. Wallis,et al.  Combining Density and Interval Forecasts: A Modest Proposal , 2005 .

[17]  Kajal Lahiri,et al.  Analysis of panels and limited dependent variable models: Re-examining the rational expectations hypothesis using panel data on multi-period forecasts , 1999 .

[18]  K. Wallis,et al.  Evaluating a three-dimensional panel of point forecasts: The Bank of England Survey of External Forecasters , 2008 .

[19]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[20]  Todd E. Clark,et al.  Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference Hypothesis , 2004 .