Pooling of Forecasts

We consider forecasting using a combination, when no model coincides with a non-constant data generation process (DGP). Practical experience suggests that combining forecasts adds value, and can even dominate the best individual device. We show why this can occur when forecasting models are differentially mis-specified, and is likely to occur when the DGP is subject to location shifts. Moreover, averaging may then dominate over estimated weights in the combination. Finally, it cannot be proved that only non-encompassed devices should be retained in the combination. Empirical and Monte Carlo illustrations confirm the analysis.

[1]  N. M. van Dijk,et al.  To Pool or Not to pool , 2000 .

[2]  Michael P. Clements,et al.  Economic Forecasting: Some Lessons from Recent Research , 2001, SSRN Electronic Journal.

[3]  R. W. Farebrother,et al.  The statistical implications of pre-test and Stein-rule estimators in econometrics , 1978 .

[4]  D. Hendry,et al.  Econometric Evaluation of Linear Macro-Economic Models , 1986 .

[5]  F. Diebold,et al.  Forecast Evaluation and Combination , 1996 .

[6]  Alfred Marshall.  Alfred Marshall, the Mathematician, As Seen by Himself , 1933 .

[7]  Marco Lippi,et al.  The Generalized Factor Model: Identification and Estimation , 2000 .

[8]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[9]  C. Granger.  Invited review combining forecasts—twenty years later , 1989 .

[10]  Kenneth F. Wallis,et al.  Chi-Squared Tests of Interval and Density Forecasts, and the Bank of England's Fan Charts , 2001, SSRN Electronic Journal.

[11]  M. Rosenblatt.  Remarks on a Multivariate Transformation , 1952 .

[12]  Michael P. Clements,et al.  Evaluating interval forecasts of high-frequency financial data , 2003 .

[13]  Anthony S. Tay,et al.  Evaluating Density Forecasts with Applications to Financial Risk Management , 1998 .

[14]  David F. Hendry,et al.  On detectable and non-detectable structural change , 2000 .

[15]  J. Stock,et al.  A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series , 1998 .

[16]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[17]  Francis X. Diebold,et al.  Forecast combination and encompassing: Reconciling two divergent literatures , 1989 .

[18]  Grayham E. Mizon,et al.  Forecast Encompassing and Model Evaluation , 1991 .

[19]  Anthony S. Tay,et al.  Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters , 1997 .

[20]  David M. Grether,et al.  Forecasting Non-Stationary Economic Time Series , 1966 .

[21]  Michael P. Clements,et al.  Evaluating The Forecast of Densities of Linear and Non-Linear Models: Applications to Output Growth and Unemployment , 2000 .

[22]  Jeremy Berkowitz.  Testing Density Forecasts, With Applications to Risk Management , 2001 .

[23]  C. Granger,et al.  Interval forecasting. An analysis based upon ARCH-quantile estimators , 1989 .

[24]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[25]  C. Granger,et al.  Experience with Forecasting Univariate Time Series and the Combination of Forecasts , 1974 .

[26]  Francis X. Diebold,et al.  Serial Correlation and the Combination of Forecasts , 1988 .

[27]  Anthony S. Tay,et al.  Multivariate Density Forecast Evaluation and Calibration In Financial Risk Management: High-Frequency Returns on Foreign Exchange , 1999, Review of Economics and Statistics.

[28]  Kenneth F. Wallis,et al.  Density Forecasting: A Survey , 2000 .

[29]  N. Edward Coulson,et al.  Forecast combination in a dynamic setting , 1993 .

[30]  R. Koenker,et al.  Robust Tests for Heteroscedasticity Based on Regression Quantiles , 1982 .

[31]  Neil R. Ericsson.  Parameter constancy, mean square forecast errors, and measuring forecast performance: an exposition, extensions, and illustration , 1991 .

[32]  K. Wall,et al.  A preference-based method for forecast combination , 1989 .

[33]  Chris Chatfield,et al.  Calculating Interval Forecasts , 1993 .

[34]  Neil R. Ericsson,et al.  Encompassing the forecasts of U.S. trade balance models , 1993 .

[35]  Rand R. Wilcox,et al.  The statistical implications of pre-test and Stein-rule estimators in econometrics , 1978 .

[36]  R. Frisch,et al.  Partial Time Regressions as Compared with Individual Trends , 1933 .

[37]  N. Shephard.  Partial non-Gaussian state space , 1994 .

[38]  M. Hallin,et al.  The Generalized Dynamic-Factor Model: Identification and Estimation , 2000, Review of Economics and Statistics.

[39]  P. Newbold,et al.  Tests for Forecast Encompassing , 1998 .

[40]  Michael P. Clements,et al.  Bootstrapping prediction intervals for autoregressive models , 2001 .

[41]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[42]  Michael P. Clements,et al.  On the limitations of comparing mean square forecast errors , 1993 .

[43]  Jurgen A. Doornik,et al.  The Implications for Econometric Modelling of Forecast Failure , 1997 .

[44]  Gerard A. Pfann,et al.  Pooling in Dynamic Panel-Data Models: An Application to Forecasting GDP Growth Rates , 2000 .