Forecast Combination under Heavy-Tailed Errors

Forecast combination has been proven to be a very important technique to obtain accurate predictions for various applications in economics, finance, marketing and many other areas. In many applications, forecast errors exhibit heavy-tailed behaviors for various reasons. Unfortunately, to our knowledge, little has been done to obtain reliable forecast combinations for such situations. The familiar forecast combination methods, such as simple average, least squares regression or those based on the variance-covariance of the forecasts, may perform very poorly due to the fact that outliers tend to occur, and they make these methods have unstable weights, leading to un-robust forecasts. To address this problem, in this paper, we propose two nonparametric forecast combination methods. One is specially proposed for the situations in which the forecast errors are strongly believed to have heavy tails that can be modeled by a scaled Student’s t-distribution; the other is designed for relatively more general situations when there is a lack of strong or consistent evidence on the tail behaviors of the forecast errors due to a shortage of data and/or an evolving data-generating process. Adaptive risk bounds of both methods are developed. They show that the resulting combined forecasts yield near optimal mean forecast errors relative to the candidate forecasts. Simulations and a real example demonstrate their superior performance in that they indeed tend to have significantly smaller prediction errors than the previous combination methods in the presence of forecast outliers.

[1]  Michael P. Clements,et al.  Forecast Combination and Encompassing , 2009 .

[2]  A. Timmermann Chapter 4 Forecast Combinations , 2006 .

[3]  A. Harvey Dynamic Models for Volatility and Heavy Tails: With Applications to Financial and Economic Time Series , 2013 .

[4]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[5]  Yuhong Yang,et al.  Forecast combination with outlier protection , 2015 .

[6]  A. Timmermann Forecast Combinations , 2005 .

[7]  Raymond Kan,et al.  Modeling non-normality using multivariate t: implications for asset pricing , 2017 .

[8]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[9]  Yuhong Yang,et al.  Combining Linear Regression Models , 2005, Journal of the American Statistical Association.

[10]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[11]  Yuhong Yang,et al.  Confidence sets for model selection by F -testing , 2015 .

[12]  Hui Zou,et al.  Combining time series models for forecasting , 2004, International Journal of Forecasting.

[13]  L. Kilian,et al.  How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation , 2008 .

[14]  Robert Fildes,et al.  Simple versus complex forecasting : The evidence , 2015 .

[15]  Helio S. Migon,et al.  Objective Bayesian analysis for the Student-t regression model , 2008 .

[16]  Mark W. Watson,et al.  Chapter 10 Forecasting with Many Predictors , 2006 .

[17]  C. Ing ACCUMULATED PREDICTION ERRORS, INFORMATION CRITERIA AND OPTIMAL FORECASTING FOR AUTOREGRESSIVE TIME SERIES , 2007, 0708.2373.

[18]  Rodrigo Sekkel,et al.  Model Confidence Sets and forecast combination , 2017 .

[19]  M. Steel,et al.  Multivariate Student -t Regression Models : Pitfalls and Inference , 1999 .

[20]  Yuhong Yang COMBINING FORECASTING PROCEDURES: SOME THEORETICAL RESULTS , 2004, Econometric Theory.

[21]  J. Stock,et al.  Forecasting with Many Predictors , 2006 .

[22]  Fotios Petropoulos,et al.  Golden Rule of Forecasting : Be Conservative , 2015 .

[23]  Andrew Harvey,et al.  Dynamic Models for Volatility and Heavy Tails , 2013 .

[24]  Carlo Altavilla,et al.  Forecasting and combining competing models of exchange rate determination , 2006, SSRN Electronic Journal.

[25]  Alessio Sancetta RECURSIVE FORECAST COMBINATION FOR DEPENDENT HETEROGENEOUS DATA , 2009, Econometric Theory.

[26]  Yuhong Yang,et al.  Robust forecast combinations , 2012 .

[27]  Xinyu Zhang,et al.  Adaptively combined forecasting for discrete response time series , 2013 .

[28]  Yongchen Zhao,et al.  Machine Learning and Forecast Combination in Incomplete Panels , 2013 .

[29]  Rodrigo Sekkel,et al.  Forecasting with Many Models: Model Confidence Sets and Forecast Combination , 2013 .

[30]  Ching-Kang Ing,et al.  Model selection for integrated autoregressive processes of infinite order , 2012, J. Multivar. Anal..

[31]  Bruce E. Hansen,et al.  Least-squares forecast averaging , 2008 .

[32]  Peter Reinhard Hansen,et al.  The Model Confidence Set , 2010 .

[33]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[34]  W.J. Lee,et al.  Short-term load forecasting using comprehensive combination based on multi- meteorological information , 2008, 2008 IEEE/IAS Industrial and Commercial Power Systems Technical Conference.

[35]  Svetlozar T. Rachev,et al.  Subordinated Exchange Rate Models: Evidence for Heavy Tailed Distributions and Long-Range Dependence , 2001 .

[36]  Ismael Sánchez,et al.  Adaptive combination of forecasts with application to wind energy , 2008 .