Beating the Simple Average: Egalitarian LASSO for Combining Economic Forecasts

Despite the clear success of forecast combination in many economic environments, several important issues remain incompletely resolved. The issues relate to selection of the set of forecasts to combine, and whether some form of additional regularization (e.g., shrinkage) is desirable. Against this background, and also considering the frequently-found superiority of simple-average combinations, we propose LASSO-based procedures that select and shrink toward equal combining weights. We then provide an empirical assessment of the performance of our "egalitarian LASSO" procedures. The results indicate that simple averages are highly competitive, and that although out-of-sample RMSE improvements on simple averages are possible in principle using our methods, they are hard to achieve in real time, due to the intrinsic difficulty of small-sample real-time cross validation of the LASSO tuning parameter. We therefore propose alternative direct combination procedures, most notably "best average" combination, motivated by the structure of egalitarian LASSO and the lessons learned, which do not require choice of a tuning parameter yet outperform simple averages.

[1]  Carlo A. Favero,et al.  Model Uncertainty, Thick Modelling and the Predictability of Stock Returns , 2003 .

[2]  Mark W. Watson,et al.  Generalized Shrinkage Methods for Forecasting Using Many Predictors , 2012 .

[3]  A. Timmermann Forecast Combinations , 2005 .

[4]  Francis X. Diebold,et al.  The use of prior information in forecast combination , 1990 .

[5]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[6]  A. Timmermann,et al.  Combining expert forecasts: Can anything beat the simple average? , 2013 .

[7]  K. Wallis,et al.  A Simple Explanation of the Forecast Combination Puzzle , 2009 .

[8]  Allan Timmermann,et al.  Forecast Combination With Entry and Exit of Experts , 2006 .

[9]  J. Stock,et al.  A dynamic factor model framework for forecast combination , 1999 .

[10]  Rodrigo Sekkel,et al.  Model Confidence Sets and forecast combination , 2017 .

[11]  Allan Timmermann,et al.  Persistence in forecasting performance and conditional combination strategies , 2006 .

[12]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[13]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[14]  H. Bondell,et al.  Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR , 2008, Biometrics.

[15]  Improving GDP Measurement: A Forecast Combination Perspective , 2011 .

[16]  J. Stock,et al.  Combination forecasts of output growth in a seven-country data set , 2004 .

[17]  Woncheol Jang,et al.  Regression shrinkage and grouping of highly correlated predictors with HORSES , 2013, 1302.0256.

[18]  Jose Rodriguez,et al.  Selecting and combining experts from survey forecasts , 2014 .

[19]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[20]  C. De Mol,et al.  Optimal Combination of Survey Forecasts , 2012 .

[21]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[22]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[23]  Graham Elliott,et al.  Averaging and the Optimal Combination of Forecasts , 2011 .

[24]  Leif Anders Thorsrud,et al.  Does Forecast Combination Improve Norges Bank Inflation Forecasts?* , 2012 .