Forecast Combination With Entry and Exit of Experts

Combination of forecasts from survey data is complicated by the frequent entry and exit of individual forecasters which renders conventional least squares regression approaches infeasible. We explore the consequences of this issue for existing combination methods and propose new methods for bias-adjusting the equal-weighted forecast or applying combinations on an extended panel constructed by back-filling missing observations using an EM algorithm. Through simulations and an application to a range of macroeconomic variables we show that the entry and exit of forecasters can have a large effect on the real-time performance of conventional combination methods. The bias-adjusted combination method is found to work well in practice.

[1]  Dean Croushore,et al.  Introducing: The Survey of Professional Forecasters , 1993 .

[2]  Kenneth Rogoff,et al.  Was It Real? The Exchange Rate‐Interest Differential Relation over the Modern Floating‐Rate Period , 1988 .

[3]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[4]  Victor Zarnowitz,et al.  Rational Expectations and Macroeconomic Forecasts , 1985 .

[5]  Graham Field,et al.  Analyzing the analysts , 2005 .

[6]  Lutz Kilian,et al.  How Useful is Bagging in Forecasting Economic Time Series? A Case Study of Us CPI Inflation , 2005 .

[7]  Norman R. Swanson,et al.  Information in the Revision Process of Real-Time Datasets , 2008 .

[8]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[9]  Halbert White,et al.  Tests of Conditional Predictive Ability , 2003 .

[10]  Heejoon Kang.  Unstable Weights in the Combination of Forecasts , 1986 .

[11]  S. Koopman,et al.  Disturbance smoother for state space models , 1993 .

[12]  Allan Timmermann,et al.  Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss? , 2008 .

[13]  A. Timmermann.  Forecast Combinations , 2005 .

[14]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[15]  Dean Croushore,et al.  A real-time data set for macroeconomists , 2001 .

[16]  Norman R. Swanson,et al.  The Real-Time Predictive Content of Money for Output , 2000 .

[17]  Allen Silver,et al.  Beta , 1975, The SAGE Encyclopedia of Research Design.

[18]  Sunil Gupta,et al.  Combination of Economic Forecasts: An Odds-Matrix Approach , 1988 .

[19]  Stephen Taylor,et al.  Forecasting Economic Time Series , 1979 .

[20]  J. Stock,et al.  A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series , 1998 .

[21]  Norman R. Swanson,et al.  Choosing among competing econometric forecasts: Regression‐based forecast combination using model selection , 2001 .

[22]  W. Newey,et al.  A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelationconsistent Covariance Matrix , 1986 .

[23]  C. Granger,et al.  Forecasting Economic Time Series. , 1988 .

[24]  Mark W. Watson,et al.  AN EMPIRICAL COMPARISON OF METHODS FOR FORECASTING USING MANY PREDICTORS , 2005 .

[25]  The real-time predictive content of money for output , 2001 .

[26]  Sune Karlsson,et al.  Finding Good Predictors for Inflation: A Bayesian Model Averaging Approach , 2004 .

[27]  J. Stock,et al.  Combination forecasts of output growth in a seven-country data set , 2004 .

[28]  Sunil Gupta,et al.  Combination of Forecasts: An Extension , 1987 .

[29]  R. Engle,et al.  Alternative Algorithms for the Estimation of Dynamic Factor , 1983 .

[30]  GuptaSunil,et al.  Combination of Forecasts , 1987 .

[31]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[32]  Todd E. Clark,et al.  Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference Hypothesis , 2004 .

[33]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[34]  Allan Timmermann,et al.  Optimal Forecast Combination Under Regime Switching , 2004 .

[35]  Anthony Davies,et al.  A new framework for analyzing survey forecasts using three-dimensional panel data☆ , 1995 .

[36]  Todd E. Clark,et al.  Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference Hypothesis , 2004 .

[37]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[38]  Jeffrey D. Kubik,et al.  Analyzing the Analysts: Career Concerns and Biased Earnings Forecasts , 2003 .

[39]  J. Stock,et al.  A dynamic factor model framework for forecast combination , 1999 .

[40]  J. Stock,et al.  Forecasting with Many Predictors , 2006 .

[41]  J. Galí,et al.  Monetary Policy Rules and Macroeconomic Stability: Evidence and Some Theory , 1998 .

[42]  M. Hashem Pesaran,et al.  REAL-TIME ECONOMETRICS , 2004, Econometric Theory.