Predictive Ability of Business Cycle Indicators under Test

Summary In this paper we assess the information content of seven widely cited early indicators for the euro area with respect to forecasting area-wide industrial production. To this end, we use various tests that are designed to compare competing forecast models. In addition to the standard Diebold-Mariano test, we employ tests that account for specific problems typically encountered in forecast exercises. Specifically, we pay attention to nested model structures, we alleviate the problem of data snooping arising from multiple pairwise testing, and we analyze the structural stability in the relative forecast performance of one indicator compared to a benchmark model. Moreover, we consider loss functions that overweight forecast errors in booms and recessions to check-whether a specific indicator that appears to be a good choice on average is also preferable in times of economic stress. We find that none of this indicators uniformly dominates all its competitors. The optimal choice rather depends on the specific forecast situation and the loss function of the user. For 1-month forecasts the business climate indicator of the European Commission and the OECD composite leading indicator generally work well, for 6-month forecasts the OECD composite leading indicator performs very good by all criteria, and for 12-month forecasts the FAZ-Euro indicator published by the Frankfurter Allgemeine Zeitung is the only one that can beat the benchmark AR(1) model.

[1]  Marco Lippi,et al.  Do Financial Variables Help Forecasting Inflation and Real Activity in the Euro Area , 2002 .

[2]  P. Hansen.  A Test for Superior Predictive Ability , 2005 .

[3]  Jörg Breitung,et al.  Prognoseeigenschaften alternativer Indikatoren für die Konjunkturentwicklung in Deutschland , 2002 .

[4]  Todd E. Clark,et al.  Using Out-of-Sample Mean Squared Prediction Errors to Test the Martingale Difference Hypothesis , 2004 .

[5]  Massimiliano Marcellino,et al.  A linear benchmark for forecasting GDP growth and inflation , 2008 .

[6]  Roberto Golinelli,et al.  Forecasting industrial production in the Euro area , 2000 .

[7]  George Kapetanios,et al.  Are More Data Always Better for Factor Analysis' Results for the Euro Area, the Six Largest Euro Area Countries and the UK , 2009, SSRN Electronic Journal.

[8]  Philip Rothman,et al.  Out-of-sample forecasting of unemployment rates with pooled STVECM forecasts , 2008 .

[9]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[10]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[11]  D. Andrews.  Tests for Parameter Instability and Structural Change with Unknown Change Point , 1993 .

[12]  Todd E. Clark,et al.  Averaging Forecasts from Vars with Uncertain Instabilities , 2006 .

[13]  J. Stock,et al.  Macroeconomic forecasting in the Euro area: Country specific versus area-wide information , 2003 .

[14]  Barbara Rossi,et al.  Have Economic Models’ Forecasting Performance for US Output Growth and Inflation Changed Over Time, and When? , 2009 .

[15]  J. Stiglitz,et al.  Economic Forecasts and Expectations. , 1971 .

[16]  Philip Hans Franses,et al.  Selecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy , 2003 .

[17]  叶萍,et al.  β , 2002 .

[18]  Joseph P. Romano,et al.  The stationary bootstrap , 1994 .

[19]  Victor Zarnowitz,et al.  Rational Expectations and Macroeconomic Forecasts , 1985 .

[20]  Allan Timmermann,et al.  Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss? , 2008 .

[21]  Todd E. Clark,et al.  Approximately Normal Tests for Equal Predictive Accuracy in Nested Models , 2005 .

[22]  David I. Harvey.  The evaluation of economic forecasts , 1997 .

[23]  Ferdinand Fichtner,et al.  Leading Indicators in a Globalised World , 2009, SSRN Electronic Journal.

[24]  Robert Fildes,et al.  Journal of business and economic statistics 5: Garcia-Ferrer, A. et al., Macroeconomic forecasting using pooled international data, (1987), 53-67 , 1988 .

[25]  Todd E. Clark,et al.  Tests of Equal Forecast Accuracy and Encompassing for Nested Models , 1999 .

[26]  D. Andrews.  Tests for Parameter Instability and Structural Change with Unknown Change Point , 1993 .

[27]  Ataman Ozyildirim,et al.  Business cycles in the euro area defined with coincident economic indicators and predicted with leading economic indicators , 2010 .

[28]  H. White,et al.  A Reality Check for Data Snooping , 2000 .

[29]  B. Rossi,et al.  Model Comparisons in Unstable Environments Ra ¤ , 2010 .