How Successful are Dynamic Factor Models at Forecasting Output and Inflation? A Meta-Analytic Approach

This paper surveys existing factor forecast applications for real economic activity and inflation by means of a meta-analysis and contributes to the current debate on the determinants of the forecast performance of large-scale dynamic factor models relative to other models. We find that, on average, factor forecasts are slightly better than other models' forecasts. In particular, factor models tend to outperform small-scale models, whereas they perform slightly worse than alternative methods which are also able to exploit large datasets. Our results further suggest that factor forecasts are better for US than for UK macroeconomic variables, and that they are better for US than for euro-area output; however, there are no significant differences between the relative factor forecast performance for US and euro-area inflation. There is also some evidence that factor models are better suited to predict output at shorter forecast horizons than at longer horizons. These findings all relate to the forecasting environment (which cannot be influenced by the forecasters). Among the variables capturing the forecasting design (which can, by contrast, be influenced by the forecasters), the size of the dataset from which factors are extracted seems to positively affect the relative factor forecast performance. There is some evidence that quarterly data lend themselves better to factor forecasts than monthly data. Rolling forecasts are preferable to recursive forecasts. The factor estimation technique seems to matter as well. Other potential determinants - namely whether forecasters rely on a balanced or an unbalanced panel, whether restrictions implied by the factor structure are imposed in the forecasting equation or not and whether an iterated or a direct multi-step forecast is made - are found to be rather irrelevant. Moreover, we find no evidence that pre-selecting the variables to be included in the panel from which factors are extracted helped to improve factor forecasts in the past.

[1]  J. Stock,et al.  A Comparison of Direct and Iterated Multistep Ar Methods for Forecasting Macroeconomic Time Series , 2005 .

[2]  Ricardo Mestre,et al.  Diffusion Index-Based Inflation Forecasts for the Euro Area , 2002, SSRN Electronic Journal.

[3]  C. L. Céspedes,et al.  Uso de Análisis Factorial Dinámico para Proyecciones Macroeconómicas , 2004 .

[4]  Halbert White,et al.  Tests of Conditional Predictive Ability , 2003 .

[5]  J. Stock,et al.  Macroeconomic forecasting in the Euro area: Country specific versus area-wide information , 2003 .

[6]  Giovanni Veronese,et al.  A Core Inflation Indicator for the Euro Area , 2005 .

[7]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[8]  J. Fidrmuc,et al.  Meta-Analysis of the Business Cycle Correlation between the Euro Area and the Ceecs , 2006, SSRN Electronic Journal.

[9]  Peter Tillmann.  The New Keynesian Phillips curve in Europe: does it fit or does it fail? , 2009, Social Science Research Network.

[10]  J. Stock,et al.  Combination forecasts of output growth in a seven-country data set , 2004 .

[11]  Christian Schumacher,et al.  Forecasting German GDP Using Alternative Factor Models Based on Large Datasets , 2007, SSRN Electronic Journal.

[12]  J. Tukey,et al.  The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data , 1974 .

[13]  J. Stock,et al.  Forecasting with Many Predictors , 2006 .

[14]  Jörg Breitung,et al.  Real-Time Forecasting of GDP Based on a Large Factor Model with Monthly and Quarterly Data , 2007, SSRN Electronic Journal.

[15]  George Kapetanios,et al.  Forecasting Using Bayesian and Information Theoretic Model Averaging: An Application to UK Inflation , 2005 .

[16]  Marc Hallin,et al.  The Generalized Dynamic Factor Model. One-Sided Estimation and Forecasting , 2003 .

[17]  Lucrezia Reichlin,et al.  Factor Models in Large Cross-Sections of Time Series , 2002 .

[18]  J. Campbell,et al.  In Search of Distress Risk , 2006, SSRN Electronic Journal.

[19]  J. Stock,et al.  Diffusion Indexes , 1998 .

[20]  G. Moser,et al.  Forecasting Austrian Inflation , 2004 .

[21]  G. Wamser,et al.  Going Multinational: What are the Effects on Home-Market Performance? , 2010, SSRN Electronic Journal.

[22]  Gary Koop,et al.  Forecasting in Dynamic Factor Models Using Bayesian Model Averaging , 2004 .

[23]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[24]  J. Poot,et al.  A Meta-Analytic Assessment of the Effect of Immigration on Wages: The Effect Of Immigration On Wages , 2005 .

[25]  Forecasting Inflation and Output: Comparing Data-Rich Models With Simple Rules , 2007 .

[26]  Filippo Altissimo,et al.  Eurocoin: A Real Time Coincident Indicator of the Euro Area Business Cycle , 2001 .

[27]  George Kapetanios,et al.  A parametric estimation method for dynamic factor models of large dimensions , 2006 .

[28]  J. Stock,et al.  Forecasting Using Principal Components From a Large Number of Predictors , 2002 .

[29]  Anindya Banerjee,et al.  Forecasting Macroeconomic Variables Using Diffusion Indexes in Short Samples with Structural Change , 2008 .

[30]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[31]  G. Kapetanios,et al.  Forecasting Euro Area Inflation Using Dynamic Factor Measures of Underlying Inflation , 2004, SSRN Electronic Journal.

[32]  Lutz Kilian,et al.  How Useful is Bagging in Forecasting Economic Time Series? A Case Study of Us CPI Inflation , 2005 .

[33]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[34]  Jin-Lung Lin,et al.  Comparisons of Forecasting Methods with Many Predictors , 2005 .

[35]  L. Hurwicz,et al.  Measuring Business Cycles. , 1946 .

[36]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[37]  H. Uhlig.  What moves GNP , 2004 .

[38]  M. Knell,et al.  Three decades of money demand studies: differences and similarities , 2006 .

[39]  C. Bruneau,et al.  Forecasting Inflation in the Euro Area , 2003 .

[40]  M. Rothschild,et al.  Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets , 1982 .

[41]  Daniel Grenouilleau.  A sorted leading indicators dynamic (SLID) factor model for short-run euro-area GDP forecasting , 2004 .

[42]  M. Hallin,et al.  The Generalized Dynamic-Factor Model: Identification and Estimation , 2000, Review of Economics and Statistics.

[43]  Anindya Banerjee,et al.  Are There Any Reliable Leading Indicators for U.S. Inflation and GDP Growth? , 2003 .

[44]  Frank Heid.  Cyclical Implications of Minimum Capital Requirements , 2005, SSRN Electronic Journal.

[45]  Daniel Porath,et al.  Accounting for Distress in Bank Mergers , 2005, SSRN Electronic Journal.

[46]  F. Dias,et al.  Determining the number of factors in approximate factor models with global and group-specific factors , 2008 .

[47]  T. Stanley,et al.  Wheat from Chaff: Meta-Analysis as Quantitative Literature Review: Response , 2001 .

[48]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[49]  Emil Stavrev.  Measures of underlying inflation in the euro area: assessment and role for informing monetary policy , 2006, SSRN Electronic Journal.

[50]  Calista Cheung,et al.  Evaluating Forecasts from Factor Models for Canadian GDP Growth and Core Inflation , 2007 .

[51]  Harald Stahl,et al.  Time-Dependent or State-Dependent Price Setting? Micro-Evidence from German Metal-Working Industries , 2005, SSRN Electronic Journal.

[52]  Serena Ng,et al.  Are more data always better for factor analysis , 2006 .

[53]  J. Poot,et al.  A Meta-Analytic Assessment of the Effect of Immigration on Wages , 2004 .

[54]  Domenico Giannone,et al.  Comparing Alternative Predictors Based on Large‐Panel Factor Models , 2006 .

[55]  Anindya Banerjee,et al.  Leading Indicators for Euro-Area Inflation and GDP Growth , 2003 .

[56]  Troy D. Matheson.  Factor Model Forecasts for New Zealand , 2006 .

[57]  A. Banerjee,et al.  The Central and Eastern European Countries and the European Union , 2010 .

[58]  Christian Schumacher,et al.  Estimating Large-Scale Factor Models for Economic Activity in Germany: Do They Outperform Simpler Models? / Die Schätzung von großen Faktormodellen für die deutsche Volkswirtschaft: Übertreffen sie einfachere Modelle? , 2004 .

[59]  B. Hofmann,et al.  Do Monetary Indicators (Still) Predict Euro Area Inflation? , 2006, SSRN Electronic Journal.

[60]  Serena Ng,et al.  Determining the Number of Primitive Shocks in Factor Models , 2007 .

[61]  G. Kapetanios.  Modelling Core Inflation for the UK Using a New Dynamic Factor Estimation Method and a Large Disaggregated Price Index Dataset , 2004 .

[62]  Mark W. Watson,et al.  AN EMPIRICAL COMPARISON OF METHODS FOR FORECASTING USING MANY PREDICTORS , 2005 .

[63]  Ernest Pytlarczyk.  An Estimated DSGE Model for the German Economy within the Euro Area , 2005 .

[64]  M. Wedow,et al.  Banks' Regulatory Capital Buffer and the Business Cycle: Evidence for Germany , 2006 .

[65]  Serena Ng,et al.  Understanding and Comparing Factor-Based Forecasts , 2005 .

[66]  Massimiliano Marcellino,et al.  Factor Forecasts for the UK , 2005 .

[67]  Davide Pettenuzzo,et al.  Learning, Structural Instability and Present Value Calculations , 2006, SSRN Electronic Journal.

[68]  M. Knell,et al.  The Income Elasticity of Money Demand: A Meta-Analysis of Empirical Results , 2005 .

[69]  Domenico Giannone,et al.  Tracking Greenspan: Systematic and Unsystematic Monetary Policy Revisited , 2002 .

[70]  M. Koetter.  Evaluating the German Bank Merger Wave , 2005, SSRN Electronic Journal.

[71]  Marco Lippi,et al.  Do Financial Variables Help Forecasting Inflation and Real Activity in the Euro Area , 2002 .

[72]  C. V. Nieuwenhuyze,et al.  A Generalised Dynamic Factor Model for the Belgian Economy - Useful Business Cycle Indicators and GDP Growth Forecasts , 2006 .

[73]  U. Fritsche,et al.  European Inflation Expectations Dynamics , 2005, SSRN Electronic Journal.

[74]  Herman J. Bierens,et al.  Forecasting Quarterly Brazilian GDP Growth Rate With Linear and NonLinear Diffusion Index Models , 2005 .

[75]  Gary Chamberlain,et al.  FUNDS, FACTORS, AND DIVERSIFICATION IN ARBITRAGE PRICING MODELS , 1983 .

[76]  Rudolf Winter-Ebmer,et al.  A Meta-Analysis of the International Gender Wage Gap , 2003, SSRN Electronic Journal.

[77]  A. Banerjee,et al.  Forecasting Macroeconomic Variables for the New Member States of the European Union , 2005, SSRN Electronic Journal.

[78]  Mark W. Watson,et al.  Chapter 10 Forecasting with Many Predictors , 2006 .

[79]  Ard den Reijer,et al.  Forecasting Dutch GDP using Large Scale Factor Models , 2005 .

[80]  Mark W. Watson,et al.  Advances in Economics and Econometrics: Macroeconomic Forecasting Using Many Predictors , 2003 .

[81]  C. Bruneau,et al.  Forecasting Inflation Using Economic Indicators: The Case of France , 2003 .

[82]  Maximo Camacho,et al.  Spanish diffusion indexes , 2003 .

[83]  Carlo A. Favero,et al.  Forecasting Italian Inflation with Large Datasets and Many Models , 2004 .

[84]  Harald Stahl.  Price Setting in German Manufacturing: New Evidence from New Survey Data , 2005, SSRN Electronic Journal.

[85]  Eduard H. Hochreiter.  Forecasting Austrian GDP using the generalized dynamic factor model , 2004 .

[86]  Antoine Martin,et al.  Financial Intermediaries, Markets, and Growth , 2008 .

[87]  J. Bai,et al.  Determining the Number of Factors in Approximate Factor Models , 2000 .

[88]  Todd E. Clark,et al.  Tests of Equal Forecast Accuracy and Encompassing for Nested Models , 1999 .

[89]  Troy D. Matheson,et al.  A New Core Inflation Indicator for New Zealand , 2007 .

[90]  J. Stock,et al.  Macroeconomic Forecasting Using Diffusion Indexes , 2002 .

[91]  C. De Mol,et al.  Forecasting Using a Large Number of Predictors: Is Bayesian Regression a Valid Alternative to Principal Components? , 2006, SSRN Electronic Journal.

[92]  John W. Galbraith,et al.  Série Scientifique Scientific Series Forecasting Some Low-predictability Time Series Using Diffusion Indices Forecasting Some Low-predictability Time Series Using Diffusion Indices * , 2022 .

[93]  Hristos Doucouliagos,et al.  Publication Bias in the Economic Freedom and Economic Growth Literature , 2005 .