Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset

Many recent articles have found that atheoretical forecasting methods using many predictors give better predictions for key macroeconomic variables than various small-model methods. The practical relevance of these results is open to question, however, because these articles generally use ex post revised data not available to forecasters and because no comparison is made to best actual practice. We provide some evidence on both of these points using a new large dataset of vintage data synchronized with the Fed’s Greenbook forecast. This dataset consist of a large number of variables as observed at the time of each Greenbook forecast since 1979. We compare realtime, large dataset predictions to both simple univariate methods and to the Greenbook forecast. For inflation we find that univariate methods are dominated by the best atheoretical large dataset methods and that these, in turn, are dominated by Greenbook. For GDP growth, in contrast, we find that once one takes account of Greenbook’s advantage in evaluating the current state of the economy, neither large dataset methods, nor the Greenbook process offers much advantage over a univariate autoregressive forecast.

[1]  Gary Koop,et al.  Forecasting in Large Macroeconomic Panels Using Bayesian Model Averaging , 2003 .

[2]  Peter Tulip,et al.  Gaging the Uncertainty of the Economic Outlook from Historical Forecasting Errors , 2007 .

[3]  J. Stock,et al.  A Comparison of Direct and Iterated Multistep Ar Methods for Forecasting Macroeconomic Time Series , 2005 .

[4]  Jean-Philippe Laforte,et al.  A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model , 2009 .

[5]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[6]  Todd E. Clark,et al.  The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence , 2003 .

[7]  Mark W. Watson,et al.  AN EMPIRICAL COMPARISON OF METHODS FOR FORECASTING USING MANY PREDICTORS , 2005 .

[8]  Todd E. Clark,et al.  Tests of Equal Forecast Accuracy and Encompassing for Nested Models , 1999 .

[9]  Serena Ng,et al.  Are more data always better for factor analysis , 2006 .

[10]  Brian Ironside,et al.  Real-time model uncertainty in the United States: the Fed from 1996-2003 , 2005 .

[11]  Domenico Giannone,et al.  Comparing Alternative Predictors Based on Large‐Panel Factor Models , 2006 .

[12]  David H. Small,et al.  Nowcasting: the real time informational content of macroeconomic data releases , 2008 .

[13]  L. Kilian,et al.  In-Sample or Out-of-Sample Tests of Predictability: Which One Should We Use? , 2002, SSRN Electronic Journal.

[14]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[15]  Serena Ng,et al.  Evaluating latent and observed factors in macroeconomics and finance , 2006 .

[16]  Min Wei,et al.  Do macro variables, asset markets, or surveys forecast inflation better? , 2006 .

[17]  A. Atkeson,et al.  Are Phillips Curves Useful for Forecasting Inflation , 2001 .

[18]  Michael P. Clements,et al.  Forecasting Non-Stationary Economic Time Series , 1999 .

[19]  J. Stock,et al.  Forecasting Output and Inflation: The Role of Asset Prices , 2001 .

[20]  Jonathan H. Wright Forecasting U.S. Inflation by Bayesian Model Averaging , 2003 .

[21]  C. Peake Federal Reserve Information and the Behavior of Interest Rates , 2001 .

[22]  Mark W. Watson,et al.  Erratum to “Why Has U.S. Inflation Become Harder to Forecast?” , 2007 .

[23]  M. Steel,et al.  Model uncertainty in cross-country growth regressions , 2001 .

[24]  Jean Boivin,et al.  Monetary Policy in a Data-Rich Environment , 2001 .

[25]  Jonathan H. Wright,et al.  Forecasting U.S. Inflation by Bayesian Model Averaging , 2003 .

[26]  Jonathan H. Wright,et al.  Efficient forecast tests for conditional policy forecasts , 2008 .

[27]  Mark W. Watson,et al.  Has inflation become harder to forecast , 2005 .

[28]  Norman R. Swanson,et al.  Nonparametric Bootstrap Procedures for Predictive Inference Based on Recursive Estimation Schemes , 2005 .

[29]  David L. Reifschneider,et al.  Econometric models and the monetary policy process , 1997 .

[30]  D. Romer,et al.  Federal Reserve Information and the Behavior of Interest Rates , 2000 .

[31]  Bruce E. Hansen,et al.  Least-squares forecast averaging , 2008 .

[32]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[33]  J. Stock,et al.  Forecasting Using Principal Components From a Large Number of Predictors , 2002 .

[34]  Brian Ironside,et al.  Real-Time Model Uncertainty in the United States: The Fed from 1996-2003 , 2005 .

[35]  Francis X. Diebold,et al.  Real-Time Measurement of Business Conditions , 2007 .

[36]  Regina Y. Liu Moving blocks jackknife and bootstrap capture weak dependence , 1992 .

[37]  Christopher A. Sims,et al.  The Role of Models and Probabilities in the Monetary Policy Process , 2002 .

[38]  H. Künsch The Jackknife and the Bootstrap for General Stationary Observations , 1989 .

[39]  N. Swanson,et al.  Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Largescale Macroeconomic Time Series Environments , 2008 .

[40]  Peter Tulip,et al.  Has Output Become More Predictable? Changes in Greenbook Forecast Accuracy , 2005 .

[41]  Norman R. Swanson,et al.  Predictive Density Evaluation , 2005 .

[42]  J. Stock,et al.  Combination forecasts of output growth in a seven-country data set , 2004 .

[43]  Marco Lippi,et al.  The Generalized Dynamic Factor Model , 2002 .