Evaluating Point and Density Forecasts of DSGE Models

This paper investigates the accuracy of point and density forecasts of four DSGE models for inflation, output growth and the federal funds rate. Model parameters are estimated and forecasts are derived successively from historical U.S. data vintages synchronized with the Fed’s Greenbook projections. Point forecasts of some models are of similar accuracy as the forecasts of nonstructural large dataset methods. Despite their common underlying New Keynesian modeling philosophy, forecasts of different DSGE models turn out to be quite distinct. Weighted forecasts are more precise than forecasts from individual models. The accuracy of a simple average of DSGE model forecasts is comparable to Greenbook projections for medium term horizons. Comparing density forecasts of DSGE models with the actual distribution of observations shows that the models overestimate uncertainty around point forecasts.

[1]  Charles H. Whiteman,et al.  Supplanting the''Minnesota''Prior: Forecasting Macroeconomic Time Series Using Real Business Cycle M , 1994 .

[2]  Frank Schorfheide,et al.  Priors from General Equilibrium Models for Vars , 2002 .

[3]  Michael T. Kiley,et al.  Documentation of the Research and Statistics Divisions Estimated DSGE Model of the U.S. Economy: 2006 Version , 2007 .

[4]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[5]  R. Fair.  Evaluating Inflation Targeting Using a Macroeconometric Model , 2007 .

[6]  R. King,et al.  The New Neoclassical Synthesis and the Role of Monetary Policy , 1997, NBER Macroeconomics Annual.

[7]  Anthony S. Tay,et al.  Evaluating Density Forecasts with Applications to Financial Risk Management , 1998 .

[8]  Anthony S. Tay,et al.  Multivariate Density Forecast Evaluation and Calibration In Financial Risk Management: High-Frequency Returns on Foreign Exchange , 1999, Review of Economics and Statistics.

[9]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[10]  Christopher A. Sims,et al.  The Role of Models and Probabilities in the Monetary Policy Process , 2002 .

[11]  Barbara Rossi,et al.  Advances in Forecasting Under Instability , 2012 .

[12]  Jeffrey C. Fuhrer,et al.  Monetary Policy Trade-offs and the Correlation between Nominal Interest Rates and Real Output , 1995 .

[13]  Gianni Amisano,et al.  Prediction with Misspecified Models , 2012 .

[14]  Edward P. Herbst,et al.  Evaluating DSGE Model Forecasts of Comovements , 2011 .

[15]  Jeffrey C. Fuhrer.  Inflation Persistence , 2009 .

[16]  Frank Schorfheide,et al.  Loss function‐based evaluation of DSGE models , 2000 .

[17]  Jean Boivin,et al.  Monetary Policy in a Data-Rich Environment , 2001 .

[18]  Miles S. Kimball.  The Quantitative Analytics of the Basic Neomonetarist Model , 1995 .

[19]  J. Stock,et al.  Macroeconomic forecasting in the Euro area: Country specific versus area-wide information , 2003 .

[20]  Shui Ki Wan,et al.  Is there an optimal forecast combination , 2014 .

[21]  V. Ramey,et al.  Measures of Per Capita Hours and Their Implications for the Technology-Hours Debate , 2005 .

[22]  Anders Warne,et al.  The New Area-Wide Model of the Euro Area: A Micro-Founded Open-Economy Model for Forecasting and Policy Analysis , 2008, SSRN Electronic Journal.

[23]  Maik H. Wolters,et al.  A New Comparative Approach to Macroeconomic Modeling and Policy Analysis , 2012 .

[24]  Michael T. Kiley,et al.  A comparison of forecast performance between federal reserve staff forecasts, simple reduced‐form models, and a DSGE model , 2010 .

[25]  Michael K. Andersson,et al.  Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks , 2007 .

[26]  Mu‐Chun Wang.  Comparing the DSGE Model with the Factor Model: An Out-of-Sample Forecasting Experiment , 2009, SSRN Electronic Journal.

[27]  The Science and Practice of Monetary Policy Today , 2010 .

[28]  R. Fair.  Evaluating Inflation Targeting Using a Macroeconometric Model Economics : The Open-Access , 2007 .

[29]  Julio J. Rotemberg,et al.  An Optimization-Based Econometric Framework for the Evaluation of Monetary Policy , 1997, NBER Macroeconomics Annual.

[30]  Sveriges Riksbank.  Forecast Combination and Model Averaging using Predictive Measures , 2005 .

[31]  Shaun P. Vahey,et al.  Combining VAR and DSGE forecast densities , 2011 .

[32]  Francesca Monti,et al.  Incorporating conjunctural analysis in structural models , 2010 .

[33]  Frank Schorfheide,et al.  DSGE Model-Based Forecasting , 2012 .

[34]  Jean-Philippe Laforte,et al.  Natural Rate Measures in an Estimated DSGE Model of the U.S. Economy , 2007 .

[35]  Robert B. Litterman,et al.  Forecasting and Conditional Projection Using Realistic Prior Distributions , 1983 .

[36]  Robert Elder,et al.  Assessing the Mpc's Fan Charts , 2005 .

[37]  Lawrence J. Christiano,et al.  Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy , 2001, Journal of Political Economy.

[38]  J. Stock,et al.  Forecasting Using Principal Components From a Large Number of Predictors , 2002 .

[39]  A. Timmermann.  Forecast Combinations , 2005 .

[40]  Marco Lippi,et al.  Do Financial Variables Help Forecasting Inflation and Real Activity in the Euro Area , 2002 .

[41]  Daniel F. Waggoner,et al.  Confronting Model Misspecification in Macroeconomics , 2012 .

[42]  Maik H. Wolters,et al.  The diversity of forecasts from macroeconomic models of the US economy , 2010 .

[43]  D. Romer,et al.  Federal Reserve Information and the Behavior of Interest Rates , 2000 .

[44]  Frank Smets,et al.  Forecasting with a Bayesian DSGE Model: An Application to the Euro Area , 2004, SSRN Electronic Journal.

[45]  Steven N. Durlauf,et al.  Model Uncertainty and Empirical Policy Analysis in Economics: A Selective Review , 2012 .

[46]  Marco Del Negro,et al.  Inflation in the Great Recession and New Keynesian Models , 2013 .

[47]  Anders Warne,et al.  Forecasting with DSGE Models , 2010, SSRN Electronic Journal.

[48]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[49]  Michael K. Andersson,et al.  Bayesian Forecast Combination for VAR Models , 2007 .

[50]  Rochelle M. Edge,et al.  How Useful Are Estimated DSGE Model Forecasts for Central Bankers? , 2010 .

[51]  Frank Schorfheide,et al.  On the Fit of New Keynesian Models , 2007 .

[52]  F. Smets,et al.  DSGE models and their use at the ECB , 2010 .

[53]  Maik H. Wolters,et al.  Forecasting and Policy Making , 2012 .

[54]  Jon Faust,et al.  Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset , 2007 .

[55]  M. Woodford,et al.  INTEREST AND PRICES: FOUNDATIONS OF A THEORY OF MONETARY POLICY , 2005, Macroeconomic Dynamics.

[56]  Athanasios Orphanides.  Monetary policy rules based on real-time data , 2001 .

[57]  Jeremy Berkowitz.  Testing Density Forecasts, With Applications to Risk Management , 2001 .

[58]  Frank Smets,et al.  Shocks and Frictions in Us Business Cycles: A Bayesian DSGE Approach , 2007, SSRN Electronic Journal.

[59]  Stephen Murchison,et al.  ToTEM: The Bank of Canada's New Quarterly Projection Model , 2006 .

[60]  Jeffrey C. Fuhrer.  Inflation/Output Variance Trade-Offs and Optimal Monetary Policy , 1997 .

[61]  D. Giannone,et al.  Large Bayesian vector auto regressions , 2010 .

[62]  Mattias Villani,et al.  Bayesian Estimation of an Open Economy DSGE Model with Incomplete Pass-Through , 2006 .