Loss function‐based evaluation of DSGE models

In this paper we propose a Bayesian econometric procedure for the evaluation and comparison of DSGE models. Unlike in many previous econometric approaches we explicitly take into account the possibility that the DSGE models are misspecified and introduce a reference model to complete the model space. Three loss functions are proposed to assess the discrepancy between DSGE model predictions and an overall posterior distribution of population characteristics that the researcher is trying to match. The evaluation procedure is applied to the comparison of a standard cash-in-advance (CIA) and a portfolio adjustment cost (PAC) model. We find that the CIA model has higher posterior probability than the PAC model and achieves a better in-sample time series fit. Both models overpredict the magnitude of the negative correlation between output growth and inflation. However, unlike the PAC model, the CIA model is not able to generate a positive real effect of money growth shocks on aggregate output. Overall, the impulse response dynamics of the PAC model resemble the posterior mean impulse response functions more closely than the responses of the CIA model. Copyright © 2000 John Wiley & Sons, Ltd.

[1]  James M. Nason,et al.  Testing the Implications of Long-Run Neutrality for Monetary Business Cycle Models , 1994 .

[2]  Fabio Canova,et al.  Statistical Inference in Calibrated Models , 1994 .

[3]  G. Nelson,et al.  Policy analysis with econometric models. , 1996 .

[4]  Timothy Cogley,et al.  Output Dynamics in Real-Business-Cycle Models , 1993 .

[5]  Harald Uhlig,et al.  Solving Nonlinear Stochastic Growth Models: a Comparison of Alternative Solution Methods , 1989 .

[6]  M. Crowder.  Asymptotic expansions of posterior expectations, distributions and densities for stochastic processes , 1988 .

[7]  Olivier J. Blanchard,et al.  The Dynamic Effects of Aggregate Demand and Supply Disturbances , 1988 .

[8]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[9]  Adrian Pagan,et al.  Evaluating a real business cycle model , 1993 .

[10]  Julio J. Rotemberg,et al.  Real-Business-Cycle Models and the Forecastable Movements in Output, Hours, and Consumption , 1996 .

[11]  John Geweke,et al.  Federal Reserve Bank of Minneapolis Research Department Staff Report 249 Using Simulation Methods for Bayesian Econometric Models: Inference, Development, and Communication , 2022 .

[12]  Martin Eichenbaum,et al.  Is Theory Really Ahead of Measurement? Current Real Business Cycle Theories and Aggregate Labor Market Fluctuations , 1988 .

[13]  A. Zellner.  An Introduction to Bayesian Inference in Econometrics , 1971 .

[14]  Eric M. Leeper,et al.  Toward a Modern Macroeconomic Model Usable for Policy Analysis , 1994, NBER Macroeconomics Annual.

[15]  P. Söderlind.  Cyclical Properties of a Real Business Cycle Model , 1993 .

[16]  Martin Eichenbaum,et al.  Liquidity Effects and the Monetary Transmission Mechanism , 1992 .

[17]  Peter C. B. Phillips,et al.  Econometric Model Determination , 1996 .

[18]  Lawrence I. Clxistiaoo,et al.  Current Real Business Cycle Theories and Aggregate Labor Market Fiuctaationr , 1990 .

[19]  Timothy S. Fuerst.  Liquidity, loanable funds, and real activity☆ , 1992 .

[20]  Lawrence J. Christiano.  Modeling the Liquidity Effect of a Money Shock , 1991 .

[21]  Beth F. Ingram,et al.  A Bayesian approach to dynamic macroeconomics , 2000 .

[22]  Peter N. Ireland,et al.  A Method for Taking Models to the Data , 2004 .

[23]  George E. P. Box,et al.  Sampling and Bayes' inference in scientific modelling and robustness , 1980 .

[24]  W. Andrew.  LO, . Finance: Survey.. Journal of the American Statistical Association, , . , 2000 .

[25]  Edward C. Prescott,et al.  The Computational Experiment: an Econometric Tool , 1996 .

[26]  Anthony A. Smith,et al.  Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions , 1993 .

[27]  Jinill Kim.  Constructing and estimating a realistic optimizing model of monetary policy , 2000 .

[28]  Ray C. Fair,et al.  Testing Macroeconometric Models , 1995 .

[29]  Colin P. Hargreaves,et al.  Non-Stationary Time Series Analysis and Cointegration , 1994 .

[30]  Sumru Altug,et al.  Time-to-Build and Aggregate Fluctuations: Some New Evidence , 1989 .

[31]  John Geweke,et al.  Computational Experiments and Reality , 1999 .

[32]  Francis X. Diebold,et al.  Dynamic Equilibrium Economies: A Framework for Comparing Models and Data , 1995 .

[33]  I. R. Dunsmore,et al.  A Bayesian Approach to Calibration , 1968 .

[34]  Christopher A. Sims,et al.  Macroeconomics and Methodology , 1996 .