Evaluating the predictive accuracy of models

Publisher Summary The methods for evaluating the predictive accuracy of econometric models are discussed in this chapter. The use of these methods should allow to decide upon the model that best approximates the true structure of the economy and how much confidence to place on the predictions from a given model. The numerical solution of nonlinear models is reviewed in the chapter, including stochastic simulation procedures. The standard methods that have been used to evaluate ex ante and ex post predictive accuracy are discussed in the chapter. The main problems with these methods are that they (1) do not account for exogenous variable uncertainty, (2) do not account for the fact that forecast-error variances vary across time, and (3) do not treat the possible existence of misspecification in a systematic way. The comparison of the predictive accuracy of alternative models is not a straightforward exercise. The difficulty of evaluating alternative models is undoubtedly one of the main reasons that there is currently so little agreement about the model that best approximates the true structure of the economy.

[1]  G. Treyz,et al.  Forecasts with quarterly macroeconometric models , 1974 .

[2]  Thomas J. Sargent,et al.  A Classical Macroeconometric Model for the United States , 1976, Journal of Political Economy.

[3]  K. Garbade.  Discretionary control of aggregate economic activity , 1975 .

[4]  G. Treyz,et al.  Forecasts with Qtrly Macroeconometric Models: Equation Adjustments, and Benchmark Predictions: The U.S. Experience , 1972 .

[5]  Ray C. Fair,et al.  Estimating the Expected Predictive Accuracy of Econometric Models , 1980 .

[6]  G. Treyz,et al.  An Analysis of the Forecasting Properties of U.S. Econometric Models , 1972 .

[7]  George Roland Schink,et al.  Small sample estimates of the variance covariance matrix of forecast error for large econometric models : the stochastic simulation technique , 1980 .

[8]  Neil Wallace,et al.  A Study of Discretionary and Nondiscretionary Monetary and Fiscal Policies in the Context of Stochastic Macroeconometric Models , 1972 .

[9]  C. Granger,et al.  Forecasting Economic Time Series. , 1988 .

[10]  J. Cooper.  Development of the monetary sector, prediction and policy analysis in the FRB-MIT-Penn model , 1974 .

[11]  G. Calzolari,et al.  Divergences in the results of stochastic and deterministic simulation of an Italian non linear econometric model , 1976 .

[12]  C. B. Tilanus,et al.  Applied Economic Forecasting , 1966 .

[13]  C. Nelson.  The Prediction Performance of the FRB-MIT-PENN Model of the U.S. Economy , 1972 .

[14]  Michael D. Intriligator,et al.  Econometric Models, Techniques, and Applications. , 1979 .

[15]  C. Sims.  MACROECONOMICS AND REALITY , 1977 .

[16]  J. Cooper,et al.  Monetary and Fiscal Policy in the Fully Stochastic St. Louis Econometric Model , 1974 .

[17]  Neil Wallace,et al.  Tests for Structural Change and Prediction Intervals for the reduced Forms of Two Structural Models of the U.S.: The FRB-MIT and Michigan Quarterly Models , 1974 .

[18]  M. D. McCarthy,et al.  Short-Run Prediction and Long-Run Simulation of the Wharton Model , 1972 .

[19]  Bruce T. Grimm,et al.  Some Multiplier and Error Characteristics of the BEA Qtrly Model , 1974 .

[20]  Gary Fromm,et al.  THE NBER/NSF Model Comparison Seminar: An Analysis of Results , 1976 .

[21]  Robert B. Litterman.  Techniques of forecasting using vector autoregressions , 1979 .

[22]  Gary Fromm,et al.  Short- and Long-Term Simulations with the Brookings Model , 1972 .

[23]  J. Cooper,et al.  Stochastic Simulation of Monetary Rules in Two Macroeconometric Models , 1972 .

[24]  Ray C. Fair,et al.  A Short-Run Forecasting Model of the United States Economy. , 1973 .

[25]  Giorgio Calzolari,et al.  Stochastic simulation as a validation tool for econometric models , 1977 .

[26]  Victor Zarnowitz,et al.  An Analysis of Annual and Multiperiod Quarterly Forecasts of Aggregate Income, Output, and the Price Level , 1979 .

[27]  A. Hirsch,et al.  Short- and Long-Term Simulations with the OBE Econometric Model , 1972 .

[28]  G. V. Cox.  Evaluation of Economic Forecasts , 1930 .

[29]  R. Fair.  An Evaluation of a Short-Run Forecasting Model , 1974 .