Modeling data revisions: Measurement error and dynamics of 'true' values

Policy makers must base their decisions on preliminary and partially revised data of varying reliability. Realistic modeling of data revisions is required to guide decision makers in their assessment of current and future conditions. This paper provides a new framework with which to model data revisions. Recent empirical work suggests that measurement errors typically have much more complex dynamics than existing models of data revisions allow. This paper describes a state-space model that allows for richer dynamics in these measurement errors, including the noise, news and spillover effects documented in this literature. We also show how to relax the common assumption that "true" values are observed after a few revisions. The result is a unified and flexible framework that allows for more realistic data revision properties, and allows the use of standard methods for optimal real-time estimation of trends and cycles. We illustrate the application of this framework with real-time data on US real output growth.

[1]  P. Robinson.  The Estimation of Linear Differential Equations with Constant Coefficients , 1976 .

[2]  F. Denton,et al.  The Effect of Measurement Errors on Parameter Estimates and Forecasts: A Case Study Based on the Canadian Preliminary National Accounts , 1965 .

[3]  S. Kuznets.  National Income: A New Version , 1948 .

[4]  K D Patterson,et al.  An Integrated Model of the Data Measurement and Data Generation Processes with an Application to Consumers' Expenditure , 1995 .

[5]  K. Patterson.  Which vintage of data to use when there are multiple vintages of data?: Cointegration, weak exogeneity and common factors , 2000 .

[6]  J. Mincer.  Economic forecasts and expectations : analyses of forecasting behavior and performance , 1969 .

[7]  James D. Hamilton.  Time Series Analysis , 1994 .

[8]  Jeremy Piger,et al.  The Use and Abuse of Real-Time Data in Economic Forecasting , 2003, Review of Economics and Statistics.

[9]  Gerhard Rünstler.  The Information Content of Real-Time Output Gap Estimates: An Application to the Euro Area , 2002, SSRN Electronic Journal.

[10]  S. V. Norden.  Are We There Yet? Looking for Evidence of a New Economy , 2007 .

[11]  P. Otter.  Dynamic structural systems under indirect observation: identifiability and estimation aspects from a system theoretic perspective , 1986 .

[12]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[13]  K. D. Patterson.  Modelling the data measurement process for the index of production , 2002 .

[14]  Dean Croushore,et al.  A real-time data set for macroeconomists , 2001 .

[15]  E. Hannan.  The Identification and Parameterization of ARMAX and State Space Forms , 1976 .

[16]  Kerry Patterson,et al.  Are different vintages of data on the components of GDP co-integrated?: Some evidence for the United Kingdom , 1991 .

[17]  Carol Corrado,et al.  Application of the Kalman filter to revisions in monthly retail sales estimates , 1979 .

[18]  Anthony Garratt,et al.  Real-Time Representations of the Output Gap , 2008, The Review of Economics and Statistics.

[19]  Herschel I. Grossman,et al.  Tests of Equilibrium Macroeconomics Using Contemporaneous Monetary Data , 1981 .

[20]  O. Morgenstern,et al.  On the Accuracy of Economic Observations. , 1950 .

[21]  Thomas J. Sargent,et al.  Two Models of Measurements and the Investment Accelerator , 1989, Journal of Political Economy.

[22]  The transmission of data noise into policy noise in monetary control , 1986 .

[23]  Enrico Rettore,et al.  Preliminary Data Errors and Their Impact on the Forecast Error of Simultaneous-Equations Models , 1986 .

[24]  E. P. Howrey,et al.  The Use of Preliminary Data in Econometric Forecasting , 1978 .

[25]  Athanasios Orphanides,et al.  The Unreliability of Output-Gap Estimates in Real Time , 2002, Review of Economics and Statistics.

[26]  David E. Runkle,et al.  Are preliminary announcements of the money stock rational forecasts , 1984 .

[27]  Thomas Laubach.  Measuring the NAIRU: Evidence from Seven Economies , 2001, Review of Economics and Statistics.

[28]  Forecastable Money-Growth Revisions: A Closer Look at the Data , 1990 .

[29]  K. A. Mork.  Ain't Behavin': Forecast Errors and Measurement Errors in Early GNP Estimates , 1987 .

[30]  Kerry Patterson,et al.  Exploiting information in vintages of time-series data , 2003 .

[31]  Evan F. Koenig,et al.  VAR Estimation and Forecasting When Data Are Subject to Revision , 2010 .

[32]  A. Harvey,et al.  Detrending, stylized facts and the business cycle , 1993 .

[33]  Rational Economic Data Revisions , 1987 .

[34]  Melvin J. Hinich,et al.  Time Series Analysis by State Space Methods , 2001 .

[35]  S. B. Aruoba,et al.  Data Revisions are Not Well-Behaved , 2004 .

[36]  Jonathan H. Wright,et al.  Federal Reserve Board , 2000 .

[37]  Kerry Patterson,et al.  The data measurement process for UK GNP: stochastic trends, long memory, and unit roots , 2002 .

[38]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter , 1990 .

[39]  G. Kapetanios,et al.  Estimating time variation in measurement error from data revisions: an application to backcasting and forecasting in dynamic models , 2010 .

[40]  E. Hannan.  The Identification Problem for Multiple Equation Systems with Moving Average Errors , 1971 .

[41]  Kerry Patterson.  A state space approach to forecasting the final vintage of revised data with an application to the index of industrial production , 1995 .

[42]  James D. Hamilton,et al.  Estimation of Unobserved Expected Monthly Inflation Using Kalman Filtering , 1986 .

[43]  H. Stekler.  Data Revisions and Economic Forecasting , 1967 .

[44]  Kerry Patterson.  A state space model for reducing the uncertainty associated with preliminary vintages of data with an application to aggregate consumption , 1994 .

[45]  Kerry Patterson,et al.  Data Revisions and the Expenditure Components of GDP , 1991 .

[46]  Dean Croushore,et al.  Forecasting with Real-Time Macroeconomic Data , 2006 .

[47]  Dean Croushore,et al.  A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter? , 1999, Review of Economics and Statistics.

[48]  Fabio Busetti,et al.  Preliminary Data and Econometric Forecasting: An Application with the Bank of Italy Quarterly Model , 2004 .

[49]  Giampiero M. Gallo,et al.  Ex post and ex ante analysis of provisional data , 1999 .

[50]  N. Gregory Mankiw,et al.  News or Noise : An Analysis of GNP Revisions , 2007 .

[51]  Kerry Patterson,et al.  Forecasting the final vintage of real personal disposable income: A state space approach , 1995 .

[52]  E. Philip Howrey,et al.  Data Revision, Reconstruction, and Prediction: An Application to Inventory Investment , 1984 .

[53]  P. Siklos.  What Can We Learn from Comprehensive Data Revisions for Forecasting Inflation: Some US Evidence , 2006 .

[54]  G. Kapetanios,et al.  Estimating Time-Variation in Measurement Error from Data Revisions : Working , 2002 .

[55]  O. Morgenstern,et al.  On the Accuracy of Economic Observations. , 1950 .

[56]  George Kapetanios,et al.  A State Space Approach to Extracting the Signal From Uncertain Data , 2007 .

[57]  Norman R. Swanson,et al.  Are Statistical Reporting Agencies Getting It Right? Data Rationality and Business Cycle Asymmetry , 2001 .

[58]  Kerry Patterson,et al.  EFFICIENT FORECASTS OR MEASUREMENT ERRORS? SOME EVIDENCE FOR REVISIONS TO UNITED KINGDOM GDP GROWTH RATES* , 1992 .

[59]  Hisashi Tanizaki,et al.  Prediction of Final Data with Use of Preliminary and/or Revised Data , 1995 .

[60]  Silvano Bordignon,et al.  The Optimal Use of Provisional Data in Forecasting With Dynamic Models , 1989 .

[61]  R. Mckenzie.  Undertaking Revisions and Real-Time Data Analysis using the OECD Main Economic Indicators Original Release Data and Revisions Database , 2006 .

[62]  Anthony Garratt,et al.  UK Real-Time Macro Data Characteristics , 2006 .

[63]  A. Zellner.  A Statistical Analysis of Provisional Estimates of Gross National Product and its Components, of Selected National Income Components, and of Personal Saving , 1958 .

[64]  A State Space Approach To The Policymaker's Data Uncertainty Problem , 2007 .

[65]  What Can We Learn From Comprehensive Data Revisions for Forecasting Inflation ? , 2007 .