Forecast Rationality Tests Based on Multi-Horizon Bounds

Forecast rationality under squared error loss implies various bounds on second moments of the data across forecast horizons. For example, the mean squared forecast error should be increasing in the horizon, and the mean squared forecast should be decreasing in the horizon. We propose rationality tests based on these restrictions, including new ones that can be conducted without data on the target variable, and implement them via tests of inequality constraints in a regression framework. A new test of optimal forecast revision based on a regression of the target variable on the long-horizon forecast and the sequence of interim forecast revisions is also proposed. The size and power of the new tests are compared with those of extant tests through Monte Carlo simulations. An empirical application to the Federal Reserve's Greenbook forecasts is presented.

[1]  C. Capistrán.  Optimality Tests for Multi-Horizon Forecasts , 2007 .

[2]  Jonathan H. Wright,et al.  Efficient forecast tests for conditional policy forecasts , 2008 .

[3]  Tatevik Sekhposyan,et al.  Has Models' Forecasting Performance for US Output Growth and Inflation Changed over Time, and When? , 2008 .

[4]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[5]  H. White.  Asymptotic theory for econometricians , 1985 .

[6]  Clive W. J. Granger.  Outline of forecast theory using generalized cost functions , 1999 .

[7]  M. Hashem Pesaran,et al.  Chapter 14 Survey Expectations , 2006 .

[8]  N. Gregory Mankiw,et al.  News or Noise : An Analysis of GNP Revisions , 2007 .

[9]  Jonathan H. Wright,et al.  Federal Reserve Board , 2000 .

[10]  Dean Croushore,et al.  A real-time data set for macroeconomists , 2001 .

[11]  W. Newey,et al.  A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelationconsistent Covariance Matrix , 1986 .

[12]  Michael P. Clements,et al.  Forecasting Economic Time Series , 2000 .

[13]  Andrew J. Patton.  Volatility Forecast Comparison Using Imperfect Volatility Proxies , 2006 .

[14]  Barbara Rossi,et al.  OPTIMAL TESTS FOR NESTED MODEL SELECTION WITH UNDERLYING PARAMETER INSTABILITY , 2005, Econometric Theory.

[15]  K. Lahiri,et al.  Learning and Heterogeneity in GDP and Inflation Forecasts , 2008 .

[16]  An Evaluation of the Forecasts of the Federal Reserve: A Pooled Approach , 2007 .

[17]  Jeffrey M. Wooldridge,et al.  Some Invariance Principles and Central Limit Theorems for Dependent Heterogeneous Processes , 1988, Econometric Theory.

[18]  Andrew J. Patton,et al.  Generalized Forecast Errors, A Change of Measure, and Forecast Optimality , 2008 .

[19]  William D. Nordhaus,et al.  Forecasting Efficiency: Concepts and Applications , 1987 .

[20]  A. Kudô,et al.  A multivariate analogue of the one-sided test , 1963 .

[21]  Kajal Lahiri,et al.  Analysis of panels and limited dependent variable models: Re-examining the rational expectations hypothesis using panel data on multi-period forecasts , 1999 .

[22]  Andrew J. Patton,et al.  Predictability of Output Growth and Inflation: A Multi-Horizon Survey Approach , 2011 .

[23]  Timothy J. Vogelsang.  Asymptotic Theory for Econometricians (rev. ed.) , 2002 .

[24]  工藤 昭夫,et al.  A Multivariate Analogue of the One-Sided Testについての一注意 (多次元統計解析の数理的研究) , 1979 .

[25]  Barbara Rossi,et al.  Forecast comparisons in unstable environments , 2010 .

[26]  Norman R. Swanson,et al.  Information in the Revision Process of Real-Time Datasets , 2008 .

[27]  Andrew J. Patton,et al.  Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity , 2007 .

[28]  Hong-Jie Sun.  A general reduction method for n–variate normal orthant probability , 1988 .

[29]  H. White,et al.  A Reality Check for Data Snooping , 2000 .

[30]  F. Wolak.  Testing inequality constraints in linear econometric models , 1989 .

[31]  L. Bregman.  The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[32]  Clive W. J. Granger,et al.  Prediction with a generalized cost of error function , 1969 .

[33]  K. Lahiri,et al.  Evolution of Forecast Disagreement in a Bayesian Learning Model , 2007 .

[34]  Peter Schmidt,et al.  THE ASYMPTOTIC DISTRIBUTION OF FORECASTS IN THE DYNAMIC SIMULATION OF AN ECONOMETRIC MODEL , 1974 .

[35]  B. Rossi,et al.  Forecast Optimality Tests in the Presence of Instabilities , 2011 .

[36]  Anthony Davies,et al.  A new framework for analyzing survey forecasts using three-dimensional panel data☆ , 1995 .

[37]  Kajal Lahiri,et al.  How far ahead can we forecast? Evidence from cross-country surveys , 2007 .

[38]  David I. Harvey.  The evaluation of economic forecasts , 1997 .

[39]  Dean Croushore,et al.  Forecasting with Real-Time Macroeconomic Data , 2006 .

[41]  Andrew J. Patton,et al.  Monotonicity in asset returns: New tests with applications to the term structure, the CAPM, and portfolio sorts , 2010 .

[42]  Andrew J. Patton,et al.  Why do forecasters disagree? Lessons from the term structure of cross-sectional dispersion , 2010 .

[43]  Andrew J. Patton,et al.  Properties of Optimal Forecasts , 2003 .

[44]  J. Stock,et al.  A Comparison of Direct and Iterated Multistep Ar Methods for Forecasting Macroeconomic Time Series , 2005 .

[45]  Allan Timmermann,et al.  Estimation and Testing of Forecast Rationality under Flexible Loss , 2005 .

[46]  Halbert White,et al.  Tests of Conditional Predictive Ability , 2003 .

[47]  C. Gouriéroux,et al.  Likelihood Ratio Test, Wald Test, and Kuhn-Tucker Test in Linear Models with Inequality Constraints on the Regression Parameters , 1982 .

[48]  Michael P. Clements.  Evaluating the Rationality of Fixed-Event Forecasts , 1997 .

[49]  Frank A. Wolak,et al.  An Exact Test for Multiple Inequality and Equality Constraints in the Linear Regression Model , 1987 .

[50]  Andrew J. Patton,et al.  Testing Forecast Optimality Under Unknown Loss , 2007 .

[51]  M. Hashem Pesaran,et al.  Consistency of short-term and long-term expectations , 1989 .

[52]  M. Pesaran,et al.  Survey Expectations , 2005, SSRN Electronic Journal.

[53]  Francis X. Diebold,et al.  Elements of Forecasting , 1997 .

[54]  Frank Schorfheide,et al.  Estimation with overidentifying inequality moment conditions , 2009 .

[55]  Jon Faust,et al.  Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset , 2007 .

[56]  Glenn D. Rudebusch,et al.  Forecasting Output with the Composite Leading Index: A Real-Time Analysis , 1991 .

[57]  P. Hansen.  A Test for Superior Predictive Ability , 2005 .

[58]  Kajal Lahiri,et al.  How quickly do forecasters incorporate news? Evidence from cross-country surveys , 2006 .