Equal Predictive Ability Tests Based on Panel Data with Applications to OECD and IMF Forecasts

We propose two types of equal predictive ability (EPA) tests with panels to compare the predictions made by two forecasters. The first type, namely $S$-statistics, focuses on the overall EPA hypothesis which states that the EPA holds on average over all panel units and over time. The second, called $C$-statistics, focuses on the clustered EPA hypothesis where the EPA holds jointly for a fixed number of clusters of panel units. The asymptotic properties of the proposed tests are evaluated under weak and strong cross-sectional dependence. An extensive Monte Carlo simulation shows that the proposed tests have very good finite sample properties even with little information about the cross-sectional dependence in the data. The proposed framework is applied to compare the economic growth forecasts of the OECD and the IMF, and to evaluate the performance of the consumer price inflation forecasts of the IMF.

[1]  Timo Dimitriadis,et al.  On Testing Equal Conditional Predictive Ability Under Measurement Error , 2021, Journal of Business & Economic Statistics.

[2]  A. Pirotte,et al.  Equal Predictive Ability Tests for Panel Data with an Application to OECD and IMF Forecasts , 2020 .

[3]  Yinchu Zhu,et al.  Comparing Forecasting Performance with Panel Data , 2019, SSRN Electronic Journal.

[4]  P. Phillips,et al.  Lag length selection in panel autoregression , 2017 .

[5]  F. Moscone,et al.  Robust estimation under error cross section dependence , 2015 .

[6]  P. Richardson,et al.  OECD Forecasts During and After the Financial Crisis: A Post Mortem , 2014 .

[7]  F. Moscone,et al.  HAC estimation in spatial panels , 2012 .

[8]  R. Mariano,et al.  Statistical Tests for Multiple Forecast Comparison , 2012 .

[9]  M. Hashem Pesaran,et al.  Testing Weak Cross-Sectional Dependence in Large Panels , 2012, SSRN Electronic Journal.

[10]  Yixiao Sun,et al.  Heteroskedasticity and Spatiotemporal Dependence Robust Inference for Linear Panel Models with Fixed Effects , 2011 .

[11]  T. Gneiting.  Making and Evaluating Point Forecasts , 2009, 0912.0902.

[12]  M. Pesaran,et al.  Weak and Strong Cross-Section Dependence and Estimation of Large Panels , 2009, SSRN Electronic Journal.

[13]  A. Dreher,et al.  The political economy of IMF forecasts , 2008 .

[14]  P. Phillips,et al.  UNIT ROOT AND COINTEGRATING LIMIT THEORY WHEN INITIALIZATION IS IN THE INFINITE PAST , 2008, Econometric Theory.

[15]  A. Ullah,et al.  A Bias-Adjusted LM Test of Error Cross-Section Independence , 2008 .

[16]  Harry H. Kelejian,et al.  HAC estimation in a spatial framework , 2007 .

[17]  J. Bai,et al.  Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions , 2006 .

[18]  Todd E. Clark,et al.  Approximately Normal Tests for Equal Predictive Accuracy in Nested Models , 2005 .

[19]  N. Davies.  Multiple Time Series , 2005 .

[20]  Halbert White,et al.  Tests of Conditional Predictive Ability , 2003 .

[21]  J. Stock,et al.  Forecasting Using Principal Components From a Large Number of Predictors , 2002 .

[22]  Michael Jansson.  CONSISTENT COVARIANCE MATRIX ESTIMATION FOR LINEAR PROCESSES , 2002, Econometric Theory.

[23]  J. Bai,et al.  Determining the Number of Factors in Approximate Factor Models , 2000 .

[24]  Todd E. Clark,et al.  Tests of Equal Forecast Accuracy and Encompassing for Nested Models , 1999 .

[25]  J. Driscoll,et al.  Consistent Covariance Matrix Estimation with Spatially Dependent Panel Data , 1998, Review of Economics and Statistics.

[26]  H. Kelejian,et al.  A Generalized Spatial Two-Stage Least Squares Procedure for Estimating a Spatial Autoregressive Model with Autoregressive Disturbances , 1998 .

[27]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[28]  Anthony Davies,et al.  A new framework for analyzing survey forecasts using three-dimensional panel data☆ , 1995 .

[29]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[30]  Victor Solo,et al.  Asymptotics for Linear Processes , 1992 .

[31]  D. Andrews.  Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation , 1991 .

[32]  Q. Vuong.  Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses , 1989 .

[33]  H. White.  Asymptotic theory for econometricians , 1985 .

[34]  Todd E. Clark,et al.  Reserve Bank of St . Louis Working Paper Series Nested Forecast Model Comparisons : A New Approach to Testing Equal Accuracy , 2012 .

[35]  J. Bai,et al.  Inferential Theory for Factor Models of Large Dimensions , 2003 .

[36]  David E. Runkle,et al.  Testing the Rationality of Price Forecasts: New Evidence from Panel Data , 1990 .

[37]  Adrian Pagan,et al.  The Lagrange Multiplier Test and its Applications to Model Specification in Econometrics , 1980 .