Finite‐sample properties of tests for equal forecast accuracy

This study examines the small-sample properties of some commonly used tests of equal forecast accuracy. The paper considers the size and power of different tests and the performance of different heteroscedasticity and autocorrelation-consistent (HAC) variance estimators. Monte Carlo experiments show that the tests all suffer some size distortions in small samples, with the distortions varying across tests. The experiments also show that, adjusted for size distortions, the tests have broadly similar power, although some small differences exist. Finally, the experiments indicate that the size and power performances of HAC estimators vary with the features of the data. Copyright © 1999 John Wiley & Sons, Ltd.

[1]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[2]  Neil R. Ericsson,et al.  Encompassing the forecasts of U.S. trade balance models , 1993 .

[3]  W. A. Morgan.  TEST FOR THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN THE TWO VARIANCES IN A SAMPLE FROM A NORMAL BIVARIATE POPULATION , 1939 .

[4]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[5]  Bent E. Sørensen,et al.  GMM Estimation of a Stochastic Volatility Model: A Monte Carlo Study , 1996 .

[6]  H. White.  Maximum Likelihood Estimation of Misspecified Models , 1982 .

[7]  W. Newey,et al.  Automatic Lag Selection in Covariance Matrix Estimation , 1994 .

[8]  Chris D. Orme,et al.  The small-sample performance of the information-matrix test , 1990 .

[9]  C. Granger,et al.  Forecasting Economic Time Series. , 1988 .

[10]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[11]  Kenneth Rogoff,et al.  Was It Real? The Exchange Rate‐Interest Differential Relation over the Modern Floating‐Rate Period , 1988 .

[12]  M. Eichenbaum,et al.  Small-Sample Properties of GMM-Based Wald Tests , 1996 .

[13]  Todd E. Clark.  Small-Sample Properties of Estimators of Nonlinear Models of Covariance Structure , 1996 .

[14]  Lawrence J. Christiano,et al.  Small Sample Properties of GMM for Business Cycle Analysis , 1995 .

[15]  Bruce Mizrach,et al.  The distribution of the Theil U-statistic in bivariate normal populations , 1992 .

[16]  Victor Zarnowitz,et al.  Rational Expectations and Macroeconomic Forecasts , 1985 .

[17]  D. Romer,et al.  Federal Reserve Private Information and the Behavior of Interest Rates , 1996 .

[18]  James G. MacKinnon,et al.  Small Sample Properties of Alternative Forms of the Lagrange Multiplier Test , 1983 .

[19]  C. Nelson.  The Prediction Performance of the FRB-MIT-PENN Model of the U.S. Economy , 1972 .