Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?

Statistical model selection criteria provide an informed choice of the model with best external (i.e., out-of-sample) validity. Therefore they guard against overfitting ('data snooping'). We implement several model selection criteria in order to verify recent evidence of predictability in excess stock returns and to determine which variables are valuable predictors. We confirm the presence of in-sample predictability in an international stock market dataset, but discover that even the best prediction models have no out-of-sample forecasting power. The failure to detect out-of-sample predictability is not due to lack of power. Article published by Oxford University Press on behalf of the Society for Financial Studies in its journal, The Review of Financial Studies.

[1]  Bruno Solnik The performance of international asset allocation strategies using conditioning information , 1993 .

[2]  Donald B. Keim,et al.  Predicting returns in the stock and bond markets , 1986 .

[3]  L. Kavalieris,et al.  THE ESTIMATION OF THE ORDER OF AN AUTOREGRESSION USING RECURSIVE RESIDUALS AND CROSS‐VALIDATION , 1989 .

[4]  J. Campbell Stock Returns and the Term Structure , 1985 .

[5]  Peter C. B. Phillips,et al.  An Asymptotic Theory of Bayesian Inference for Time Series , 1996 .

[6]  H. White,et al.  Data‐Snooping, Technical Trading Rule Performance, and the Bootstrap , 1999 .

[7]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[8]  J. Rissanen Order estimation by accumulated prediction errors , 1986, Journal of Applied Probability.

[9]  C. Z. Wei On Predictive Least Squares Principles , 1992 .

[10]  H. Akaike A new look at the statistical model identification , 1974 .

[11]  E. Fama,et al.  Efficient Capital Markets : II , 2007 .

[12]  J. Rissanen Stochastic Complexity and Modeling , 1986 .

[13]  Campbell R. Harvey,et al.  The Risk and Predictability of International Equity Returns , 1993 .

[14]  A. Lo,et al.  Data-Snooping Biases in Tests of Financial Asset Pricing Models , 1989 .

[15]  Peter C. B. Phillips,et al.  Posterior Odds Testing for a Unit Root with Data-Based Model Selection , 1994, Econometric Theory.

[16]  A. Timmermann,et al.  Predictability of Stock Returns: Robustness and Economic Significance , 1995 .

[17]  M. Richardson Predictability of stock returns , 1989 .

[18]  B. LeBaron,et al.  Simple Technical Trading Rules and the Stochastic Properties of Stock Returns , 1992 .

[19]  L. Glosten,et al.  Economic Significance of Predictable Variations in Stock Index Returns , 1989 .

[20]  K. West,et al.  Asymptotic Inference about Predictive Ability , 1996 .

[21]  F. Douglas Foster,et al.  Assessing goodness-of-fit of asset pricing models: The distribution of the maximal R2 , 1997 .