Is Time-Series Based Predictability Evident in Real Time?

We show that out-of-sample tests used in the time-series predictability literature may suffer from test size problems related to the common practice of exogenous specification of critical parameters, such as the choice of predictive variables, traded assets, and in-sample estimation periods. We perform specification searches across these parameters and find that rejections of the null hypothesis of no predictability are very sensitive to minor variations in parameter specification. We perform simulations to determine if the observed predictability in the data is real. The simulations suggest that much of the literature's out-of-sample evidence of time-series-based predictability is consistent with data snooping.

[1]  Franklin Allen,et al.  Using genetic algorithms to find technical trading rules , 1999 .

[2]  Stephen M. Horan.  Book-to-Market Ratios as Predictors of Market Returns , 1999 .

[3]  Fischer Black,et al.  Estimating Expected Return , 1993 .

[4]  Jennifer Conrad,et al.  Profitability of Momentum Strategies: An Evaluation of Alternative Explanations , 2001 .

[5]  A. Lo,et al.  MAXIMIZING PREDICTABILITY IN THE STOCK AND BOND MARKETS , 1995, Macroeconomic Dynamics.

[6]  A. Timmermann,et al.  Predictability of Stock Returns: Robustness and Economic Significance , 1995 .

[7]  Sydney C. Ludvigson,et al.  Consumption, Aggregate Wealth and Expected Stock Returns , 1999 .

[8]  M. C. Jensen.  The Performance of Mutual Funds in the Period 1945-1964 , 1967 .

[9]  S. Ross,et al.  An Empirical Investigation of the Arbitrage Pricing Theory , 1980 .

[10]  Geert Bekaert,et al.  Characterizing Predictable Components in Excess Returns on Equity and Foreign Exchange Markets , 1991 .

[11]  H. White,et al.  Data‐Snooping, Technical Trading Rule Performance, and the Bootstrap , 1999 .

[12]  Michael W. Brandt.  Estimating Portfolio and Consumption Choice: A Conditional Euler Equations Approach , 1999 .

[13]  Norman R. Swanson,et al.  A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks , 1997, Review of Economics and Statistics.

[14]  Tyler Shumway,et al.  Is Sound Just Noise? , 1998 .

[15]  A. Gallant,et al.  Nonlinear Statistical Models , 1988 .

[16]  Fischer Black,et al.  Beta and Return , 1993 .

[17]  R. Shiller,et al.  Stock Prices, Earnings and Expected Dividends , 1988 .

[18]  N. Barberis.  Investing for the Long Run When Returns are Predictable , 2000 .

[19]  Brad M. Barber,et al.  Can Investors Profit from the Prophets? Consensus Analyst Recommendations and Stock Returns , 1998 .

[20]  Andrew Metrick,et al.  Performance Evaluation with Transactions Data: the Stock Selection of Investment Newsletters , 1998 .

[21]  Wayne E. Ferson,et al.  Are the Latent Variables in Time‐Varying Expected Returns Compensation for Consumption Risk? , 1990 .

[22]  Donald B. Keim,et al.  Execution Costs and Investment Performance: An Empirical Analysis of Institutional Equity Trades , 1998 .

[23]  Phoebus J. Dhrymes,et al.  A Critical Reexamination of the Empirical Evidence on the Arbitrage Pricing Theory , 1984 .

[24]  Christo A. Pirinsky.  Are Financial Institutions Better Investors? , 2000 .

[25]  A. Lo,et al.  Data-Snooping Biases in Tests of Financial Asset Pricing Models , 1989 .

[26]  Harald Hau,et al.  Information and Geography: Evidence from the German Stock Market , 1999 .

[27]  R. Shiller,et al.  The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors , 1986 .

[28]  J. Lewellen,et al.  The time-series relations among expected return, risk, and book-to-market ☆ , 1999 .

[29]  H. White,et al.  A Reality Check for Data Snooping , 2000 .

[30]  R. Stambaugh,et al.  On the Predictability of Stock Returns: An Asset-Allocation Perspective , 1995 .

[31]  Campbell R. Harvey,et al.  The Risk and Predictability of International Equity Returns , 1993 .

[32]  P. Bossaerts,et al.  Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn? , 1999 .

[33]  Campbell R. Harvey,et al.  The Variation of Economic Risk Premiums , 1990, Journal of Political Economy.

[34]  Philippe Jorion,et al.  GLOBAL STOCK MARKETS IN THE TWENTIETH CENTURY , 1999 .

[35]  S. Ross,et al.  Economic Forces and the Stock Market , 1986 .

[36]  J. Cochrane.  Production‐Based Asset Pricing and the Link Between Stock Returns and Economic Fluctuations , 1991 .

[37]  Michael J. Cooper,et al.  Value versus glamour , 2003 .

[38]  Donald B. Keim,et al.  Predicting returns in the stock and bond markets , 1986 .

[39]  R. Hodrick.  Dividend Yields and Expected Stock Returns: Alternative Procedures for Interference and Measurement , 1991 .

[40]  J. Campbell.  Stock Returns and the Term Structure , 1985 .

[41]  Campbell R. Harvey.  Time-Varying Conditional Covariances in Tests of Asset Pricing Models , 1989 .

[42]  Owen A. Lamont.  Earnings and Expected Returns , 1996 .

[43]  Russ Wermers,et al.  Mutual Fund Performance: An Empirical Decomposition into Stock-Picking Talent, Style, Transactions Costs, and Expenses , 2000 .

[44]  L. Glosten,et al.  Economic Significance of Predictable Variations in Stock Index Returns , 1989 .

[45]  A. Shleifer,et al.  The Limits of Arbitrage , 1995 .

[46]  Terrance Odean.  Do Investors Trade Too Much? , 1998 .

[47]  Peter Bossaerts,et al.  IPO Post-Issue Markets: Questionable Predilections But Diligent Learners? , 2001, Review of Economics and Statistics.

[48]  Sheridan Titman,et al.  An Analysis of the Recommendations of the " Superstar " Money Managers at Barron ' s Annual Roundtable , 1999 .

[49]  E. Fama,et al.  Dividend yields and expected stock returns , 1988 .

[50]  Harald Hau,et al.  Location Matters: An Examination of Trading Profits , 2001 .

[51]  Brad M. Barber,et al.  Trading is Hazardous to Your Wealth: The Common Stock Investment Performance of Individual Investors , 2000 .

[52]  E. Fama,et al.  Value Versus Growth: The International Evidence , 1997 .

[53]  Andrew Ang,et al.  Stock Return Predictability: Is it There? , 2001 .

[54]  D. Hirshleifer,et al.  Good Day Sunshine: Stock Returns and the Weather , 2001 .

[55]  F. Black,et al.  The Capital Asset Pricing Model: Some Empirical Tests , 2006 .

[56]  E. Fama,et al.  BUSINESS CONDITIONS AND EXPECTED RETURNS ON STOCKS AND BONDS , 1989 .

[57]  E. Fama,et al.  Efficient Capital Markets : II , 2007 .

[58]  K. J. Martijn Cremers,et al.  Stock Return Predictability: A Bayesian Model Selection Perspective , 2000 .

[59]  W. Ferson,et al.  Conditioning Manager Alphas on Economic Information: Another Look at the Persistence of Performance , 1996 .

[60]  F. Douglas Foster,et al.  Assessing goodness-of-fit of asset pricing models: The distribution of the maximal R2 , 1997 .

[61]  William N. Goetzmann,et al.  The Dow Theory: William Peter Hamilton's Track Record Re-Considered , 1998 .

[62]  Kent D. Daniel,et al.  NBER WORKING PAPER SERIES EVIDENCE ON THE CHARACTERISTICS OF CROSS SECTIONAL VARIATION IN STOCK RETURNS , 1996 .

[63]  E. Fama,et al.  Multifactor Explanations of Asset Pricing Anomalies , 1996 .

[64]  Sheridan Titman,et al.  On Persistence in Mutual Fund Performance , 1997 .

[65]  Russ Wermers,et al.  Can Mutual Fund 'Stars' Really Pick Stocks? New Evidence from a Bootstrap Analysis , 2005 .

[66]  Mark M. Carhart.  On Persistence in Mutual Fund Performance , 1997 .

[67]  Pietro Veronesi,et al.  Labor Income and Predictable Stock Returns , 2001 .

[68]  Michael W. Brandt,et al.  Variable Selection for Portfolio Choice , 2001 .

[69]  Campbell R. Harvey.  The World Price of Covariance Risk , 1991 .

[70]  J. Poterba,et al.  Mean Reversion in Stock Prices: Evidence and Implications , 1987 .

[71]  Michael J. Cooper,et al.  On the Predictability of Stock Returns in Real Time , 1998 .

[72]  Sergei Sarkissian,et al.  Spurious Regressions in Financial Economics? , 2002 .

[73]  A. Timmermann,et al.  Model Instability and Choice of Observation Window , 1999 .

[74]  E. Fama,et al.  Common risk factors in the returns on stocks and bonds , 1993 .

[75]  Robert A. Korajczyk,et al.  Do Arbitrage Pricing Models Explain the Predictability of Stock Returns? , 1995 .

[76]  R. Shiller.  Stock Prices and Social Dynamics , 1984 .

[77]  Narasimhan Jegadeesh,et al.  Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency , 1993 .

[78]  Ľuboš Pástor.  Portfolio Selection and Asset Pricing Models , 1999 .

[79]  Doron Avramov,et al.  Stock Return Predictability and Model Uncertainty , 2001 .

[80]  J. Lewellen,et al.  Learning, Asset-Pricing Tests, and Market Efficiency , 2002 .

[81]  J. Cochrane,et al.  Portfolio Advice for a Multifactor World , 1999 .