This article originated over ten years ago as a set of joke slides showing silly spurious correlations. These statistically appealing relationships between the stock market and diary products and third world livestock populations have been cited often, in Business Week, the Wall Street Journal, the book “A Mathematician Looks at the Stock Market,” and elsewhere. Students from Bill Sharpe's classes at Stanford seem to be familiar with them. The slides were expanded to include some actual content about data mining, and reissued as an academic working paper in 2001. Occasional requests arrive from distant corners of the world, so I thank the editors of the Journal of Investing for publishing this article. Without taking a hatchet to the original, the advice offered remains valuable, perhaps even more so now that there is so much more data to mine. Monthly data arrives as a single data point, once a month. It's hard to avoid data mining sins if you look twice. Ticks, quotes, and executions arrive in millions per minute, and many of the practices which fail the statistical sniff tests for low frequency data can now be used responsibly. Nevertheless, fooling yourself remains an occupational hazard in quantitative trading.
[1]
Rand R. Wilcox,et al.
The statistical implications of pre-test and Stein-rule estimators in econometrics
,
1978
.
[2]
Peter Schmidt,et al.
The Theory and Practice of Econometrics
,
1985
.
[3]
D. Freedman.
A Note on Screening Regression Equations
,
1983
.
[4]
H. Markowitz,et al.
Data Mining Corrections
,
1994
.
[5]
A. Lo,et al.
MAXIMIZING PREDICTABILITY IN THE STOCK AND BOND MARKETS
,
1995,
Macroeconomic Dynamics.
[6]
A. Lo,et al.
Data-Snooping Biases in Tests of Financial Asset Pricing Models
,
1989
.
[7]
Joel B. Greenhouse,et al.
Selection Models and the File Drawer Problem
,
1988
.
[8]
R. W. Farebrother,et al.
The statistical implications of pre-test and Stein-rule estimators in econometrics
,
1978
.
[9]
G. Judge,et al.
The Theory and Practice of Econometrics
,
1981
.
[10]
D FreemanJohn.
Behind the Smoke and Mirrors: Gauging the Integrity of Investment Simulations
,
1992
.
[11]
David J. Hand,et al.
Data Mining: Statistics and More?
,
1998
.