A prediction scheme using perceptually important points and dynamic time warping

An algorithmic method for assessing statistically the efficient market hypothesis (EMH) is developed based on two data mining tools, perceptually important points (PIPs) used to dynamically segment price series into subsequences, and dynamic time warping (DTW) used to find similar historical subsequences. Then predictions are made from the mappings of the most similar subsequences, and the prediction error statistic is used for the EMH assessment. The predictions are assessed on simulated price paths composed of stochastic trend and chaotic deterministic time series, and real financial data of 18 world equity markets and the GBP/USD exchange rate. The main results establish that the proposed algorithm can capture the deterministic structure in simulated series, confirm the validity of EMH on the examined equity indices, and indicate that prediction of the exchange rates using PIPs and DTW could beat at cases the prediction of last available price.

[1]  R. Edwards,et al.  Technical Analysis of Stock Trends , 1966 .

[2]  Fl Chung,et al.  Financial time series indexing based on low resolution clustering , 2004 .

[3]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[4]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[5]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[6]  E. Fama.  EFFICIENT CAPITAL MARKETS: A REVIEW OF THEORY AND EMPIRICAL WORK* , 1970 .

[7]  Cheolbeom Park,et al.  What Do We Know About the Profitability of Technical Analysis? , 2007 .

[8]  C. Osler,et al.  Support for Resistance: Technical Analysis and Intraday Exchange Rates , 2000 .

[9]  P. Weller,et al.  The Predictive Power of Head-and-Shoulders Price Patterns in the U.S. Stock Market , 2006 .

[10]  Jar-Long Wang,et al.  Trading rule discovery in the US stock market: An empirical study , 2009, Expert Syst. Appl..

[11]  Z. Q. John Lu,et al.  Modelling and Forecasting Financial Data: Techniques of Nonlinear Dynamics , 2004, Technometrics.

[12]  Achilleas Zapranis,et al.  Principles of Neural Model Identification, Selection and Adequacy: With Applications to Financial Econometrics , 1999 .

[13]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[14]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[15]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[16]  D. Kugiumtzis.  State space reconstruction parameters in the analysis of chaotic time series—the role of the time window length , 1996, comp-gas/9602002.

[17]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[18]  Chi Xie,et al.  Similarity measure and topology evolution of foreign exchange markets using dynamic time warping method: Evidence from minimal spanning tree , 2012 .

[19]  Ralf Schweizer,et al.  Technical Analysis From A To Z , 2016 .

[20]  Ryan Sullivan,et al.  Forecast Evaluation with Shared Data Sets , 2001 .

[21]  Achilleas Zapranis,et al.  A novel, rule-based technical pattern identification mechanism: Identifying and evaluating saucers and resistant levels in the US stock market , 2012, Expert Syst. Appl..

[22]  D. Kugiumtzis.  State Space Local Linear Prediction , 2002 .

[23]  Tak-Chung Fu,et al.  Stock time series pattern matching: Template-based vs. rule-based approaches , 2007, Eng. Appl. Artif. Intell..

[24]  C. Osler,et al.  Identifying Noise Traders: The Head-and-Shoulders Pattern in U.S. Equities , 1998 .

[25]  T. Andersen.  THE ECONOMETRICS OF FINANCIAL MARKETS , 1998, Econometric Theory.

[26]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[27]  G. Caginalp,et al.  The Predictive Power of Price Patterns , 1998 .

[28]  Tak-Chung Fu,et al.  Financial Time Series Segmentation based on Specialized Binary Tree Representation , 2006, International Conference on Data Mining.

[29]  Ben R. Marshall,et al.  Is technical analysis profitable on US stocks with certain size, liquidity or industry characteristics? , 2009 .

[30]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[31]  Dennis Olson,et al.  Have trading rule profits in the currency markets declined over time , 2004 .

[32]  Huaiqing Wang,et al.  A New Segmentation Algorithm to Stock Time Series Based on PIP Approach , 2007, 2007 International Conference on Wireless Communications, Networking and Mobile Computing.

[33]  B. Efron.  Bootstrap Methods: Another Look at the Jackknife , 1979 .

[34]  B. Efron.  The jackknife, the bootstrap, and other resampling plans , 1987 .

[35]  Martin J. Pring,et al.  Technical Analysis Explained: The Successful Investor's Guide to Spotting Investment Trends and Turning Points , 1980 .

[36]  H. White,et al.  Data‐Snooping, Technical Trading Rule Performance, and the Bootstrap , 1999 .

[37]  Achilleas Zapranis,et al.  Identifying and evaluating horizontal support and resistance levels: an empirical study on US stock markets , 2012 .

[38]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .

[39]  Tak-chung Fu,et al.  Flexible time series pattern matching based on perceptually important points , 2001 .

[40]  Achilleas Zapranis,et al.  Identification of the Head-and-Shoulders Technical Analysis Pattern with Neural Networks , 2010, ICANN.

[41]  B. Mandelbrot.  Forecasts of Future Prices, Unbiased Markets, and "Martingale" Models , 1966 .