Locally Slope-based Dynamic Time Warping for Time Series Classification

Dynamic time warping (DTW) has been widely used in various domains of daily life. Essentially, DTW is a non-linear point-to-point matching method under time consistency constraints to find the optimal path between two temporal sequences. Although DTW achieves a globally optimal solution, it does not naturally capture locally reasonable alignments. Concretely, two points with entirely dissimilar local shape may be aligned. To solve this problem, we propose a novel weighted DTW based on local slope feature (LSDTW), which enhances DTW by taking regional information into consideration. LSDTW is inherently a DTW algorithm. However, it additionally attempts to pair locally similar shapes, and to avoid matching points with distinct neighborhood slopes. Furthermore, when LSDTW is used as a similarity measure in the popular nearest neighbor classifier, it beats other distance-based methods on the vast majority of public datasets, with significantly improved classification accuracies. In addition, case studies establish the interpretability of the proposed method.

[1]  Yuan Li,et al.  Rotation-invariant similarity in time series using bag-of-patterns representation , 2012, Journal of Intelligent Information Systems.

[2]  Romain Tavenard,et al.  Data Augmentation for Time Series Classification using Convolutional Neural Networks , 2016 .

[3]  Pattreeya Tanisaro,et al.  Time Series Classification Using Time Warping Invariant Echo State Networks , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[4]  Eamonn J. Keogh,et al.  Fast Shapelets: A Scalable Algorithm for Discovering Time Series Shapelets , 2013, SDM.

[5]  Yixin Chen,et al.  Multi-Scale Convolutional Neural Networks for Time Series Classification , 2016, ArXiv.

[6]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[7]  Jason Lines,et al.  Classification of time series by shapelet transformation , 2013, Data Mining and Knowledge Discovery.

[8]  Bachir Boucheham,et al.  Improved Dynamic Time Warping for Abnormality Detection in ECG Time Series , 2016, IWBBIO.

[9]  George C. Runger,et al.  Time series representation and similarity based on local autopatterns , 2016, Data Mining and Knowledge Discovery.

[10]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[11]  Lars Schmidt-Thieme,et al.  Learning time-series shapelets , 2014, KDD.

[12]  Eamonn J. Keogh,et al.  CID: an efficient complexity-invariant distance for time series , 2013, Data Mining and Knowledge Discovery.

[13]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[14]  Zhihai Wang,et al.  Random Pairwise Shapelets Forest , 2018, PAKDD.

[15]  Sergey Malinchik,et al.  SAX-VSM: Interpretable Time Series Classification Using SAX and Vector Space Model , 2013, 2013 IEEE 13th International Conference on Data Mining.

[16]  Alexandros Karatzoglou,et al.  Towards a universal neural network encoder for time series , 2018, CCIA.

[17]  Marco Zaffalon,et al.  Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysis , 2016, J. Mach. Learn. Res..

[18]  Yi Zheng,et al.  Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks , 2014, WAIM.

[19]  George C. Runger,et al.  A Bag-of-Features Framework to Classify Time Series , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Gautam Das,et al.  The Move-Split-Merge Metric for Time Series , 2013, IEEE Transactions on Knowledge and Data Engineering.

[21]  Jason Lines,et al.  Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles , 2015, IEEE Transactions on Knowledge and Data Engineering.

[22]  Junliang Liu,et al.  Convolutional neural networks for time series classification , 2017 .

[23]  Jidong Yuan,et al.  A Discriminative Shapelets Transformation for Time Series Classification , 2014, Int. J. Pattern Recognit. Artif. Intell..

[24]  Rohit J. Kate.  Using dynamic time warping distances as features for improved time series classification , 2016, Data Mining and Knowledge Discovery.

[25]  Georgiana Ifrim,et al.  Interpretable Time Series Classification using All-Subsequence Learning and Symbolic Representations in Time and Frequency Domains , 2018, ArXiv.

[26]  Ahlame Douzal Chouakria,et al.  Multi-modal and multi-scale temporal metric learning for a robust time series nearest neighbors classification , 2017, Inf. Sci..

[27]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[28]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[29]  Olufemi A. Omitaomu,et al.  Weighted dynamic time warping for time series classification , 2011, Pattern Recognit..

[30]  Jessica Lin,et al.  Linear Time Complexity Time Series Classification with Bag-of-Pattern-Features , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[31]  Yu Qiao,et al.  Affine Invariant Dynamic Time Warping and its Application to Online Rotated Handwriting Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[32]  George C. Runger,et al.  A time series forest for classification and feature extraction , 2013, Inf. Sci..

[33]  Laurent Itti,et al.  Classifying Time Series Using Local Descriptors with Hybrid Sampling , 2016, IEEE Transactions on Knowledge and Data Engineering.

[34]  K. Selçuk Candan,et al.  sDTW: Computing DTW Distances using Locally Relevant Constraints based on Salient Feature Alignments , 2012, Proc. VLDB Endow..

[35]  Zhihai Wang,et al.  A lazy associative classifier for time series , 2015, Intell. Data Anal..

[36]  Patrick Schäfer.  The BOSS is concerned with time series classification in the presence of noise , 2014, Data Mining and Knowledge Discovery.

[37]  Zhihai Wang,et al.  A large margin time series nearest neighbour classification under locally weighted time warps , 2018, Knowledge and Information Systems.

[38]  Georgiana Ifrim,et al.  Time Series Classification by Sequence Learning in All-Subsequence Space , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[39]  Germain Forestier,et al.  Transfer learning for time series classification , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[40]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  F. Itakura,et al.  Minimum prediction residual principle applied to speech recognition , 1975 .

[42]  Laurent Itti,et al.  shapeDTW: Shape Dynamic Time Warping , 2016, Pattern Recognit..

[43]  Kotagiri Ramamohanarao,et al.  Making Use of the Most Expressive Jumping Emerging Patterns for Classification , 2001, Knowledge and Information Systems.

[44]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[45]  Ulf Leser,et al.  Fast and Accurate Time Series Classification with WEASEL , 2017, CIKM.

[46]  Pierre-François Marteau,et al.  Time Warp Edit Distance with Stiffness Adjustment for Time Series Matching , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.