Multivariate time series classification with parametric derivative dynamic time warping

We improve DTW distance measure in multivariate time series classification.We use derivatives to improve DTW in multivariate time series classification.We test effectiveness on 18 real time series.We present a detailed comparison of proposed methods. Multivariate time series (MTS) data are widely used in a very broad range of fields, including medicine, finance, multimedia and engineering. In this paper a new approach for MTS classification, using a parametric derivative dynamic time warping distance, is proposed. Our approach combines two distances: the DTW distance between MTS and the DTW distance between derivatives of MTS. The new distance is used in classification with the nearest neighbor rule. Experimental results performed on 18 data sets demonstrate the effectiveness of the proposed approach for MTS classification.

[1]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Björn W. Schuller,et al.  A multidimensional dynamic time warping algorithm for efficient multimodal fusion of asynchronous data streams , 2009, Neurocomputing.

[3]  Dimitrios Gunopulos,et al.  Indexing multi-dimensional time-series with support for multiple distance measures , 2003, KDD '03.

[4]  Claude Sammut,et al.  Classification of Multivariate Time Series and Structured Data Using Constructive Induction , 2005, Machine Learning.

[5]  Tomasz Górecki,et al.  Using derivatives in a longest common subsequence dissimilarity measure for time series classification , 2014, Pattern Recognit. Lett..

[6]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[7]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[8]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[9]  Latifur Khan,et al.  Real-time classification of variable length multi-attribute motions , 2006, Knowledge and Information Systems.

[10]  Jignesh M. Patel,et al.  An efficient and accurate method for evaluating time series similarity , 2007, SIGMOD '07.

[11]  Eamonn J. Keogh,et al.  Exact indexing of dynamic time warping , 2002, Knowledge and Information Systems.

[12]  Tomasz Górecki,et al.  Non-isometric transforms in time series classification using DTW , 2014, Knowl. Based Syst..

[13]  Yannis Theodoridis,et al.  Index-based Most Similar Trajectory Search , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[14]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[15]  Rodrigo Fernandes de Mello,et al.  Multi-Dimensional Dynamic Time Warping for Image Texture Similarity , 2008, SBIA.

[16]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[17]  Pierre Geurts,et al.  Segment and Combine Approach for Non-parametric Time-Series Classification , 2005, PKDD.

[18]  Lei Chen,et al.  Robust and fast similarity search for moving object trajectories , 2005, SIGMOD '05.

[19]  Tomasz Górecki,et al.  First and Second Derivatives in Time Series Classification Using DTW , 2014, Commun. Stat. Simul. Comput..

[20]  Dimitrios Gunopulos,et al.  Finding Similar Time Series , 1997, PKDD.

[21]  Juan José Rodríguez Diez,et al.  Support vector machines of interval-based features for time series classification , 2004, Knowl. Based Syst..

[22]  Daniel Lemire,et al.  Faster retrieval with a two-pass dynamic-time-warping lower bound , 2008, Pattern Recognit..

[23]  Mohamed F. Ghalwash,et al.  Early classification of multivariate time series using a hybrid HMM/SVM model , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[24]  Latifur Khan,et al.  Feature Selection for Classification of Variable Length Multiattribute Motions , 2007 .

[25]  Mohamed F. Ghalwash,et al.  Early classification of multivariate temporal observations by extraction of interpretable shapelets , 2012, BMC Bioinformatics.

[26]  Daniel P. Siewiorek,et al.  Generalized feature extraction for structural pattern recognition in time-series data , 2001 .

[27]  Dimitrios Gunopulos,et al.  Indexing Multidimensional Time-Series , 2004, The VLDB Journal.

[28]  C. Shahabi,et al.  CLeVer : a Feature Subset Selection Technique for Multivariate Time Series ? ( Full Version ) , 2005 .

[29]  János Abonyi,et al.  Correlation based dynamic time warping of multivariate time series , 2012, Expert Syst. Appl..

[30]  Junyi Shen,et al.  Classification of multivariate time series using two-dimensional singular value decomposition , 2008, Knowl. Based Syst..

[31]  Elizabeth Ann Maharaj,et al.  Comparison and classification of stationary multivariate time series , 1999, Pattern Recognit..

[32]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[33]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .

[34]  Hui Ding,et al.  Querying and mining of time series data: experimental comparison of representations and distance measures , 2008, Proc. VLDB Endow..

[35]  Junyi Shen,et al.  Classification of multivariate time series using locality preserving projections , 2008, Knowl. Based Syst..

[36]  M. Reinders,et al.  Multi-Dimensional Dynamic Time Warping for Gesture Recognition , 2007 .

[37]  Juan José Rodríguez Diez,et al.  Stacking for multivariate time series classification , 2015, Pattern Analysis and Applications.

[38]  Akira Hayashi,et al.  Embedding Time Series Data for Classification , 2005, MLDM.

[39]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[40]  Tomasz Górecki,et al.  Using derivatives in time series classification , 2012, Data Mining and Knowledge Discovery.

[41]  J. Ross Quinlan,et al.  Bagging, Boosting, and C4.5 , 1996, AAAI/IAAI, Vol. 1.

[42]  Sahin Albayrak,et al.  Pattern recognition and classification for multivariate time series , 2011, SensorKDD '11.

[43]  Weng Xiaoqing.  Classification of Multivariate Time Series Using Supervised Locality Preserving Projection , 2013, 2013 Third International Conference on Intelligent System Design and Engineering Applications.

[44]  Hans-Peter Kriegel,et al.  Similarity Search on Time Series Based on Threshold Queries , 2006, EDBT.

[45]  Kazuhiro Seki,et al.  A shape-based similarity measure for time series data with ensemble learning , 2011, Pattern Analysis and Applications.

[46]  Lei Chen,et al.  On The Marriage of Lp-norms and Edit Distance , 2004, VLDB.

[47]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[48]  Xiaowei Yu,et al.  Finding Similar Time Series in Sales Transaction Data , 2015, IEA/AIE.

[49]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[50]  Anthony K. H. Tung,et al.  SpADe: On Shape-based Pattern Detection in Streaming Time Series , 2007, 2007 IEEE 23rd International Conference on Data Engineering.