DECADE : A Deep Metric Learning Model for Multivariate Time Series

Determining similarities (or distance) between multivariate time series sequences is a fundamental problem in time series analysis. The complex temporal dependencies and variable lengths of time series make it an extremely challenging task. Most existing work either rely on heuristics which lacks flexibility and theoretical justifications, or build complex algorithms that are not scalable to big data. In this paper, we propose a novel and effective metric learning model for multivariate time series, referred to as Deep ExpeCted Alignment DistancE (DECADE). It yields a valid distance metric for time series with unequal lengths by sampling from an innovative alignment mechanism, namely expected alignment, and captures complex temporal multivariate dependencies in local representation learned by deep networks. On the whole, DECADE can provide valid data-dependent distance metric efficiently via end-toend gradient training. Extensive experiments on both synthetic and application datasets with multivariate time series demonstrate the superior performance of DECADE compared to the state-of-the-art approaches.

[1]  Yuan-Fang Wang,et al.  Learning a Mahalanobis Distance-Based Dynamic Time Warping Measure for Multivariate Time Series Classification , 2016, IEEE Transactions on Cybernetics.

[2]  Laurens van der Maaten,et al.  Modeling Time Series Similarity with Siamese Recurrent Networks , 2016, ArXiv.

[3]  Jonas Mueller,et al.  Siamese Recurrent Architectures for Learning Sentence Similarity , 2016, AAAI.

[4]  Rahul Sukthankar,et al.  MatchNet: Unifying feature and metric learning for patch-based matching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Nir Ailon,et al.  Deep Metric Learning Using Triplet Network , 2014, SIMBAD.

[6]  Yan Liu,et al.  An Examination of Multivariate Time Series Hashing with Applications to Health Care , 2014, 2014 IEEE International Conference on Data Mining.

[7]  Damien Garreau,et al.  Metric Learning for Temporal Sequence Alignment , 2014, NIPS.

[8]  Shengcai Liao,et al.  Deep Metric Learning for Person Re-identification , 2014, 2014 22nd International Conference on Pattern Recognition.

[9]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face Verification in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Eamonn J. Keogh,et al.  Searching and Mining Trillions of Time Series Subsequences under Dynamic Time Warping , 2012, KDD.

[11]  Tohru Ozaki,et al.  Time Series Modeling of Neuroscience Data , 2012 .

[12]  Eamonn J. Keogh,et al.  Logical-shapelets: an expressive primitive for time series classification , 2011, KDD.

[13]  Marco Cuturi,et al.  Fast Global Alignment Kernels , 2011, ICML.

[14]  Robert M Hamer,et al.  Last observation carried forward versus mixed models in the analysis of psychiatric clinical trials. , 2009, The American journal of psychiatry.

[15]  James H Thrall,et al.  Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. , 2009, Radiology.

[16]  Pasi Fränti,et al.  Time-series clustering by approximate prototypes , 2008, ICPR.

[17]  Bing-Yu Sun,et al.  A Study on the Dynamic Time Warping in Kernel Machines , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[18]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[19]  Tomoko Matsui,et al.  A Kernel for Time Series Based on Global Alignments , 2006, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[20]  Li Wei,et al.  Semi-supervised time series classification , 2006, KDD '06.

[21]  Li Wei,et al.  Fast time series classification using numerosity reduction , 2006, ICML.

[22]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[23]  P. Hogeweg,et al.  The alignment of sets of sequences and the construction of phyletic trees: An integrated method , 2005, Journal of Molecular Evolution.

[24]  Eamonn J. Keogh,et al.  On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration , 2002, Data Mining and Knowledge Discovery.

[25]  P. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 1999 .

[26]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[27]  Aaron E. Rosenberg,et al.  Performance tradeoffs in dynamic time warping algorithms for isolated word recognition , 1980 .

[28]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .