New Approaches in Ordinal Pattern Representations for Multivariate Time Series

Many practical applications involve classification tasks on time series data, e.g., the diagnosis of cardiac insufficiency by evaluating the recordings of an electrocardiogram. Since most machine learning algorithms for classification are not capable of dealing with time series directly, mappings of time series to scalar values, also called representations, are applied before using these algorithms. Finding efficient mappings, which capture the characteristics of a time series is subject of the field of representation learning and especially valuable in cases of few data samples. Time series representations based on information theoretic entropies are a proven and well-established approach. Since this approach assumes a total ordering it is only directly applicable to univariate time series and thus rendering it difficult for many real-world applications dealing with multiple measurements at the same time. Some extensions were established which also cope with multivariate time series data, but none of the existing approaches take into account potential correlations between the movement of the variables. In this paper we propose two new approaches, considering the correlation between multiple variables, which outperform state-of-the-art algorithms on realworld data sets.

[1]  Martin Jaggi,et al.  Unsupervised Scalable Representation Learning for Multivariate Time Series , 2019, NeurIPS.

[2]  K. Keller,et al.  Kolmogorov-Sinai entropy via separation properties of order-generated $\sigma$-algebras , 2013, 1304.4450.

[3]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[4]  K. Keller,et al.  ENTROPY DETERMINATION BASED ON THE ORDINAL STRUCTURE OF A DYNAMICAL SYSTEM , 2015, 1502.01309.

[5]  Kehui Sun,et al.  Multivariate permutation entropy and its application for complexity analysis of chaotic systems , 2016 .

[6]  Gustavo J. Meschino,et al.  Mammographic Density Estimation Through Permutation Entropy , 2018, IFMBE Proceedings.

[7]  Inga Stolz,et al.  A General Symbolic Approach to Kolmogorov-Sinai Entropy , 2017, Entropy.

[8]  Xiaoming Xue,et al.  Fault Diagnosis of Rolling Element Bearings with a Two-Step Scheme Based on Permutation Entropy and Random Forests , 2019, Entropy.

[9]  Eamonn J. Keogh,et al.  Matrix Profile I: All Pairs Similarity Joins for Time Series: A Unifying View That Includes Motifs, Discords and Shapelets , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[10]  Audun Myers,et al.  On the Automatic Parameter Selection for Permutation Entropy , 2020, Chaos.

[11]  Klaus Nordhausen,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman , 2009 .

[12]  Karsten Keller Permutations and the Kolmogorov-Sinai entropy , 2011 .

[13]  Jos Amig Permutation Complexity in Dynamical Systems: Ordinal Patterns, Permutation Entropy and All That , 2010 .

[14]  Eamonn J. Keogh,et al.  Probabilistic discovery of time series motifs , 2003, KDD '03.

[15]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yasser F. O. Mohammad,et al.  Multidimensional Permutation Entropy for Constrained Motif Discovery , 2019, ACIIDS.

[17]  R. Wicks,et al.  Permutation entropy and statistical complexity analysis of turbulence in laboratory plasmas and the solar wind. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[19]  G. Moody,et al.  Spontaneous termination of atrial fibrillation: a challenge from physionet and computers in cardiology 2004 , 2004, Computers in Cardiology, 2004.

[20]  Makoto Aoshima,et al.  Effective PCA for high-dimension, low-sample-size data with noise reduction via geometric representations , 2012, J. Multivar. Anal..

[21]  Inga Stolz,et al.  Algorithmics, Possibilities and Limits of Ordinal Pattern Based Entropies , 2019, Entropy.

[22]  Francesco Carlo Morabito,et al.  Multivariate Multi-Scale Permutation Entropy for Complexity Analysis of Alzheimer's Disease EEG , 2012, Entropy.

[23]  Michael Flynn,et al.  The UEA multivariate time series classification archive, 2018 , 2018, ArXiv.

[24]  Inga Stolz,et al.  Permutation Entropy: New Ideas and Challenges , 2017, Entropy.