Algorithmics, Possibilities and Limits of Ordinal Pattern Based Entropies

The study of nonlinear and possibly chaotic time-dependent systems involves long-term data acquisition or high sample rates. The resulting big data is valuable in order to provide useful insights into long-term dynamics. However, efficient and robust algorithms are required that can analyze long time series without decomposing the data into smaller series. Here symbolic-based analysis techniques that regard the dependence of data points are of some special interest. Such techniques are often prone to capacity or, on the contrary, to undersampling problems if the chosen parameters are too large. In this paper we present and apply algorithms of the relatively new ordinal symbolic approach. These algorithms use overlapping information and binary number representation, whilst being fast in the sense of algorithmic complexity, and allow, to the best of our knowledge, larger parameters than comparable methods currently used. We exploit the achieved large parameter range to investigate the limits of entropy measures based on ordinal symbolics. Moreover, we discuss data simulations from this viewpoint.

[1]  C. Finney,et al.  A review of symbolic analysis of experimental data , 2003 .

[2]  Niels Wessel,et al.  Practical considerations of permutation entropy , 2013, The European Physical Journal Special Topics.

[3]  Karsten Keller,et al.  Efficiently Measuring Complexity on the Basis of Real-World Data , 2013, Entropy.

[4]  Wolfram Bunk,et al.  Transcripts: an algebraic approach to coupled time series. , 2012, Chaos.

[5]  G. Keller,et al.  Entropy of interval maps via permutations , 2002 .

[6]  K. Keller,et al.  TIME SERIES FROM THE ORDINAL VIEWPOINT , 2007 .

[7]  Jos Amig Permutation Complexity in Dynamical Systems: Ordinal Patterns, Permutation Entropy and All That , 2010 .

[8]  K. Keller,et al.  Equality of kolmogorov-sinai and permutation entropy for one-dimensional maps consisting of countably many monotone parts , 2018, Discrete & Continuous Dynamical Systems - A.

[9]  Massimiliano Zanin,et al.  Permutation Entropy and Its Main Biomedical and Econophysics Applications: A Review , 2012, Entropy.

[10]  Geon Ho Choe,et al.  Computational Ergodic Theory , 2005 .

[11]  C. Bandt Ordinal time series analysis , 2005 .

[12]  M. Mirzakhani,et al.  Introduction to Ergodic theory , 2010 .

[13]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[14]  Karsten Keller,et al.  Conditional entropy of ordinal patterns , 2014, 1407.5390.

[15]  Rodney R. Howell On Asymptotic Notation with Multiple Variables , 2008 .

[16]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[17]  M. V. Wilkes,et al.  The Art of Computer Programming, Volume 3, Sorting and Searching , 1974 .

[18]  K. Keller,et al.  ENTROPY DETERMINATION BASED ON THE ORDINAL STRUCTURE OF A DYNAMICAL SYSTEM , 2015, 1502.01309.

[19]  Raúl Alcaraz Symbolic Entropy Analysis and Its Applications , 2018, Entropy.

[20]  A. Witty,et al.  Measures of Complexity in Signal Analysis , 1995 .

[21]  Inga Stolz,et al.  Permutation Entropy: New Ideas and Challenges , 2017, Entropy.

[22]  Edilson Delgado-Trejos,et al.  Embedded Dimension and Time Series Length. Practical Influence on Permutation Entropy and Its Applications , 2019, Entropy.