Permutation entropy based time series analysis: Equalities in the input signal can lead to false conclusions

Abstract A symbolic encoding scheme, based on the ordinal relation between the amplitude of neighboring values of a given data sequence, should be implemented before estimating the permutation entropy. Consequently, equalities in the analyzed signal, i.e. repeated equal values, deserve special attention and treatment. In this work, we carefully study the effect that the presence of equalities has on permutation entropy estimated values when these ties are symbolized, as it is commonly done, according to their order of appearance. On the one hand, the analysis of computer-generated time series is initially developed to understand the incidence of repeated values on permutation entropy estimations in controlled scenarios. The presence of temporal correlations is erroneously concluded when true pseudorandom time series with low amplitude resolutions are considered. On the other hand, the analysis of real-world data is included to illustrate how the presence of a significant number of equal values can give rise to false conclusions regarding the underlying temporal structures in practical contexts.

[1]  S. K. Turitsyn,et al.  Unveiling Temporal Correlations Characteristic of a Phase Transition in the Output Intensity of a Fiber Laser. , 2016, Physical review letters.

[2]  J P Toomey,et al.  Mapping the dynamic complexity of a semiconductor laser with optical feedback using permutation entropy. , 2014, Optics express.

[3]  M. C. Soriano,et al.  Time Scales of a Chaotic Semiconductor Laser With Optical Feedback Under the Lens of a Permutation Information Analysis , 2011, IEEE Journal of Quantum Electronics.

[4]  Lai,et al.  Validity of threshold-crossing analysis of symbolic dynamics from chaotic time series , 2000, Physical review letters.

[5]  Claudio R Mirasso,et al.  A symbolic information approach to determine anticipated and delayed synchronization in neuronal circuit models , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Cristina Masoller,et al.  Experimental and numerical study of the symbolic dynamics of a modulated external-cavity semiconductor laser. , 2014, Optics express.

[7]  Xiaoli Li,et al.  EEG entropy measures in anesthesia , 2015, Front. Comput. Neurosci..

[8]  Search for correlated fluctuations in the β+ decay of Na-22 , 2009 .

[9]  M. Silverman,et al.  Tests of alpha-, beta-, and electron capture decays for randomness , 1999 .

[10]  Osvaldo A. Rosso,et al.  The (in)visible hand in the Libor market: an information theory approach , 2015, 1508.04748.

[11]  Cristina Masoller,et al.  Detecting and quantifying temporal correlations in stochastic resonance via information theory measures , 2009 .

[12]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[13]  Francesco Carlo Morabito,et al.  Multivariate Multi-Scale Permutation Entropy for Complexity Analysis of Alzheimer's Disease EEG , 2012, Entropy.

[14]  O. Rosso,et al.  Quantifying long-range correlations with a multiscale ordinal pattern approach , 2016 .

[15]  L. Voss,et al.  Using Permutation Entropy to Measure the Electroencephalographic Effects of Sevoflurane , 2008, Anesthesiology.

[16]  O. Rosso,et al.  Permutation min-entropy: An improved quantifier for unveiling subtle temporal correlations , 2015 .

[17]  M. C. Soriano,et al.  Distinguishing chaotic and stochastic dynamics from time series by using a multiscale symbolic approach. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Osvaldo A. Rosso,et al.  Causal information quantification of prominent dynamical features of biological neurons , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[19]  Zhenhu Liang,et al.  A Comparison of Multiscale Permutation Entropy Measures in On-Line Depth of Anesthesia Monitoring , 2016, PloS one.

[20]  V. A. Kolombet,et al.  Anomalous effects on radiation detectors and capacitance measurements inside a modified Faraday cage , 2016 .

[21]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[22]  Niels Wessel,et al.  Classifying cardiac biosignals using ordinal pattern statistics and symbolic dynamics , 2012, Comput. Biol. Medicine.

[23]  Dimitris Syvridis,et al.  Time-Scale Independent Permutation Entropy of a Photonic Integrated Device , 2017, Journal of Lightwave Technology.

[24]  J. Scargle,et al.  Comparative Analyses of Brookhaven National Laboratory Nuclear Decay Measurements and Super-Kamiokande Solar Neutrino Measurements: Neutrinos and Neutrino-Induced Beta-Decays as Probes of the Deep Solar Interior , 2016 .

[25]  H Kantz,et al.  Direction of coupling from phases of interacting oscillators: a permutation information approach. , 2008, Physical review letters.

[26]  Hamed Azami,et al.  Improved multiscale permutation entropy for biomedical signal analysis: Interpretation and application to electroencephalogram recordings , 2015, Biomed. Signal Process. Control..

[27]  A. M. Kowalski,et al.  Fractional Brownian motion, fractional Gaussian noise, and Tsallis permutation entropy , 2008 .

[28]  Niels Wessel,et al.  Practical considerations of permutation entropy , 2013, The European Physical Journal Special Topics.

[29]  André L. L. de Aquino,et al.  Characterization of vehicle behavior with information theory , 2015, ArXiv.

[30]  Alejandra Figliola,et al.  Entropy analysis of the dynamics of El Niño/Southern Oscillation during the Holocene , 2010 .

[31]  O. Rosso,et al.  Complexity–entropy analysis of daily stream flow time series in the continental United States , 2014, Stochastic Environmental Research and Risk Assessment.

[32]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[33]  B. Luque,et al.  Horizontal visibility graphs: exact results for random time series. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Cristina Masoller,et al.  Emergence of spike correlations in periodically forced excitable systems. , 2015, Physical review. E.

[35]  Osvaldo A. Rosso,et al.  Bandt–Pompe approach to the classical-quantum transition , 2007 .

[36]  Search for anomalies in the decay of radioactive Mn-54 , 2016 .

[37]  Nianqiang Li,et al.  Characterizing the optical chaos in a special type of small networks of semiconductor lasers using permutation entropy , 2016 .

[38]  G. Consolini,et al.  Permutation entropy analysis of complex magnetospheric dynamics , 2014 .

[39]  Moshe Lewenstein,et al.  Forbidden Patterns , 2012, LATIN.

[40]  Jing Li,et al.  Using Permutation Entropy to Measure the Changes in EEG Signals During Absence Seizures , 2014, Entropy.

[41]  Massimiliano Zanin,et al.  Permutation Entropy and Its Main Biomedical and Econophysics Applications: A Review , 2012, Entropy.

[42]  G. Ouyang,et al.  Predictability analysis of absence seizures with permutation entropy , 2007, Epilepsy Research.

[43]  H. Schrader Seasonal variations of decay rate measurement data and their interpretation. , 2016, Applied radiation and isotopes : including data, instrumentation and methods for use in agriculture, industry and medicine.

[44]  Cristina Masoller,et al.  Distinguishing signatures of determinism and stochasticity in spiking complex systems , 2013, Scientific Reports.

[45]  Alejandro C. Frery,et al.  Characterization of electric load with Information Theory quantifiers , 2017 .

[46]  Lei Yang,et al.  Mapping the dynamic complexity and synchronization in unidirectionally coupled external-cavity semiconductor lasers using permutation entropy , 2015 .

[47]  Simon E. Shnoll,et al.  Realization of discrete states during fluctuations in macroscopic processes , 1998 .

[48]  Douglas J. Little,et al.  Permutation entropy of finite-length white-noise time series. , 2016, Physical review. E.

[49]  Michael Hauhs,et al.  Diagnosing the Dynamics of Observed and Simulated Ecosystem Gross Primary Productivity with Time Causal Information Theory Quantifiers , 2016, PloS one.

[50]  Raydonal Ospina,et al.  Classification and Verification of Handwritten Signatures with Time Causal Information Theory Quantifiers , 2016, PloS one.

[51]  Matthäus Staniek,et al.  Parameter Selection for Permutation Entropy Measurements , 2007, Int. J. Bifurc. Chaos.

[52]  Cristina Masoller,et al.  Detecting and quantifying stochastic and coherence resonances via information-theory complexity measurements. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Alfonso M Albano,et al.  Phase-randomized surrogates can produce spurious identifications of non-random structure , 1994 .

[54]  Luciano Zunino,et al.  Forbidden patterns, permutation entropy and stock market inefficiency , 2009 .

[55]  Francesco Carlo Morabito,et al.  Differentiating Interictal and Ictal States in Childhood Absence Epilepsy through Permutation Rényi Entropy , 2015, Entropy.

[56]  Osvaldo A. Rosso,et al.  Evaluation of the status of rotary machines by time causal Information Theory quantifiers , 2017 .

[57]  M. Torrent,et al.  Numerical and experimental study of the effects of noise on the permutation entropy , 2015, 1503.07345.

[58]  Qianli D. Y. Ma,et al.  Modified permutation-entropy analysis of heartbeat dynamics. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  L. Telesca,et al.  Investigating anthropically induced effects in streamflow dynamics by using permutation entropy and statistical complexity analysis: A case study , 2016 .

[60]  M. C. Soriano,et al.  Characterizing the Hyperchaotic Dynamics of a Semiconductor Laser Subject to Optical Feedback Via Permutation Entropy , 2011, IEEE Journal of Selected Topics in Quantum Electronics.

[61]  Cristina Masoller,et al.  Analysis of noise-induced temporal correlations in neuronal spike sequences , 2016 .

[62]  O A Rosso,et al.  Distinguishing noise from chaos. , 2007, Physical review letters.

[63]  D. Nualart Fractional Brownian motion , 2006 .

[64]  F. James A Review of Pseudorandom Number Generators , 1990 .

[65]  Karsten Keller,et al.  Ordinal symbolic analysis and its application to biomedical recordings , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[66]  Karsten Keller,et al.  Conditional entropy of ordinal patterns , 2014, 1407.5390.

[67]  Ruqiang Yan,et al.  Permutation entropy: A nonlinear statistical measure for status characterization of rotary machines , 2012 .

[68]  Pengjian Shang,et al.  Permutation complexity and dependence measures of time series , 2013 .

[69]  M. Silverman,et al.  Experimental tests for randomness of quantum decay examined as a Markov process , 2000 .

[70]  S. E. Shnoll,et al.  Fine structure of distributions in measurements of different processes as affected by geophysical and cosmophysical factors , 1999 .

[71]  Badong Chen,et al.  Weighted-permutation entropy: a complexity measure for time series incorporating amplitude information. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[72]  Evidence for correlations between fluctuations in 54Mn decay rates and solar storms , 2016 .

[73]  O. Rosso,et al.  Complexity-entropy causality plane: A useful approach to quantify the stock market inefficiency , 2010 .

[74]  L M Hively,et al.  Detecting dynamical changes in time series using the permutation entropy. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[75]  O. Rosso,et al.  A permutation information theory tour through different interest rate maturities: the Libor case , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[76]  Michael Hauhs,et al.  Ordinal pattern and statistical complexity analysis of daily stream flow time series , 2013 .