Generalized entropy plane based on permutation entropy and distribution entropy analysis for complex time series

Abstract Entropy is an accessible way to work as a measure of the irregularity and the uncertainty between the predicting knowledge and the given time series. Statistical complexity measure (SCM) combining Shannon entropy and the extensive Jensen–Shannon divergence provides important additional information regarding the peculiarities of the underlying probability distribution, not already detected by the entropy. In this paper, we extend the traditional complexity-entropy causality plane, which applies the diagram of SCM versus normalized Shannon entropy, to two generalized complexity-entropy plane based on Permutation entropy (PE) and Permuted distribution entropy (PEDisEn). Moreover, as the important extension of the Shannon entropy, the Tsallis entropy and Renyi entropy are used to construct the plane. We discuss the parameter selection for the PE plane and PEDisEn plane respectively. Outlier detection is recently a heated point focusing on discovering patterns that occur infrequently in the time series in data mining. However, there exists few entropy plane based methods in outlier detection. We apply the proposed procedure to the real world data for outlier detection. It turns out that the generalized entropy plane is robust to the type of original series and is efficient for detecting outliers.

[1]  Zbigniew R. Struzik,et al.  Wavelet transform based multifractal formalism in outlier detection and localisation for financial time series , 2002 .

[2]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[3]  Robert X. Gao,et al.  Mechanical Systems and Signal Processing Approximate Entropy as a Diagnostic Tool for Machine Health Monitoring , 2006 .

[4]  Steven M. Pincus,et al.  Approximate Entropy of Heart Rate as a Correlate of Postoperative Ventricular Dysfunction , 1993, Anesthesiology.

[5]  G. Crooks.  On Measures of Entropy and Information , 2015 .

[6]  Osvaldo A. Rosso,et al.  Intensive entropic non-triviality measure , 2004 .

[7]  O. Rosso,et al.  Complexity-entropy causality plane: A useful approach to quantify the stock market inefficiency , 2010 .

[8]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[9]  Sumiyoshi Abe,et al.  Nonextensive thermodynamic relations , 2000 .

[10]  L. Martyushev,et al.  Maximum entropy production principle in physics, chemistry and biology , 2006 .

[11]  Dingchang Zheng,et al.  Assessing the complexity of short-term heartbeat interval series by distribution entropy , 2014, Medical & Biological Engineering & Computing.

[12]  Pengjian Shang,et al.  Financial time series analysis based on effective phase transfer entropy , 2017 .

[13]  Geoff Boeing,et al.  Visual Analysis of Nonlinear Dynamical Systems: Chaos, Fractals, Self-Similarity and the Limits of Prediction , 2016, Syst..

[14]  C. Tsallis.  Introduction to Nonextensive Statistical Mechanics: Approaching a Complex World , 2009 .

[15]  C. Li,et al.  Model-based analysis of oligonucleotide arrays: expression index computation and outlier detection. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Douglas M. Hawkins.  Identification of Outliers , 1980, Monographs on Applied Probability and Statistics.

[17]  Ning-De Jin,et al.  Gas–liquid two-phase flow structure in the multi-scale weighted complexity entropy causality plane , 2016 .

[18]  Haroldo V. Ribeiro,et al.  Complexity-entropy causality plane: a useful approach for distinguishing songs , 2011, ArXiv.

[19]  Pengjian Shang,et al.  Compositional segmentation and complexity measurement in stock indices , 2016 .

[20]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[21]  Matthäus Staniek,et al.  Parameter Selection for Permutation Entropy Measurements , 2007, Int. J. Bifurc. Chaos.

[22]  Dong Wang,et al.  Entropy-Based Wavelet De-noising Method for Time Series Analysis , 2009, Entropy.

[23]  O. Rosso,et al.  Complexity–entropy analysis of daily stream flow time series in the continental United States , 2014, Stochastic Environmental Research and Risk Assessment.

[24]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[25]  H. Stanley,et al.  Detrended cross-correlation analysis: a new method for analyzing two nonstationary time series. , 2007, Physical review letters.

[26]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[27]  Extensive statistical mechanics based on nonadditive entropy: Canonical ensemble , 2006, cond-mat/0602219.

[28]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[29]  Christos Faloutsos,et al.  LOCI: fast outlier detection using the local correlation integral , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[30]  Nirvana Meratnia,et al.  Outlier Detection Techniques for Wireless Sensor Networks: A Survey , 2008, IEEE Communications Surveys & Tutorials.

[31]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[32]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Xiao Chen,et al.  A Complexity-Based Approach for the Detection of Weak Signals in Ocean Ambient Noise , 2016, Entropy.

[34]  O A Rosso,et al.  Distinguishing noise from chaos. , 2007, Physical review letters.

[35]  Ernesto P. Borges.  A possible deformed algebra and calculus inspired in nonextensive thermostatistics , 2003, cond-mat/0304545.