Intrinsic Entropy: A Novel Adaptive Method for Measuring the Instantaneous Complexity of Time Series

The determination of appropriate parameters and an appropriate window size in most entropy-based measurements of time-series complexity is a challenging problem. Inappropriate settings can lead to the loss of intrinsic information within a time series. Therefore, two parameter-free methods, namely the intrinsic entropy (IE) and ensemble IE (eIE) methods, are proposed in this paper. The eIE method requires two parameters, which can be easily determined through an orthogonality test. The proposed approaches can measure instantaneous complexity; thus, they do not require a predetermined window size. White noise and three other varieties of colored noise were used to test the stability of the proposed methods, and five types of synthetic signals and logistic maps were applied for measuring instantaneous complexity and regularity. The results revealed that the IE and eIE methods exhibit satisfactory stability. Both methods provide point-by-point entropy measures for time series. The eIE method is useful for measuring the complexity of frequency and amplitude modulation. Furthermore, the periodicity of time series can be detected using the two proposed methods.

[1]  Chung-Kang Peng,et al.  Causal decomposition in the mutual causation system , 2017, Nature Communications.

[2]  Hamed Azami,et al.  Refined Composite Multiscale Dispersion Entropy and its Application to Biomedical Signals , 2016, IEEE Transactions on Biomedical Engineering.

[3]  N. Huang,et al.  On Holo-Hilbert spectral analysis: a full informational spectral representation for nonlinear and non-stationary data , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[4]  Hamed Azami,et al.  Dispersion Entropy: A Measure for Time-Series Analysis , 2016, IEEE Signal Processing Letters.

[5]  Tzu-Chien Hsiao,et al.  Breathing Pattern Recognition of Abdominal Wall movement by using Ensemble Empirical mode Decomposition , 2014, Adv. Data Sci. Adapt. Anal..

[6]  Dominique Zosso,et al.  Variational Mode Decomposition , 2014, IEEE Transactions on Signal Processing.

[7]  Jérôme Gilles,et al.  Empirical Wavelet Transform , 2013, IEEE Transactions on Signal Processing.

[8]  Norden E. Huang,et al.  Complementary Ensemble Empirical Mode Decomposition: a Novel Noise Enhanced Data Analysis Method , 2010, Adv. Data Sci. Adapt. Anal..

[9]  Norden E. Huang,et al.  On Instantaneous Frequency , 2009, Adv. Data Sci. Adapt. Anal..

[10]  Yang Yu,et al.  A roller bearing fault diagnosis method based on EMD energy entropy and ANN , 2006 .

[11]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  N. Huang,et al.  A study of the characteristics of white noise using the empirical mode decomposition method , 2004, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[13]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[14]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[15]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[16]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[17]  H. Fogedby On the phase space approach to complexity , 1992 .

[18]  T. Inouye,et al.  Quantification of EEG irregularity by use of the entropy of the power spectrum. , 1991, Electroencephalography and clinical neurophysiology.

[19]  J. Shore,et al.  Which is the better entropy expression for speech processing: -S log S or log S? , 1984 .

[20]  P. Grassberger,et al.  Estimation of the Kolmogorov entropy from a chaotic signal , 1983 .

[21]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[22]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[23]  J. Kurths,et al.  A Comparative Classification of Complexity Measures , 1994 .