Coarse-Graining Approaches in Univariate Multiscale Sample and Dispersion Entropy

The evaluation of complexity in univariate signals has attracted considerable attention in recent years. This is often done using the framework of Multiscale Entropy, which entails two basic steps: coarse-graining to consider multiple temporal scales, and evaluation of irregularity for each of those scales with entropy estimators. Recent developments in the field have proposed modifications to this approach to facilitate the analysis of short-time series. However, the role of the downsampling in the classical coarse-graining process and its relationships with alternative filtering techniques has not been systematically explored yet. Here, we assess the impact of coarse-graining in multiscale entropy estimations based on both Sample Entropy and Dispersion Entropy. We compare the classical moving average approach with low-pass Butterworth filtering, both with and without downsampling, and empirical mode decomposition in Intrinsic Multiscale Entropy, in selected synthetic data and two real physiological datasets. The results show that when the sampling frequency is low or high, downsampling respectively decreases or increases the entropy values. Our results suggest that, when dealing with long signals and relatively low levels of noise, the refine composite method makes little difference in the quality of the entropy estimation at the expense of considerable additional computational cost. It is also found that downsampling within the coarse-graining procedure may not be required to quantify the complexity of signals, especially for short ones. Overall, we expect these results to contribute to the ongoing discussion about the development of stable, fast and robust-to-noise multiscale entropy techniques suited for either short or long recordings.

[1]  H. Fogedby On the phase space approach to complexity , 1992 .

[2]  Shamim Nemati,et al.  Respiration and heart rate complexity: Effects of age and gender assessed by band-limited transfer entropy , 2013, Respiratory Physiology & Neurobiology.

[3]  Yi-Cheng Zhang Complexity and 1/f noise. A phase space approach , 1991 .

[4]  Ralph G Andrzejak,et al.  Nonrandomness, nonlinear dependence, and nonstationarity of electroencephalographic recordings from epilepsy patients. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  N. Huang,et al.  A study of the characteristics of white noise using the empirical mode decomposition method , 2004, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[6]  H. Azami,et al.  Refined composite multivariate generalized multiscale fuzzy entropy: A tool for complexity analysis of multichannel signals , 2017 .

[7]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[8]  David J. Hewson,et al.  Intrinsic Mode Entropy for Nonlinear Discriminant Analysis , 2007, IEEE Signal Processing Letters.

[9]  S. Guzzetti,et al.  Physiological time-series analysis using approximate entropy and sample entropy , 2000 .

[10]  Hamed Azami,et al.  Refined multiscale fuzzy entropy based on standard deviation for biomedical signal analysis , 2016, Medical & Biological Engineering & Computing.

[11]  Eberhard F. Kochs,et al.  Permutation Entropy: Too Complex a Measure for EEG Time Series? , 2017, Entropy.

[12]  Shuen-De Wu,et al.  Refined scale-dependent permutation entropy to analyze systems complexity , 2016 .

[13]  Michael Unser,et al.  B-spline signal processing. I. Theory , 1993, IEEE Trans. Signal Process..

[14]  Doreen Meier,et al.  Chaotic Dynamics An Introduction , 2016 .

[15]  Dominique Zosso,et al.  Variational Mode Decomposition , 2014, IEEE Transactions on Signal Processing.

[16]  R. Thuraisingham,et al.  On multiscale entropy analysis for physiological data , 2006 .

[17]  Gilbert Strang,et al.  Wavelets from filter banks , 1996 .

[18]  Paolo Castiglioni,et al.  Multiscale Sample Entropy of Cardiovascular Signals: Does the Choice between Fixed- or Varying-Tolerance among Scales Influence Its Evaluation and Interpretation? , 2017, Entropy.

[19]  Gabriel Rilling,et al.  Empirical mode decomposition as a filter bank , 2004, IEEE Signal Processing Letters.

[20]  Wangxin Yu,et al.  Characterization of Surface EMG Signal Based on Fuzzy Entropy , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Hamed Azami,et al.  Multivariate Multiscale Dispersion Entropy of Biomedical Times Series , 2017, Entropy.

[22]  Yaneer Bar-Yam,et al.  Dynamics Of Complex Systems , 2019 .

[23]  Shuen-De Wu,et al.  Refined Multiscale Hilbert–Huang Spectral Entropy and Its Application to Central and Peripheral Cardiovascular Data , 2016, IEEE Transactions on Biomedical Engineering.

[24]  Meng Xu,et al.  Analysis of financial time series using multiscale entropy based on skewness and kurtosis , 2018 .

[25]  S. Sakata,et al.  Spectral characteristics of ventricular response to atrial fibrillation. , 1997, The American journal of physiology.

[26]  Danilo P Mandic,et al.  Multivariate multiscale entropy: a tool for complexity analysis of multichannel data. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Luiz Otavio Murta Junior,et al.  Multiscale entropy-based methods for heart rate variability complexity analysis , 2015 .

[28]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[29]  Anne Humeau-Heurtier,et al.  The Multiscale Entropy Algorithm and Its Variants: A Review , 2015, Entropy.

[30]  Ary L. Goldberger,et al.  Generalized Multiscale Entropy Analysis: Application to Quantifying the Complex Volatility of Human Heartbeat Time Series , 2015, Entropy.

[31]  U. Rajendra Acharya,et al.  Application of Entropy Measures on Intrinsic Mode Functions for the Automated Identification of Focal Electroencephalogram Signals , 2015, Entropy.

[32]  Pere Caminal,et al.  Refined Multiscale Entropy: Application to 24-h Holter Recordings of Heart Period Variability in Healthy and Aortic Stenosis Subjects , 2009, IEEE Transactions on Biomedical Engineering.

[33]  C. Peng,et al.  Analysis of complex time series using refined composite multiscale entropy , 2014 .

[34]  S. Biyiksiz,et al.  Multirate digital signal processing , 1985, Proceedings of the IEEE.

[35]  L. Liebovitch,et al.  "Fractal dynamics of human gait: stability of long-range correlations in stride interval fluctuations". , 1996, Journal of applied physiology.

[36]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[38]  Christopher G. Wilson,et al.  The effect of time delay on Approximate & Sample Entropy calculations , 2008 .

[39]  Hamed Azami,et al.  Refined Composite Multiscale Dispersion Entropy and its Application to Biomedical Signals , 2016, IEEE Transactions on Biomedical Engineering.

[40]  S. Tsai,et al.  Is mental illness complex? From behavior to brain , 2013, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[41]  Chung-Kang Peng,et al.  Multiscale Entropy Analysis of Center-of-Pressure Dynamics in Human Postural Control: Methodological Considerations , 2015, Entropy.

[42]  Hamed Azami,et al.  Dispersion Entropy: A Measure for Time-Series Analysis , 2016, IEEE Signal Processing Letters.

[43]  Ku Ruhana Ku-Mahamud,et al.  Rule pruning techniques in the ant-miner classification algorithm and its variants: A review , 2018, 2018 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE).

[44]  C. Peng,et al.  What is physiologic complexity and how does it change with aging and disease? , 2002, Neurobiology of Aging.

[45]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.