On Entropy of Probability Integral Transformed Time Series

The goal of this paper is to investigate the changes of entropy estimates when the amplitude distribution of the time series is equalized using the probability integral transformation. The data we analyzed were with known properties—pseudo-random signals with known distributions, mutually coupled using statistical or deterministic methods that include generators of statistically dependent distributions, linear and non-linear transforms, and deterministic chaos. The signal pairs were coupled using a correlation coefficient ranging from zero to one. The dependence of the signal samples is achieved by moving average filter and non-linear equations. The applied coupling methods are checked using statistical tests for correlation. The changes in signal regularity are checked by a multifractal spectrum. The probability integral transformation is then applied to cardiovascular time series—systolic blood pressure and pulse interval—acquired from the laboratory animals and represented the results of entropy estimations. We derived an expression for the reference value of entropy in the probability integral transformed signals. We also experimentally evaluated the reliability of entropy estimates concerning the matching probabilities.

[1]  Hagen Malberg,et al.  Nonlinear Methods of Cardiovascular Physics and their Clinical Applicability , 2007, Int. J. Bifurc. Chaos.

[2]  Harald Schuh,et al.  A new hybrid method to improve the ultra-short-term prediction of LOD , 2020, Journal of Geodesy.

[3]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[4]  Vasilios Papaioannou,et al.  Investigation of heart rate and blood pressure variability, baroreflex sensitivity, and approximate entropy in acute brain injury patients. , 2008, Journal of critical care.

[5]  Guillaume A. Rousselet,et al.  A statistical framework for neuroimaging data analysis based on mutual information estimated via a gaussian copula , 2016, bioRxiv.

[6]  Bill Ravens,et al.  An Introduction to Copulas , 2000, Technometrics.

[7]  Michel C. Jeruchim,et al.  Techniques for Estimating the Bit Error Rate in the Simulation of Digital Communication Systems , 1984, IEEE J. Sel. Areas Commun..

[8]  P. Grassberger,et al.  Estimation of the Kolmogorov entropy from a chaotic signal , 1983 .

[9]  Nathaniel H. Hunt,et al.  The Appropriate Use of Approximate Entropy and Sample Entropy with Short Data Sets , 2012, Annals of Biomedical Engineering.

[10]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[11]  F Nguyen,et al.  Local estimates of Hölder exponents in turbulent vector fields. , 2019, Physical review. E.

[12]  Wangxin Yu,et al.  Characterization of Surface EMG Signal Based on Fuzzy Entropy , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Alexander Marshak,et al.  Approximate Entropy and Sample Entropy: A Comprehensive Tutorial , 2019, Entropy.

[14]  Dragana Bajic,et al.  On Consistency of Cross-Approximate Entropy in Cardiovascular and Artificial Environments , 2017, Complex..

[15]  Agnieszka Szczesna Quaternion Entropy for Analysis of Gait Data , 2019, Entropy.

[16]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[17]  Giuseppe Baselli,et al.  Measuring regularity by means of a corrected conditional entropy in sympathetic outflow , 1998, Biological Cybernetics.

[18]  Thomas Dimpfl,et al.  RTransferEntropy - Quantifying information flow between different time series using effective transfer entropy , 2019, SoftwareX.

[19]  K. Chon,et al.  Approximate entropy for all signals , 2009, IEEE Engineering in Medicine and Biology Magazine.

[20]  Hui Chen,et al.  Cardiovascular autonomic function analysis using approximate entropy from 24-h heart rate variability and its frequency components in patients with type 2 diabetes , 2014, Journal of diabetes investigation.

[21]  Paolo Castiglioni,et al.  Information-Domain Analysis of Cardiovascular Complexity: Night and Day Modulations of Entropy and the Effects of Hypertension , 2019, Entropy.

[22]  R. F. Brown,et al.  PERFORMANCE EVALUATION , 2019, ISO 22301:2019 and business continuity management – Understand how to plan, implement and enhance a business continuity management system (BCMS).

[23]  A L Goldberger,et al.  Gender- and age-related differences in heart rate dynamics: are women more complex than men? , 1994, Journal of the American College of Cardiology.

[24]  T. Smuc,et al.  The Chaos Theory and Non-linear Dynamics in Heart Rate Variability in Patients with Heart Failure , 2008, 2008 Computers in Cardiology.

[25]  Paul Embrechts,et al.  A note on generalized inverses , 2013, Math. Methods Oper. Res..

[26]  L F Zhang,et al.  Age dependency and correlation of heart rate variability, blood pressure variability and baroreflex sensitivity. , 2000, Journal of gravitational physiology : a journal of the International Society for Gravitational Physiology.

[27]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[28]  A P Blaber,et al.  Methodology of spontaneous baroreflex relationship assessed by surrogate data analysis. , 1995, The American journal of physiology.

[29]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[30]  Hsien-Tsai Wu,et al.  Multiscale Cross-Approximate Entropy Analysis as a Measurement of Complexity between ECG R-R Interval and PPG Pulse Amplitude Series among the Normal and Diabetic Subjects , 2013, Comput. Math. Methods Medicine.

[31]  Niels-Henrik Holstein-Rathlou,et al.  Approximate entropy and point correlation dimension of heart rate variability in healthy subjects , 1998, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[32]  M Vallverdú,et al.  Dimensional analysis of HRV in hypertrophic cardiomyopathy patients. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[33]  Gustavo Deco,et al.  Information dynamics - foundations and applications , 2000 .

[34]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[35]  Tatjana Loncar-Turukalo,et al.  Unbiased entropy estimates in stress: A parameter study , 2012, Comput. Biol. Medicine.

[36]  J. Bendat,et al.  Random Data: Analysis and Measurement Procedures , 1987 .

[37]  Herbert F. Jelinek,et al.  ECG Time Series Variability Analysis : Engineering and Medicine , 2017 .

[38]  Ramesh Kumar Sunkaria,et al.  Cardiac variability time-series analysis by sample entropy and multiscale entropy , 2015, Int. J. Medical Eng. Informatics.

[39]  David Murphy,et al.  Autonomic mechanisms underpinning the stress response in borderline hypertensive rats , 2011, Experimental physiology.

[40]  Christina Anagnostopoulou,et al.  Joint distribution of temperature and precipitation in the Mediterranean, using the Copula method , 2019, Theoretical and Applied Climatology.

[41]  Z. Hao,et al.  Entropy‐copula method for single‐site monthly streamflow simulation , 2012 .

[42]  Jun Zheng,et al.  Complexity Change in Cardiovascular Disease , 2017, International journal of biological sciences.

[43]  Ki H. Chon,et al.  Automatic Selection of the Threshold Value $r$ for Approximate Entropy , 2008, IEEE Transactions on Biomedical Engineering.

[44]  Ivy Liu,et al.  Analysis of Ordinal Categorical Data, 2nd edn by Alan Agresti , 2011 .

[45]  Dragana Bajic,et al.  Binarized cross-approximate entropy in crowdsensing environment , 2017, Comput. Biol. Medicine.

[46]  Steven M. Pincus,et al.  Older males secrete luteinizing hormone and testosterone more irregularly, and jointly more asynchronously, than younger males. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Mika P. Tarvainen,et al.  An advanced detrending method with application to HRV analysis , 2002, IEEE Transactions on Biomedical Engineering.

[48]  Dragana Bajic,et al.  Copula as a dynamic measure of cardiovascular signal interactions , 2018, Biomed. Signal Process. Control..

[49]  Jean-Marie Gorce,et al.  Copula-Based Interference Models for IoT Wireless Networks , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[50]  Kumar Sunkaria Ramesh The Deterministic Chaos in Heart Rate Variability Signal and Analysis Techniques , 2011 .

[51]  T. Seppänen,et al.  Quantitative beat-to-beat analysis of heart rate dynamics during exercise. , 1996, The American journal of physiology.

[52]  Han Ping Hong,et al.  Reliability of Tower and Tower-Line Systems under Spatiotemporally Varying Wind or Earthquake Loads , 2017 .

[53]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[54]  Tzu-Kang Lin,et al.  Performance Evaluation of an Entropy-Based Structural Health Monitoring System Utilizing Composite Multiscale Cross-Sample Entropy , 2019, Entropy.

[55]  Zengqi Sun,et al.  Mutual information is copula entropy , 2008, ArXiv.

[56]  A. Frigessi,et al.  Pair-copula constructions of multiple dependence , 2009 .

[57]  P. McCullagh Analysis of Ordinal Categorical Data , 1985 .

[58]  Pramod K. Varshney,et al.  Quantifying EEG synchrony using copulas , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  M. Sklar Fonctions de repartition a n dimensions et leurs marges , 1959 .

[60]  Christopher G. Wilson,et al.  The effect of time delay on Approximate & Sample Entropy calculations , 2008 .

[61]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.