Assessment of cooperativity in complex systems with non-periodical dynamics: Comparison of five mutual information metrics

Quantitative assessment of cooperativity effects is essential for a better understanding of the interactions between system components that is an important step on the way from black-box to structural models of various complex dynamical systems. In this paper, we consider five widely used mutual information metrics and test their performance using simulated stochastic data series with introduced phase- or amplitude randomization as well as data series generated by chaotic maps. We show the performance of all studied methods in both stationary mode and during phase transitions, indicating specific coupling patterns they can reveal from the system dynamics, as well as certain properties they appear invariant to. Finally, we demonstrate how a combination of several metrics can be used for a more detailed analysis of dynamical systems exhibiting characteristic phase transitions, including examples of both simulated chaotic maps and observational data series from physiological and geophysical complex systems.

[1]  B. Fernandez,et al.  Dynamics of Coupled Map Lattices and of Related Spatially Extended Systems , 2008 .

[2]  Paul J. Roebber,et al.  The architecture of the climate network , 2004 .

[3]  Roberto A. Monetti,et al.  Long-term persistence in the sea surface temperature fluctuations , 2003 .

[4]  Plamen Ch. Ivanov,et al.  Major component analysis of dynamic networks of physiologic organ interactions , 2015, Journal of physics. Conference series.

[5]  A. Bunde,et al.  Superstatistical model of bacterial DNA architecture , 2017, Scientific Reports.

[6]  Plamen Ch. Ivanov,et al.  Coexisting Forms of Coupling and Phase-Transitions in Physiological Networks , 2014 .

[7]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[8]  Amir Bashan,et al.  Network physiology reveals relations between network topology and physiological function , 2012, Nature Communications.

[9]  T. Penzel,et al.  Modulations of Heart Rate, ECG, and Cardio-Respiratory Coupling Observed in Polysomnography , 2016, Front. Physiol..

[10]  H. Eduardo Roman,et al.  Long-time correlations of sea-level and local atmospheric pressure fluctuations at Trieste , 2005 .

[11]  Murad S. Taqqu.  The Modelling of Ethernet Data and of Signals that are Heavy‐tailed with Infinite Variance* , 2002 .

[12]  A. Porta,et al.  Causal relationships between heart period and systolic arterial pressure during graded head-up tilt. , 2011, American journal of physiology. Regulatory, integrative and comparative physiology.

[13]  A. Müller,et al.  Evidence for long‐term memory in sea level , 2014 .

[14]  R. Mantegna,et al.  Scaling behaviour in the dynamics of an economic index , 1995, Nature.

[15]  Mikhail I Bogachev,et al.  Analysis of blood pressure–heart rate feedback regulation under non-stationary conditions: beyond baroreflex sensitivity , 2009, Physiological measurement.

[16]  Shlomo Havlin,et al.  Scaling behaviour of heartbeat intervals obtained by wavelet-based time-series analysis , 1996, Nature.

[17]  S. Havlin,et al.  Long-term persistence and multifractality of precipitation and river runoff records , 2006 .

[18]  Shlomo Havlin,et al.  Forecasting the magnitude and onset of El Niño based on climate network , 2017, 1703.09138.

[19]  Mikhail I. Bogachev,et al.  Statistical modeling of the Internet traffic dynamics: To which extent do we need long-term correlations? , 2017 .

[20]  Armin Bunde,et al.  Precipitation and River Flow: Long‐Term Memory and Predictability of Extreme Events , 2013 .

[21]  Thomas Penzel,et al.  Comparison of detrended fluctuation analysis and spectral analysis for heart rate variability in sleep and sleep apnea , 2003, IEEE Transactions on Biomedical Engineering.

[22]  P. Raven,et al.  Human investigations into the arterial and cardiopulmonary baroreflexes during exercise , 2012, Experimental physiology.

[23]  Artur I. Karimov,et al.  Discrete chaotic maps obtained by symmetric integration , 2018, Physica A: Statistical Mechanics and its Applications.

[24]  S. Havlin,et al.  Emergence of El Niño as an autonomous component in the climate network. , 2010, Physical review letters.

[25]  R Quian Quiroga,et al.  Performance of different synchronization measures in real data: a case study on electroencephalographic signals. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  P. Novak,et al.  Quantitative Autonomic Testing , 2011, Journal of visualized experiments : JoVE.

[27]  Holger Kantz,et al.  Long-range correlations and rare events in boundary layer wind fields , 2005 .

[28]  Kang K. L. Liu,et al.  Focus on the emerging new fields of network physiology and network medicine , 2016, New journal of physics.

[29]  J. Stewart,et al.  The Arterial Baroreflex Resets with Orthostasis , 2012, Front. Physio..

[30]  S. Havlin,et al.  Correlated and uncorrelated regions in heart-rate fluctuations during sleep. , 2000, Physical review letters.

[31]  J. Strackee,et al.  Relationships between short-term blood-pressure fluctuations and heart-rate variability in resting subjects I: a spectral analysis approach , 1985, Medical and Biological Engineering and Computing.

[32]  Kang K. L. Liu,et al.  Network Physiology: How Organ Systems Dynamically Interact , 2015, PloS one.

[33]  Walter Willinger,et al.  Self-Similarity in High-Speed Packet Traffic: Analysis and Modeling of Ethernet Traffic Measurements , 1995 .

[34]  L. Vianna,et al.  Arterial baroreflex control of sympathetic nerve activity and heart rate in patients with type 2 diabetes. , 2016, American journal of physiology. Heart and circulatory physiology.

[35]  Armin Bunde,et al.  Universal Internucleotide Statistics in Full Genomes: A Footprint of the DNA Structure and Packaging? , 2014, PloS one.

[36]  L. Faes,et al.  Information dynamics of brain–heart physiological networks during sleep , 2014, New Journal of Physics.

[37]  L. Kocarev,et al.  Pseudorandom bits generated by chaotic maps , 2003 .

[38]  Monika Ritsch-Marte,et al.  A new method for change-point detection developed for on-line analysis of the heart beat variability during sleep , 2005 .

[39]  Phatak,et al.  Logistic map: A possible random-number generator. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[40]  Rosario N. Mantegna,et al.  Book Review: An Introduction to Econophysics, Correlations, and Complexity in Finance, N. Rosario, H. Mantegna, and H. E. Stanley, Cambridge University Press, Cambridge, 2000. , 2000 .

[41]  H E Stanley,et al.  Statistical physics and physiology: monofractal and multifractal approaches. , 1999, Physica A.

[42]  D. Nychka,et al.  Climate spectra and detecting climate change , 1992 .

[43]  James D. Hamilton.  Time Series Analysis , 1994 .

[44]  Frank Lunkeit,et al.  Non‐exponential return time distributions for vorticity extremes explained by fractional Poisson processes , 2015 .

[45]  J. Peinke,et al.  Turbulent cascades in foreign exchange markets , 1996, Nature.

[46]  A. Barabasi,et al.  Network science , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[47]  Murad S. Taqqu,et al.  A seasonal fractional ARIMA Model applied to the Nile River monthly flows at Aswan , 2000 .

[48]  Shlomo Havlin,et al.  Long-term persistence and multifractality of river runoff records: Detrended fluctuation studies , 2003 .

[49]  Armin Bunde,et al.  How significant is West Antarctic warming , 2014 .

[50]  Nicola Toschi,et al.  Uncovering brain–heart information through advanced signal and image processing , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[51]  Massimo Alioto,et al.  Low-hardware complexity PRBGs based on a piecewise-linear chaotic map , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[52]  G. Zaslavsky.  Chaos, fractional kinetics, and anomalous transport , 2002 .

[53]  Shlomo Havlin,et al.  Improved El Niño forecasting by cooperativity detection , 2013, Proceedings of the National Academy of Sciences.

[54]  S. Havlin,et al.  Indication of a Universal Persistence Law Governing Atmospheric Variability , 1998 .

[55]  Armin Bunde,et al.  Fractals and Multifractals in Geophysical Time Series , 2017 .

[56]  Shlomo Havlin,et al.  Influence of autocorrelation on the topology of the climate network. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  A. Bunde,et al.  On the Occurence of Extreme Events in Long-term Correlated and Multifractal Data Sets , 2008 .

[58]  D. Sornette,et al.  ”Direct” causal cascade in the stock market , 1998 .

[59]  Shlomo Havlin,et al.  Very early warning of next El Niño , 2014, Proceedings of the National Academy of Sciences.

[60]  S. Havlin,et al.  Experimental evidence for phase synchronization transitions in the human cardiorespiratory system. , 2007, Physical review letters.

[61]  Jeffrey M. Hausdorff,et al.  Fractal dynamics in physiology: Alterations with disease and aging , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[62]  L. Amaral,et al.  Multifractality in human heartbeat dynamics , 1998, Nature.

[63]  S. Havlin,et al.  Climate networks around the globe are significantly affected by El Niño. , 2008, Physical review letters.

[64]  Ronny P Bartsch,et al.  Quantifying cardio-respiratory phase synchronization—a comparison of five methods using ECGs of post-infarction patients , 2017, Physiological measurement.

[65]  Shlomo Havlin,et al.  Neuronal noise as an origin of sleep arousals and its role in sudden infant death syndrome , 2018, Science Advances.

[66]  Herbert Witte,et al.  Time-variant coherence between heart rate variability and EEG activity in epileptic patients: an advanced coupling analysis between physiological networks , 2014 .

[67]  Robert M Corless,et al.  Numerical methods can suppress chaos , 1991 .

[68]  Shlomo Havlin,et al.  Network science: a useful tool in economics and finance , 2015, Mind & Society.

[69]  S. A. Pyko,et al.  Mutual synchronization pattern as a complementary indicator of the short-term blood pressure – heart rate feedback regulation activity , 2018, bioRxiv.

[70]  I. Sokolov,et al.  Anomalous transport : foundations and applications , 2008 .

[71]  P. Hubert,et al.  Multifractal analysis and modeling of rainfall and river flows and scaling, causal transfer functions , 1996 .

[72]  A. Bunde,et al.  Universality in the precipitation and river runoff , 2012 .

[73]  Albert-Lszl Barabsi,et al.  Network Science , 2016, Encyclopedia of Big Data.

[74]  M. Bogachev,et al.  Universal model for collective access patterns in the Internet traffic dynamics: A superstatistical approach , 2016 .

[75]  D. Turcotte,et al.  Nonlinear Dynamics of Natural Hazards , 2007 .

[76]  Monika Ritsch-Marte,et al.  Temporally Resolved Fluctuation Analysis of Sleep ECG , 2007, Journal of biological physics.

[77]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[78]  M. Bogachev,et al.  Multiscale variation model and activity level estimation algorithm of the Earth's magnetic field based on wavelet packets , 2018, Annales Geophysicae.

[79]  Manfred Mudelsee,et al.  Long memory of rivers from spatial aggregation , 2007 .