Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System

This review provides a summary of methods originated in (non-equilibrium) statistical mechanics and information theory, which have recently found successful applications to quantitatively studying complexity in various components of the complex system Earth. Specifically, we discuss two classes of methods: (i) entropies of different kinds (e.g., on the one hand classical Shannon and R´enyi entropies, as well as non-extensive Tsallis entropy based on symbolic dynamics techniques and, on the other hand, approximate entropy, sample entropy and fuzzy entropy); and (ii) measures of statistical interdependence and causality (e.g., mutual information and generalizations thereof, transfer entropy, momentary information transfer). We review a number of applications and case studies utilizing the above-mentioned methodological approaches for studying contemporary problems in some exemplary fields of the Earth sciences, highlighting the potentials of different techniques.

[1]  Daniel N. Baker,et al.  Phase transition‐like behavior of the magnetosphere during substorms , 2000 .

[2]  M. Kalimeri,et al.  Nonextensivity and universality in the earthquake preparation process. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Nathaniel A. Brunsell,et al.  Assessing the multi-resolution information content of remotely sensed variables and elevation for evapotranspiration in a tall-grass prairie environment , 2008 .

[4]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[5]  Milan Paluš,et al.  Non-linear dependence and teleconnections in climate data: sources, relevance, nonstationarity , 2012, Climate Dynamics.

[6]  John B. Rundle,et al.  Statistical physics approach to understanding the multiscale dynamics of earthquake fault systems , 2003 .

[7]  M. Paluš.  Detecting Nonlinearity in Multivariate Time Series , 1996 .

[8]  Daniele Marinazzo,et al.  Radial basis function approach to nonlinear Granger causality of time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Shlomo Havlin,et al.  Power-law persistence in the atmosphere and in the oceans , 2002 .

[10]  Tom Changa,et al.  Self-organized criticality , multi-fractal spectra , sporadic localized reconnections and intermittent turbulence in the magnetotail , 1999 .

[11]  Georgios Balasis,et al.  Dynamical complexity in Dst time series using non‐extensive Tsallis entropy , 2008 .

[12]  Andreas Groth.  Visualization of coupling in time series by order recurrence plots. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  D. Sornette.  Critical Phenomena in Natural Sciences: Chaos, Fractals, Selforganization and Disorder: Concepts and Tools , 2000 .

[14]  Pierre Gaspard,et al.  Toward a probabilistic approach to complex systems , 1994 .

[15]  Andrea Rapisarda,et al.  Complexity, Metastability and Nonextensivity, , 2005 .

[16]  Annette Witt,et al.  Holocene climate variability on millennial scales recorded in Greenland ice cores , 2005 .

[17]  Masashi Hayakawa,et al.  Fractal analysis of ULF electromagnetic emissions in possible association with earthquakes in China , 2012 .

[18]  R. Donner,et al.  Symbolic recurrence plots: A new quantitative framework for performance analysis of manufacturing networks , 2008 .

[19]  P. Grassberger,et al.  Estimation of the Kolmogorov entropy from a chaotic signal , 1983 .

[20]  Georgios Balasis,et al.  From pre-storm activity to magnetic storms: A transition described in terms of fractal dynamics , 2006 .

[21]  Jürgen Kurths,et al.  Escaping the curse of dimensionality in estimating multivariate transfer entropy. , 2012, Physical review letters.

[22]  Jonathan F. Donges,et al.  Geometric detection of coupling directions by means of inter-system recurrence networks , 2012, 1301.0934.

[23]  Ferdouz V. Cochran,et al.  Comparing Surface and Mid-Tropospheric CO2 Concentrations from Central U.S. Grasslands , 2013, Entropy.

[24]  John B. Rundle,et al.  Earthquakes: Complexity and Extreme Events , 2013 .

[25]  Daniel Chicharro,et al.  Reliable detection of directional couplings using rank statistics. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Milan Paluš,et al.  Discerning connectivity from dynamics in climate networks , 2011 .

[27]  Klaus Fraedrich,et al.  Scaling of atmosphere and ocean temperature correlations in observations and climate models. , 2003, Physical review letters.

[28]  Jürgen Kurths,et al.  Order patterns recurrence plots in the analysis of ERP data , 2007, Cognitive Neurodynamics.

[29]  Alejandra Figliola,et al.  Entropy analysis of the dynamics of El Niño/Southern Oscillation during the Holocene , 2010 .

[30]  Praveen Kumar,et al.  Ecohydrologic process networks: 2. Analysis and characterization , 2009 .

[31]  Daniel N. Baker,et al.  Radiation belts and ring current , 2007 .

[32]  O A Rosso,et al.  Distinguishing noise from chaos. , 2007, Physical review letters.

[33]  Martín Gómez Ravetti,et al.  Analyzing complex networks evolution through Information Theory quantifiers , 2011 .

[34]  Vittorio Sgrigna,et al.  Mechanical and electromagnetic phenomena accompanying pre-seismic deformation: From laboratory to geophysical scale , 2007 .

[35]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[36]  Stelios M. Potirakis,et al.  A multidisciplinary analysis for traces of the last state of earthquake generation in preseismic electromagnetic emissions , 2011 .

[37]  D. Maraun,et al.  Epochs of phase coherence between El Niño/Southern Oscillation and Indian monsoon , 2005 .

[38]  B. McMillan.  The Basic Theorems of Information Theory , 1953 .

[39]  A. Jiménez,et al.  A complex network model for seismicity based on mutual information , 2013 .

[40]  R. Dahlhaus.  Graphical interaction models for multivariate time series1 , 2000 .

[41]  Georgios Balasis,et al.  Scaling similarities of multiple fracturing of solid materials , 2004 .

[42]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[43]  S. Havlin,et al.  Climate Networks Based on Phase Synchronization Analysis Track El-Nino(Complex Networks,Econophysics-Physical Approach to Social and Economic Phenomena-) , 2009 .

[44]  K. Eftaxias,et al.  Monitoring of a preseismic phase from its electromagnetic precursors. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Cristina Masoller,et al.  Inferring interdependencies in climate networks constructed at inter-annual, intra-season and longer time scales , 2013 .

[46]  Marcelo P. de Albuquerque,et al.  Nonadditive Tsallis entropy applied to the Earths climate , 2011 .

[47]  Los Angeles,et al.  Preferential Acceleration of Coherent Magnetic Structures and Bursty Bulk Flows in Earth's Magnetotail , 2001, physics/0106098.

[48]  K. Eftaxias,et al.  Natural time analysis of critical phenomena: the case of pre-fracture electromagnetic emissions. , 2013, Chaos.

[49]  Vassilis Angelopoulos,et al.  Evidence for intermittency in Earth’s plasma sheet and implications for self-organized criticality , 1999 .

[50]  James Theiler,et al.  Generalized redundancies for time series analysis , 1995 .

[51]  Ralph G. Andrzejak,et al.  Detecting event-related time-dependent directional couplings , 2006 .

[52]  Vadim M. Uritsky,et al.  Low frequency 1/f-like fluctuations of the AE-index as a possible manifestation of self-organized criticality in the magnetosphere , 1998 .

[53]  Steven M. Pincus,et al.  Quantification of hormone pulsatility via an approximate entropy algorithm. , 1992, The American journal of physiology.

[54]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[55]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[56]  G. T. Walker,et al.  CORRELATION IN SEASONAL VARIATIONS OF WEATHER—A FURTHER STUDY OF WORLD WEATHER1 , 1925 .

[57]  C. Tsallis.  Generalized entropy-based criterion for consistent testing , 1998 .

[58]  J. Sprott.  Chaos and time-series analysis , 2001 .

[59]  Masashi Hayakawa,et al.  Current status of seismo-electromagnetics for short-term earthquake prediction , 2010 .

[60]  Shlomo Havlin,et al.  Lack of scaling in global climate models , 2002 .

[61]  Georgios Balasis,et al.  Investigating dynamical complexity in the magnetosphere using various entropy measures , 2009 .

[62]  K. Eftaxias,et al.  Linking electromagnetic precursors with earthquake dynamics: An approach based on nonextensive fragment and self-affine asperity models , 2011, 1111.4829.

[63]  D. Vassiliadis,et al.  Intense space storms: Critical issues and open disputes , 2003 .

[64]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[65]  Giuseppe Consolini,et al.  Sandpile cellular automata and magnetospheric dynamics. , 1997 .

[66]  Weiting Chen,et al.  Measuring complexity using FuzzyEn, ApEn, and SampEn. , 2009, Medical engineering & physics.

[67]  Didier Sornette,et al.  Predictability of catastrophic events: Material rupture, earthquakes, turbulence, financial crashes, and human birth , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[68]  Masahisa Sugiura,et al.  An attempt to delineate very low frequency electromagnetic signals associated with earthquakes , 2001 .

[69]  Annick Lesne,et al.  Recurrence Plots for Symbolic Sequences , 2010, Int. J. Bifurc. Chaos.

[70]  K. Mellanby.  How Nature works , 1978, Nature.

[71]  S. Frenzel,et al.  Partial mutual information for coupling analysis of multivariate time series. , 2007, Physical review letters.

[72]  Norbert Marwan,et al.  Spatial structures and directionalities in Monsoonal precipitation over South Asia , 2010 .

[73]  K. Keller,et al.  Permutation entropy: One concept, two approaches , 2013 .

[74]  A. Deschamps,et al.  High-frequency seismo-electromagnetic effects , 1993 .

[75]  Jürgen Kurths,et al.  Quantifying Causal Coupling Strength: A Lag-specific Measure For Multivariate Time Series Related To Transfer Entropy , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[76]  Konstantinos Papadopoulos,et al.  Reconstruction of low‐dimensional magnetospheric dynamics by singular spectrum analysis , 1993 .

[77]  Markus Reichstein,et al.  Detection and attribution of large spatiotemporal extreme events in Earth observation data , 2013, Ecol. Informatics.

[78]  P. Grassberger,et al.  Characterization of Strange Attractors , 1983 .

[79]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[80]  Christophe Letellier,et al.  Estimating the Shannon entropy: recurrence plots versus symbolic dynamics. , 2006, Physical review letters.

[81]  Reik V. Donner,et al.  Nonlinear time series analysis in the geosciences : applications in climatology, geodynamics and solar terrestrial physics , 2008 .

[82]  Georgios Balasis,et al.  Universality in solar flare, magnetic storm and earthquake dynamics using Tsallis statistical mechanics , 2011 .

[83]  Praveen Kumar,et al.  Information Driven Ecohydrologic Self-Organization , 2010, Entropy.

[84]  Michael Hauhs,et al.  Ordinal pattern and statistical complexity analysis of daily stream flow time series , 2013 .

[85]  Konstantinos Papadopoulos,et al.  Low-dimensional chaos in magnetospheric activity from AE time series , 1990 .

[86]  R Quian Quiroga,et al.  Performance of different synchronization measures in real data: a case study on electroencephalographic signals. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[87]  Giuseppe Consolini,et al.  Nonlinear Processes in Geophysics On the multi-scale nature of large geomagnetic storms : an empirical mode decomposition analysis , 2012 .

[88]  Edward J. Smith,et al.  The nonlinear response of AE to the IMF BS driver: A spectral break at 5 hours , 1990 .

[89]  M. Scheffer,et al.  Slowing down as an early warning signal for abrupt climate change , 2008, Proceedings of the National Academy of Sciences.

[90]  Werner Ebeling,et al.  Word frequency and entropy of symbolic sequences: a dynamical perspective , 1992 .

[91]  Richard J. Telford,et al.  All age–depth models are wrong: but how badly? , 2004 .

[92]  S. Carpenter,et al.  Early-warning signals for critical transitions , 2009, Nature.

[93]  B. Klecker,et al.  Multi-scale magnetic field intermittence in the plasma sheet , 2003 .

[94]  B. Pompe,et al.  On some entropy methods in data analysis , 1994 .

[95]  S. M. Watson,et al.  Multifractal modeling of magnetic storms via symbolic dynamics analysis , 2005 .

[96]  G. L. Ferri,et al.  Tsallis’ q-triplet and the ozone layer , 2010 .

[97]  Stephen Wolfram,et al.  A New Kind of Science , 2003, Artificial Life.

[98]  Constantinos Papadimitriou,et al.  Similarities between extreme events in the solar-terrestrial system by means of nonextensivity , 2011 .

[99]  Praveen Kumar,et al.  Ecohydrologic process networks: 1. Identification , 2009 .

[100]  P. Rapp,et al.  Statistical validation of mutual information calculations: comparison of alternative numerical algorithms. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[101]  Aleksandr Yakovlevich Khinchin,et al.  Mathematical foundations of information theory , 1959 .

[102]  Giuseppe Consolini,et al.  Sign‐singularity analysis of current disruption , 1999 .

[103]  Masashi Hayakawa,et al.  Fractal analysis of ULF geomagnetic data associated with the Guam Earthquake on August 8, 1993 , 1999 .

[104]  Norbert Marwan,et al.  Dynamical regimes and transitions in Plio-Pleistocene Asian monsoon , 2012 .

[105]  Constantino Tsallis.  Dynamical scenario for nonextensive statistical mechanics , 2004 .

[106]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[107]  Jonathan F. Donges,et al.  Comparing linear and nonlinear network construction methods , 2009 .

[108]  秦 浩起,et al.  Characterization of Strange Attractor (カオスとその周辺(基研長期研究会報告)) , 1987 .

[109]  F. Dale Morgan,et al.  Electromagnetic precursors to earthquakes in the Ulf band: A review of observations and mechanisms , 1993 .

[110]  Giuseppe Consolini,et al.  SELF-ORGANIZED CRITICALITY: A NEW PARADIGM FOR THE MAGNETOTAIL DYNAMICS , 2002 .

[111]  Panayiotis A. Varotsos,et al.  The physics of seismic electric signals , 2005 .

[112]  Giuseppe Consolini,et al.  Symmetry Breaking and Nonlinear Wave‐Wave Interaction in Current Disruption: Possible Evidence for a Phase Transition , 2013 .

[113]  A. Kraskov,et al.  Bivariate surrogate techniques: necessity, strengths, and caveats. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[114]  M. Gokhberg,et al.  Experimental measurement of electromagnetic emissions possibly related to earthquakes in Japan , 1982 .

[115]  K. Eftaxias,et al.  The Earth as a living planet: human-type diseases in the earthquake preparation process , 2013 .

[116]  Giuseppe Consolini,et al.  Magnetic Field Topology and Criticality in Geotail Dynamics: Relevance to Substorm Phenomena , 2001 .

[117]  M. S. Lazaridou,et al.  Latest aspects of earthquake prediction in Greece based on seismic electric signals, II☆ , 1993 .

[118]  Timothy M. Lenton,et al.  A modified method for detecting incipient bifurcations in a dynamical system , 2007 .

[119]  S. Pincus,et al.  Randomness and degrees of irregularity. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[120]  G. Crooks.  On Measures of Entropy and Information , 2015 .

[121]  K. Eftaxias,et al.  Unfolding the procedure of characterizing recorded ultra low frequency, kHZ and MHz electromagnetic anomalies prior to the L'Aquila earthquake as pre-seismic ones - Part 2 , 2009, 0908.0686.

[122]  D. Sornette,et al.  Occurrence of finite-time singularities in epidemic models of rupture, earthquakes, and starquakes. , 2001, Physical review letters.

[123]  Alejandra Figliola,et al.  Tsallis’ statistics in the variability of El Niño/Southern Oscillation during the Holocene epoch , 2012 .

[124]  G. Rangarajan,et al.  Multiple Nonlinear Time Series with Extended Granger Causality , 2004 .

[125]  S. Pulinets,et al.  Ionospheric precursors of earthquakes , 2004 .

[126]  Masashi Kamogawa,et al.  Minimum of the order parameter fluctuations of seismicity before major earthquakes in Japan , 2013, Proceedings of the National Academy of Sciences.

[127]  Cristina Masoller,et al.  Inferring long memory processes in the climate network via ordinal pattern analysis. , 2011, Chaos.

[128]  Michael Mitzenmacher,et al.  Detecting Novel Associations in Large Data Sets , 2011, Science.

[129]  A. Sharma,et al.  Modeling substorm dynamics of the magnetosphere: from self-organization and self-organized criticality to nonequilibrium phase transitions. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[130]  J. Kurths,et al.  Comparison of correlation analysis techniques for irregularly sampled time series , 2011 .

[131]  早川 正士,et al.  Seismo-electromagnetics and related phenomena : history and latest results , 2008 .

[132]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[133]  G. P. Pavlos,et al.  Universality of Tsallis Non-Extensive Statistics and Fractal Dynamics for Complex Systems , 2012, 1203.5556.

[134]  早川 正士,et al.  Seismo electromagnetics : lithosphere-atmosphere-ionosphere coupling , 2002 .

[135]  L de Arcangelis,et al.  Universality in solar flare and earthquake occurrence. , 2006, Physical review letters.

[136]  J. Kurths,et al.  A Comparative Classification of Complexity Measures , 1994 .

[137]  Giuseppe Consolini,et al.  Complexity, magnetic field topology, criticality, and metastability in magnetotail dynamics , 2002 .

[138]  Milan PALUS.  Testing For Nonlinearity Using Redundancies: Quantitative and Qualitative Aspects , 1994 .

[139]  Georgios Balasis,et al.  Signatures of discrete scale invariance in Dst time series , 2011 .

[140]  A. Sharma,et al.  Extreme events and natural hazards : the complexity perspective , 2012 .

[141]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[142]  K. Eftaxias,et al.  Sudden drop of fractal dimension of electromagnetic emissions recorded prior to significant earthquake , 2012, Natural Hazards.

[143]  J. Kurths,et al.  Estimation of dynamical invariants without embedding by recurrence plots. , 2004, Chaos.

[144]  Robert L. McPherron,et al.  Plasma sheet turbulence observed by Cluster II , 2005 .

[145]  B. Pompe,et al.  Momentary information transfer as a coupling measure of time series. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[146]  Joseph E. Borovsky,et al.  MHD turbulence in the Earth's plasma sheet: Dynamics, dissipation, and driving , 2003 .

[147]  Niels Wessel,et al.  Practical considerations of permutation entropy , 2013, The European Physical Journal Special Topics.

[148]  Milan Paluš,et al.  Testing for Nonlinearity in Weather Records , 1994 .

[149]  Milan Palus,et al.  Reliability of Inference of Directed Climate Networks Using Conditional Mutual Information , 2013, Entropy.

[150]  Jürgen Kurths,et al.  Detecting subthreshold events in noisy data by symbolic dynamics. , 2003, Physical review letters.

[151]  Stelios M. Potirakis,et al.  Analysis of electromagnetic pre-seismic emissions using Fisher information and Tsallis entropy , 2012 .

[152]  V. Plerou,et al.  Scale invariance and universality: organizing principles in complex systems , 2000 .

[153]  Norbert Marwan,et al.  The backbone of the climate network , 2009, 1002.2100.

[154]  B. Hao,et al.  Elementary Symbolic Dynamics And Chaos In Dissipative Systems , 1989 .

[155]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[156]  Georgios Balasis,et al.  Quantifying Dynamical Complexity of Magnetic Storms and Solar Flares via Nonextensive Tsallis Entropy , 2011, Entropy.

[157]  Michael W. Mislove,et al.  Mathematical Foundations of Information Flow , 2012 .

[158]  P. Grassberger.  Toward a quantitative theory of self-generated complexity , 1986 .

[159]  Sandra C. Chapman,et al.  A simple avalanche model as an analogue for magnetospheric activity , 1998 .

[160]  Jürgen Kurths,et al.  Analysis of spatial and temporal extreme monsoonal rainfall over South Asia using complex networks , 2012, Climate Dynamics.

[161]  V I Keilis-Borok,et al.  Similarities of multiple fracturing on a neutron star and on the Earth. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[162]  J. Bjerknes.  ATMOSPHERIC TELECONNECTIONS FROM THE EQUATORIAL PACIFIC1 , 1969 .

[163]  Masashi Kamogawa,et al.  Preseismic lithosphere‐atmosphere‐ionosphere coupling , 2006 .

[164]  M. Ausloos,et al.  Tsallis non-extensive statistical mechanics of El Niño southern oscillation index , 2007 .

[165]  Norbert Marwan,et al.  Identification of dynamical transitions in marine palaeoclimate records by recurrence network analysis , 2011 .

[166]  Konstantinos Eftaxias,et al.  Are There Pre-Seismic Electromagnetic Precursors? A Multidisciplinary Approach , 2012 .

[167]  Massimo Materassi,et al.  An information theory approach to the storm-substorm relationship , 2011 .

[168]  Konstantinos Karamanos,et al.  Symbolic Dynamics and Entropy Analysis of Feigenbaum Limit Sets , 1999 .

[169]  D. Sornette.  Critical Phenomena in Natural Sciences: Chaos, Fractals, Selforganization and Disorder: Concepts and Tools , 2000 .

[170]  Osvaldo A. Rosso,et al.  Generalized statistical complexity measures: Geometrical and analytical properties , 2006 .

[171]  Norbert Marwan,et al.  Understanding the Earth as a Complex System – recent advances in data analysis and modelling in Earth sciences , 2009 .

[172]  Jürgen Kurths,et al.  Estimation of the direction of the coupling by conditional probabilities of recurrence. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[173]  C. Tsallis.  Introduction to Nonextensive Statistical Mechanics: Approaching a Complex World , 2009 .

[174]  Marco Thiel,et al.  Long-term predictability of mean daily temperature data , 2005 .

[175]  K. Eftaxias,et al.  Preseismic electromagnetic signals in terms of complexity. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[176]  S. Havlin,et al.  Phase synchronization in temperature and precipitation records , 2002, physics/0211092.

[177]  Daniel N. Baker,et al.  The organized nonlinear dynamics of the magnetosphere , 1996 .

[178]  Masashi Kamogawa,et al.  Short-term earthquake prediction: Current status of seismo-electromagnetics , 2009 .

[179]  Sandra Chapman,et al.  Avalanching and Self-Organised Criticality, a paradigm for geomagnetic activity? , 2000 .

[180]  H. Stanley,et al.  Scaling, Universality, and Renormalization: Three Pillars of Modern Critical Phenomena , 1999 .

[181]  V. Hadjicontis,et al.  Signature of pending earthquake from electromagnetic anomalies , 2001 .

[182]  C. Bandt.  Ordinal time series analysis , 2005 .

[183]  Daniel N. Baker,et al.  Technological impacts of space storms: Outstanding issues , 2001 .

[184]  T. Kleinen,et al.  Detection of climate system bifurcations by degenerate fingerprinting , 2004 .

[185]  Wolfgang Lucht,et al.  Tipping elements in the Earth's climate system , 2008, Proceedings of the National Academy of Sciences.

[186]  A L Goldberger,et al.  Physiological time-series analysis: what does regularity quantify? , 1994, The American journal of physiology.

[187]  M. P. Leubner,et al.  A Nonextensive Entropy Approach to Solar Wind Intermittency , 2004, astro-ph/0409497.

[188]  Annette Witt,et al.  The renormalized entropy—an appropriate complexity measure? , 1994 .

[189]  Michael I. Jordan.  Graphical Models , 1998 .

[190]  C. Finney,et al.  A review of symbolic analysis of experimental data , 2003 .

[191]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[192]  Norbert Marwan,et al.  Multiple landslide clusters record Quaternary climate changes in the northwestern Argentine Andes , 2003 .

[193]  Damien Chua,et al.  Scale‐free statistics of spatiotemporal auroral emissions as depicted by POLAR UVI images: Dynamic magnetosphere is an avalanching system , 2002 .

[194]  A. Hutt,et al.  Detecting recurrence domains of dynamical systems by symbolic dynamics. , 2012, Physical review letters.

[195]  Konstantinos Eftaxias,et al.  Experience of short term earthquake precursors with VLF–VHF electromagnetic emissions , 2003 .

[196]  J. Kurths,et al.  Comparing modern and Pleistocene ENSO-like influences in NW Argentina using nonlinear time series analysis methods , 2003, nlin/0303056.

[197]  M. Wijk,et al.  Using Information Theory to Determine Optimum Pixel Size and Shape for Ecological Studies: Aggregating Land Surface Characteristics in Arctic Ecosystems , 2009, Ecosystems.

[198]  Nathaniel A. Brunsell,et al.  Characterizing the multi–scale spatial structure of remotely sensed evapotranspiration with information theory , 2011 .

[199]  Jakob Runge,et al.  Quantifying the Strength and Delay of Climatic Interactions: The Ambiguities of Cross Correlation and a Novel Measure Based on Graphical Models , 2014 .

[200]  N. Brunsell.  A multiscale information theory approach to assess spatial-temporal variability of daily precipitation , 2010 .

[201]  Shlomo Havlin,et al.  Global climate models violate scaling of the observed atmospheric variability. , 2002, Physical review letters.

[202]  Georgios Balasis,et al.  Investigating dynamic coupling in geospace through the combined use of modeling, simulations and data analysis , 2009 .

[203]  Chunzai Wang.  Atmospheric Circulation Cells Associated with the El Niño–Southern Oscillation , 2002 .

[204]  Mark Naylor,et al.  Entropy production and self-organized (sub)criticality in earthquake dynamics , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[205]  J. Kurths,et al.  Quantitative analysis of heart rate variability. , 1995, Chaos.

[206]  Jürgen Kurths,et al.  Inferring Indirect Coupling by Means of Recurrences , 2011, Int. J. Bifurc. Chaos.

[207]  C. Kuehn.  A mathematical framework for critical transitions: Bifurcations, fast–slow systems and stochastic dynamics , 2011, 1101.2899.

[208]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[209]  Masashi Kamogawa,et al.  Earthquakes, Electromagnetic Signals of , 2009, Encyclopedia of Complexity and Systems Science.

[210]  Sandra C. Chapman,et al.  Is the dynamic magnetosphere an avalanching system? , 2000 .

[211]  M. Freeman,et al.  Power law distributions of burst duration and interburst interval in the solar wind: turbulence or dissipative self-organized criticality? , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[212]  Daniel N. Baker,et al.  The evolution from weak to strong geomagnetic activity: an interpretation in terms of deterministic chaos , 1990 .

[213]  Y. Matsuda.  Graphical modelling for multivariate time series , 2004 .

[214]  Emmanuel T. Sarris,et al.  Geometrical characteristics of magnetospheric energetic ion time series: evidence for low dimensional chaos , 2003 .

[215]  Jürgen Kurths,et al.  Nonlinear detection of paleoclimate-variability transitions possibly related to human evolution , 2011, Proceedings of the National Academy of Sciences.

[216]  Wangxin Yu,et al.  Characterization of Surface EMG Signal Based on Fuzzy Entropy , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[217]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[218]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[219]  Katsumi Hattori,et al.  ULF Geomagnetic Changes Associated with Large Earthquakes , 2004 .

[220]  A. M. Kowalski,et al.  Fractional Brownian motion, fractional Gaussian noise, and Tsallis permutation entropy , 2008 .

[221]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[222]  Kiyohumi Yumoto,et al.  ULF electromagnetic precursors for an earthquake at Biak, Indonesia on February 17, 1996 , 2000 .

[223]  Donald L. Turcotte,et al.  Modeling geocomplexity: “A new kind of science” , 2006 .

[224]  P. Mayewski,et al.  Holocene climate variability , 2004, Quaternary Research.

[225]  Xuhui Shen,et al.  The earthquake-related disturbances in ionosphere and project of the first China seismo-electromagnetic satellite , 2011 .

[226]  Nathaniel A. Brunsell,et al.  Land surface response to precipitation events using MODIS and NEXRAD data , 2008 .

[227]  Masashi Kamogawa,et al.  Natural time analysis of critical phenomena , 2011, Proceedings of the National Academy of Sciences.

[228]  R. Andrzejak,et al.  Detection of weak directional coupling: phase-dynamics approach versus state-space approach. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[229]  T. Lenton.  Early warning of climate tipping points , 2011 .

[230]  M. Ausloos,et al.  High frequency (daily) data analysis of the Southern Oscillation Index. Tsallis nonextensive statistical mechanics approach , 2007 .

[231]  Tom Chang,et al.  Low-dimensional behavior and symmetry breaking of stochastic systems near criticality-can these effects be observed in space and in the laboratory? , 1992 .

[232]  P. Grassberger,et al.  A robust method for detecting interdependences: application to intracranially recorded EEG , 1999, chao-dyn/9907013.

[233]  K. Eftaxias,et al.  Relation between seismicity and pre-earthquake electromagnetic emissions in terms of energy, information and entropy content , 2012 .