Sampling rate-corrected analysis of irregularly sampled time series.

The analysis of irregularly sampled time series remains a challenging task requiring methods that account for continuous and abrupt changes of sampling resolution without introducing additional biases. The edit distance is an effective metric to quantitatively compare time series segments of unequal length by computing the cost of transforming one segment into the other. We show that transformation costs generally exhibit a nontrivial relationship with local sampling rate. If the sampling resolution undergoes strong variations, this effect impedes unbiased comparison between different time episodes. We study the impact of this effect on recurrence quantification analysis, a framework that is well suited for identifying regime shifts in nonlinear time series. A constrained randomization approach is put forward to correct for the biased recurrence quantification measures. This strategy involves the generation of a type of time series and time axis surrogates which we call sampling-rate-constrained (SRC) surrogates. We demonstrate the effectiveness of the proposed approach with a synthetic example and an irregularly sampled speleothem proxy record from Niue island in the central tropical Pacific. Application of the proposed correction scheme identifies a spurious transition that is solely imposed by an abrupt shift in sampling rate and uncovers periods of reduced seasonal rainfall predictability associated with enhanced El Niño-Southern Oscillation and tropical cyclone activity.

[1]  Antônio M. T. Ramos,et al.  Recurrence measure of conditional dependence and applications. , 2017, Physical review. E.

[2]  M. Trauth Spectral analysis in Quaternary sciences , 2021, Quaternary Science Reviews.

[3]  T. Lenton,et al.  Climate tipping points — too risky to bet against , 2019, Nature.

[4]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[5]  Norbert Marwan,et al.  Detection of dynamical regime transitions with lacunarity as a multiscale recurrence quantification measure , 2021 .

[6]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[7]  Reik V. Donner,et al.  Nonlinear Time Series Analysis in the Geosciences , 2008 .

[8]  R. O. Dendy,et al.  Recurrence plot statistics and the effect of embedding , 2005 .

[9]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[10]  J. Kurths,et al.  Regime Change Detection in Irregularly Sampled Time Series , 2018 .

[11]  Norbert Marwan,et al.  Recurrence plots 25 years later —Gaining confidence in dynamical transitions , 2013, 1306.0688.

[12]  Jürgen Kurths,et al.  Inferring interdependencies from short time series , 2017 .

[13]  Elizabeth Bradley,et al.  Nonlinear time-series analysis revisited. , 2015, Chaos.

[14]  Sabrina Eberhart,et al.  Applied Missing Data Analysis , 2016 .

[15]  N. Marwan,et al.  An astronomically dated record of Earth’s climate and its predictability over the last 66 million years , 2020, Science.

[16]  Esko Ukkonen,et al.  Algorithms for Approximate String Matching , 1985, Inf. Control..

[17]  Michael Small,et al.  Counting forbidden patterns in irregularly sampled time series. I. The effects of under-sampling, random depletion, and timing jitter. , 2016, Chaos.

[18]  Jim Tørresen,et al.  Classification of Recurrence Plots' Distance Matrices with a Convolutional Neural Network for Activity Recognition , 2018, ANT/SEIT.

[19]  P. Aharon,et al.  Caves of Niue Island, South Pacific: Speleothems and water geochemistry , 2006 .

[20]  Gemma Lancaster,et al.  Surrogate data for hypothesis testing of physical systems , 2018, Physics Reports.

[21]  Chanseok Park,et al.  Investigation of finite-sample properties of robust location and scale estimators , 2019, Commun. Stat. Simul. Comput..

[22]  Jürgen Kurths,et al.  Late Holocene Asian summer monsoon dynamics from small but complex networks of paleoclimate data , 2013, Climate Dynamics.

[23]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[24]  Norbert Marwan,et al.  Recurrence threshold selection for obtaining robust recurrence characteristics in different embedding dimensions. , 2018, Chaos.

[25]  D. Scholz,et al.  Modelling stalagmite growth and δ13C as a function of drip interval and temperature , 2007 .

[26]  K. Trenberth Some Effects of Finite Sample Size and Persistence on Meteorological Statistics. Part I: Autocorrelations , 1984 .

[27]  Michael D. Abràmoff,et al.  Image processing with ImageJ , 2004 .

[28]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[29]  N. Marwan,et al.  Recurrence plot analysis of irregularly sampled data , 2018, Physical Review E.

[30]  Bruno Merz,et al.  Recurrence analysis of extreme event like data , 2020 .

[31]  Mourad Khayati,et al.  Mind the gap , 2020, Proc. VLDB Endow..

[32]  S. Carpenter,et al.  Inferring critical transitions in paleoecological time series with irregular sampling and variable time-averaging , 2019, Quaternary Science Reviews.

[33]  Michael Small,et al.  Counting forbidden patterns in irregularly sampled time series. II. Reliability in the presence of highly irregular sampling. , 2016, Chaos.

[34]  Jürgen Kurths,et al.  Quantifying entropy using recurrence matrix microstates. , 2018, Chaos.

[35]  I. Z. Kiss,et al.  A unified and automated approach to attractor reconstruction , 2020, New Journal of Physics.

[36]  Jürgen Kurths,et al.  Order patterns recurrence plots in the analysis of ERP data , 2007, Cognitive Neurodynamics.

[37]  Kazuyuki Aihara,et al.  Definition of Distance for Marked Point Process Data and its Application to Recurrence Plot-Based Analysis of Exchange Tick Data of Foreign Currencies , 2010, Int. J. Bifurc. Chaos.

[38]  Methods of Mathematical Analysis of Heart Rate Variability , 2020 .

[39]  Norbert Marwan,et al.  Selection of recurrence threshold for signal detection , 2008 .

[40]  N. Marwan,et al.  Mid-Holocene rainfall changes in the southwestern Pacific , 2022 .

[41]  Mike Paterson,et al.  A Faster Algorithm Computing String Edit Distances , 1980, J. Comput. Syst. Sci..

[42]  Jürgen Kurths,et al.  See–saw relationship of the Holocene East Asian–Australian summer monsoon , 2016, Nature Communications.

[43]  Jürgen Kurths,et al.  Similarity estimators for irregular and age-uncertain time series , 2013 .

[44]  Xin Yao,et al.  MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning , 2014 .

[45]  J. Kurths,et al.  Comparison of correlation analysis techniques for irregularly sampled time series , 2011 .

[46]  Finite sample correction factors for several simple robust estimators of normal standard deviation , 2011 .

[47]  J. Scargle Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .

[48]  Reik V Donner,et al.  Phase space reconstruction for non-uniformly sampled noisy time series. , 2018, Chaos.

[49]  Jürgen Kurths,et al.  Transformation-cost time-series method for analyzing irregularly sampled data. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  S. Carpenter,et al.  Early-warning signals for critical transitions , 2009, Nature.

[51]  Jürgen Kurths,et al.  Multivariate recurrence plots , 2004 .

[52]  Piazza S. Francesco,et al.  A CLOSER LOOK AT THE EPPS EFFECT , 2003 .

[53]  S. Levinson,et al.  Considerations in dynamic time warping algorithms for discrete word recognition , 1978 .

[54]  H. Kantz A robust method to estimate the maximal Lyapunov exponent of a time series , 1994 .

[55]  Michael Schulz,et al.  Spectrum: spectral analysis of unevenly spaced paleoclimatic time series , 1997 .

[56]  Yoshito Hirata,et al.  Recurrence plots for characterizing random dynamical systems , 2021, Commun. Nonlinear Sci. Numer. Simul..

[57]  J. Baldini Detecting and Quantifying Paleoseasonality in Stalagmites using Geochemical and Modelling Approaches , 2017 .

[58]  Nonlinear time series analysis of palaeoclimate proxy records , 2021, Quaternary Science Reviews.

[59]  Joshua Garland,et al.  Anomaly Detection in Paleoclimate Records Using Permutation Entropy , 2018, Entropy.