Comparing methods for analysing time scale dependent correlations in irregularly sampled time series data

Abstract Time series derived from paleoclimate archives are often irregularly sampled in time and thus not analysable using standard statistical methods such as correlation analyses. Although measures for the similarity between time series have been proposed for irregular time series, they do not account for the time scale dependency of the relationship. Stochastically distributed temporal sampling irregularities act qualitatively as a low-pass filter reducing the influence of fast variations from frequencies higher than about 0.5 ( Δ t m a x ) − 1 , where Δ t m a x is the maximum time interval between observations. This may lead to overestimated correlations if the true correlation increases with time scale. Typically, correlations are underestimated due to a non-simultaneous sampling of time series. Here, we investigated different techniques to estimate time scale dependent correlations of weakly irregularly sampled time series, with a particular focus on different resampling methods and filters of varying complexity. The methods were tested on ensembles of synthetic time series that mimic the characteristics of Holocene marine sediment temperature proxy records. We found that a linear interpolation of the irregular time series onto a regular grid, followed by a simple Gaussian filter was the best approach to deal with the irregularity and account for the time scale dependence. This approach had both, minimal filter artefacts, particularly on short time scales, and a minimal loss of information due to filter length.

[1]  K. Hasselmann Stochastic climate models Part I. Theory , 1976 .

[2]  W. Berger,et al.  Vertical mixing in pelagic sediments , 1968 .

[3]  Cameron Tropea,et al.  Model parameter estimation from non-equidistant sampled data sets at low data rates , 1998 .

[4]  Jerry F. McManus,et al.  Amplitude and timing of temperature and salinity variability in the subpolar North Atlantic over the past 10 k.y. , 2007 .

[5]  Piet M. T. Broersen Five Separate Bias Contributions in Time Series Models for Equidistantly Resampled Irregular Data , 2009, IEEE Transactions on Instrumentation and Measurement.

[6]  Michael Schulz,et al.  Spectrum: spectral analysis of unevenly spaced paleoclimatic time series , 1997 .

[7]  T. Laepple,et al.  Ocean surface temperature variability: Large model–data differences at decadal and longer periods , 2014, Proceedings of the National Academy of Sciences.

[8]  T. Laepple,et al.  Reconciling Discrepancies between Uk37 and Mg/Ca Reconstructions of Holocene Marine Temperature Variability , 2013 .

[9]  Hiroshi Kawamura,et al.  Changes in the thermocline structure of the Indonesian outflow during Terminations I and II , 2008 .

[10]  C. Chatfield,et al.  Fourier Analysis of Time Series: An Introduction , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Peter Huybers,et al.  Links between annual, Milankovitch and continuum temperature variability , 2005, Nature.

[12]  Shaun A Marcott,et al.  A Reconstruction of Regional and Global Temperature for the Past 11,300 Years , 2013, Science.

[13]  J. Kurths,et al.  Comparison of correlation analysis techniques for irregularly sampled time series , 2011 .

[14]  N. Lomb Least-squares frequency analysis of unequally spaced data , 1976 .

[15]  C. Hemleben,et al.  Assessing the reliability of magnesium in foraminiferal calcite as a proxy for water mass temperatures , 1996 .

[16]  J. Scargle Studies in astronomical time series analysis. III - Fourier transforms, autocorrelation functions, and cross-correlation functions of unevenly spaced data , 1989 .

[17]  Axel Timmermann,et al.  Southern Hemisphere and Deep-Sea Warming Led Deglacial Atmospheric CO2 Rise and Tropical Warming , 2007, Science.

[18]  Fredrik Gustafsson,et al.  Downsampling Non-Uniformly Sampled Data , 2008, EURASIP J. Adv. Signal Process..

[19]  H. V. Maanen,et al.  Estimation of turbulence power spectra from randomly sampled data by curve-fit to the autocorrelation function applied to laser-Doppler anemometry , 1998 .

[20]  M. Tummers,et al.  RAPID COMMUNICATION: Spectral estimation using a variable window and the slotting technique with local normalization , 1996 .

[21]  R. Bos,et al.  The Accuracy of Time Series Analysis for Laser-Doppler Velocimetry , 2000 .

[22]  R Edelson,et al.  The Discrete Correlation Function: a New Method for Analyzing Unevenly Sampled Variability Data , 1988 .

[23]  Michael Schulz,et al.  REDFIT: estimating red-noise spectra directly from unevenly spaced paleoclimatic time series , 2002 .