Feature-preserving interpolation and filtering of environmental time series

We propose a method for filling gaps and removing interferences in time series for applications involving continuous monitoring of environmental variables. The approach is non-parametric and based on an iterative pattern-matching between the affected and the valid parts of the time series. It considers several variables jointly in the pattern matching process and allows preserving linear or non-linear dependences between variables. The uncertainty in the reconstructed time series is quantified through multiple realizations. The method is tested on self-potential data that are affected by strong interferences as well as data gaps, and the results show that our approach allows reproducing the spectral features of the original signal. Even in the presence of intense signal perturbations, it significantly improves the signal and corrects bias introduced by asymmetrical interferences. Potential applications are wide-ranging, including geophysics, meteorology and hydrology. A time series processing method that repairs both gaps and interferences.Preserves dependencies between multiple variables.Quantifies the uncertainty of the reconstructed signal.

[1]  M. Zukovic,et al.  Reconstruction of missing data in remote sensing images using conditional stochastic optimization with global geometric constraints , 2013, Stochastic Environmental Research and Risk Assessment.

[2]  C. Constable,et al.  Spectral estimation for geophysical time-series with inconvenient gaps , 2012 .

[3]  F. Paparella,et al.  Filling gaps in chaotic time series , 2005, nlin/0502044.

[4]  Niklas Linde,et al.  Self-potential investigations of a gravel bar in a restored river corridor , 2010 .

[5]  Niklas Linde,et al.  Monitoring of saline tracer movement with vertically distributed self-potential measurements at the HOBE agricultural test site, Voulund, Denmark , 2015, 1501.02277.

[6]  B. Mandelbrot How Long Is the Coast of Britain? Statistical Self-Similarity and Fractional Dimension , 1967, Science.

[7]  Philippe Renard,et al.  Simulation of rainfall time series from different climatic regions using the direct sampling technique , 2014 .

[8]  Yi Liu,et al.  A three-dimensional gap filling method for large geophysical datasets: Application to global satellite soil moisture observations , 2012, Environ. Model. Softw..

[9]  Michael Ghil,et al.  Spatio-temporal filling of missing points in geophysical data sets , 2006 .

[10]  Dionissios T. Hristopulos,et al.  Using GPS for monitoring tall-building response to wind loading: filtering of abrupt changes and low-frequency noise, variography and spectral analysis of displacements , 2007 .

[11]  Juan Ruiz-Alzola,et al.  Kriging filters for multidimensional signal processing , 2005, Signal Process..

[12]  Piet M. T. Broersen,et al.  Automatic spectral analysis with missing data , 2006, Digit. Signal Process..

[13]  David H. Schoellhamer,et al.  Singular spectrum analysis for time series with missing data , 2001 .

[14]  A. Bárdossy,et al.  Infilling missing precipitation records – A comparison of a new copula-based method with other techniques , 2014 .

[15]  Tae-Woong Kim,et al.  Spatial rainfall model using a pattern classifier for estimating missing daily rainfall data , 2009 .

[16]  Ramesh S. V. Teegavarapu,et al.  Improved weighting methods, deterministic and stochastic data-driven models for estimation of missing precipitation records , 2005 .

[17]  Gregoire Mariethoz,et al.  The Direct Sampling method to perform multiple‐point geostatistical simulations , 2010 .

[18]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .