Optimal data recovery and forecasting with dummy long-horizon forecasts

The paper suggests a method of recovering missing values for sequences, including sequences with a multidimensional index, based on optimal approximation by processes featuring spectrum degeneracy. The problem is considered in the pathwise setting, without using probabilistic assumptions on the ensemble. The method requires to solve a closed linear equation connecting the available observations of the underlying process with the values of the approximating process with degenerate spectrum outside the observation range.Some robustness with respect to noise contamination is established for the suggested recovering algorithm. It is suggested to apply this data recovery algorithm to forecasting with a preselected dummy long-horizon forecast that helps to regularize the solution.

[1]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[2]  Tianqi Zhang,et al.  Unified approach to extrapolation of bandlimited signals in linear canonical transform domain , 2014, Signal Process..

[3]  Mohsen Pourahmadi,et al.  On Minimality and Interpolation of Harmonizable Stable Processes , 1984 .

[4]  Mohsen Pourahmadi.  ESTIMATION AND INTERPOLATION OF MISSING VALUES OF A STATIONARY TIME SERIES , 1989 .

[5]  Nikolai Dokuchaev.  On recovering missing values in a pathwise setting , 2016, ArXiv.

[6]  Johannes B. Huber,et al.  Signal Processing Causal discrete-time system approximation of non-bandlimited continuous-time systems by means of discrete prolate spheroidal wave functions , 2009, Eur. Trans. Telecommun..

[7]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[8]  J. M. Almira,et al.  HOW DISTANT IS THE IDEAL FILTER OF BEING A CAUSAL ONE , 2015, 1502.07650.

[9]  Paulo Jorge S. G. Ferreira.  Interpolation and the discrete Papoulis-Gerchberg algorithm , 1994, IEEE Trans. Signal Process..

[10]  Tianqi Zhang,et al.  Extrapolation of discrete bandlimited signals in linear canonical transform domain , 2014, Signal Process..

[11]  Nikolai Dokuchaev.  On predictors for band-limited and high-frequency time series , 2012, Signal Process..

[12]  Nikolai Dokuchaev,et al.  Near-ideal causal smoothing filters for the real sequences , 2016, Signal Process..

[13]  Paulo Jorge S. G. Ferreira,et al.  Incomplete sampling series and the recovery of missing samples from oversampled band-limited signals , 1992, IEEE Trans. Signal Process..

[14]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[15]  Achim Kempf,et al.  Construction of Aharonov–Berry's superoscillations , 2007 .

[16]  Rodney A. Kennedy,et al.  Band-limited extrapolation on the sphere for signal reconstruction in the presence of noise , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[18]  Paulo Jorge S. G. Ferreira,et al.  Nonuniform sampling of nonbandlimited signals , 1995, IEEE Signal Processing Letters.

[19]  D. Slepian,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — II , 1961 .

[20]  A. J. Jerri.  Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[21]  V. Peller.  Regularity Conditions for Vectorial Stationary Processes , 2000 .

[22]  Nikolai Dokuchaev.  Predictors for Discrete Time Processes With Energy Decay on Higher Frequencies , 2012, IEEE Transactions on Signal Processing.

[23]  Nikolai Dokuchaev,et al.  A Closed Equation in Time Domain for Band-Limited Extensions of One-Sided Sequences , 2015, IEEE Transactions on Signal Processing.

[24]  Dae Gwan Lee,et al.  Direct Construction of Superoscillations , 2014, IEEE Transactions on Signal Processing.

[25]  J. Tropp,et al.  SIGNAL RECOVERY FROM PARTIAL INFORMATION VIA ORTHOGONAL MATCHING PURSUIT , 2005 .

[26]  A. J. Jerri.  The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[27]  D. Donoho,et al.  Uncertainty principles and signal recovery , 1989 .

[28]  G. Szegő.  Beiträge zur Theorie der Toeplitzschen Formen , 1921 .

[29]  Jun Zhang,et al.  On Recovery of Sparse Signals Via $\ell _{1}$ Minimization , 2008, IEEE Transactions on Information Theory.

[30]  P. Ferreira.  Approximating Non-band-limited Functions by Nonuniform Sampling Series , 1995 .

[31]  G. Szegő.  Beiträge zur Theorie der Toeplitzschen Formen , 1920 .

[32]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[33]  Jun Zhang,et al.  On Recovery of Sparse Signals via ℓ1 Minimization , 2008, ArXiv.

[34]  Paulo Jorge S. G. Ferreira.  The stability of a procedure for the recovery of lost samples in band-limited signals , 1994, Signal Process..

[35]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[36]  Nikolai Dokuchaev.  On exact and optimal recovering of missing values for sequences , 2017, Signal Process..