Spectrally adapted Mercer kernels for support vector nonuniform interpolation

Interpolation of nonuniformly sampled signals in the presence of noise is a widely analyzed problem in signal processing applications. Interpolators based on Support Vector Machines (SVM) with Gaussian and sinc Mercer kernels have been previously proposed, obtaining good performance in terms of regularization and sparseness. In this paper, inspired in the classical spectral interpretation of the Wiener filter, we explore the impact of adapting the spectrum of the SVM kernel to that of the observed signal. We provide a theoretical foundation for this approach based on a continuous-time equivalent system for interpolation. We study several kernels with different degrees of spectral adaptation to band-pass signals, namely, modulated kernels and autocorrelation kernels. The proposed algorithms are evaluated with extensive simulations with synthetic signals and an application example with real data. Our approach is compared with SVM with Gaussian and sinc kernels and with other well known interpolators. The SVM with autocorrelation kernel provides the highest performance in terms of signal to error ratio in several scenarios. We conclude that the estimated (or actual if known) autocorrelation of the observed sequence can be straightforwardly used as a spectrally adapted kernel, outperforming the classic SVM with low pass kernels for nonuniform interpolation.

[1]  José Luis Rojo-Álvarez,et al.  Support vector machines framework for linear signal processing , 2005, Signal Process..

[2]  A. J. Jerri The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[3]  Thomas Strohmer,et al.  Numerical analysis of the non-uniform sampling problem , 2000 .

[4]  José Luis Rojo-Álvarez,et al.  Support vector method for robust ARMA system identification , 2004, IEEE Transactions on Signal Processing.

[5]  Håkan Johansson,et al.  Reconstruction of Nonuniformly Sampled Bandlimited Signals by Means of Time-Varying Discrete-Time FIR Filters , 2004, 2004 12th European Signal Processing Conference.

[6]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[7]  Robert J. Marks,et al.  Generalizations of the Sampling Theorem , 1991 .

[8]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[9]  José Luis Rojo-Álvarez,et al.  Spectrally adapted mercer kernels for support vector signal interpolation , 2011, 2011 19th European Signal Processing Conference.

[10]  E. Meijering,et al.  A chronology of interpolation: from ancient astronomy to modern signal and image processing , 2002, Proc. IEEE.

[11]  David C. Munson,et al.  A linear, time-varying system framework for noniterative discrete-time band-limited signal extrapolation , 1991, IEEE Trans. Signal Process..

[12]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Hyeokho Choi,et al.  Direct‐Fourier reconstruction in tomography and synthetic aperture radar , 1998 .

[14]  A. Macovski,et al.  Selection of a convolution function for Fourier inversion using gridding [computerised tomography application]. , 1991, IEEE transactions on medical imaging.

[15]  P. Vaidyanathan Generalizations of the sampling theorem: Seven decades after Nyquist , 2001 .

[16]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[17]  Giancarlo Calvagno,et al.  New results on Yen's approach to interpolation from nonuniformly spaced samples , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[18]  Sergios Theodoridis,et al.  A Novel Efficient Cluster-Based MLSE Equalizer for Satellite Communication Channels with-QAM Signaling , 2006, EURASIP J. Adv. Signal Process..

[19]  G GarciaAntonio Orthogonal Sampling Formulas , 2000 .

[20]  José Luis Rojo-Álvarez,et al.  Sparse Deconvolution Using Support Vector Machines , 2008, EURASIP J. Adv. Signal Process..

[21]  José Luis Rojo-Álvarez,et al.  Nonuniform Interpolation of Noisy Signals Using Support Vector Machines , 2007, IEEE Transactions on Signal Processing.

[22]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[23]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[24]  Stefan Tertinek,et al.  Reconstruction of Nonuniformly Sampled Bandlimited Signals Using a Differentiator–Multiplier Cascade , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[26]  J. Yen On Nonuniform Sampling of Bandwidth-Limited Signals , 1956 .

[27]  G. Moody,et al.  Power spectral density of unevenly sampled data by least-square analysis: performance and application to heart rate signals , 1998, IEEE Transactions on Biomedical Engineering.

[28]  Jesus Selva Functionally Weighted Lagrange Interpolation of Band-Limited Signals From Nonuniform Samples , 2009, IEEE Transactions on Signal Processing.

[29]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[30]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[31]  David C. Munson,et al.  A frequency-domain characterization of interpolation from nonuniformly spaced data , 1989, IEEE International Symposium on Circuits and Systems,.

[32]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[33]  Antonio G. García,et al.  Orthogonal Sampling Formulas: A Unified Approach , 2000, SIAM Rev..