Non-Ideal Sampling and Interpolation from Noisy Observations in Shift-Invariant Spaces

Digital analysis and processing of signals inherently relies on the existence of methods for reconstructing a continuous-time signal from a sequence of corrupted discrete-time samples. In this paper, a general formulation of this problem is developed which treats the interpolation problem from ideal, noisy samples, and the deconvolution problem in which the signal is filtered prior to sampling, in a unified way. The signal reconstruction is performed in a shift-invariant subspace spanned by the integer shifts of a generating function, where the expansion coefficients are obtained by processing the noisy samples with a digital correction filter. Several alternative approaches to designing the correction filter are suggested, which differ in their assumptions on the signal and noise. The classical deconvolution solutions (least-squares, Tikhonov, and Wiener) are adapted to our particular situation and new methods that are optimal in a minimax sense are also proposed. The solutions often have a similar structure and can be computed simply and efficiently by digital filtering. Some concrete examples of reconstruction filters are presented as well as simple guidelines for selecting the free parameters (e.g., regularization) of the various algorithms.

[1]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[2]  Adam Krzyzak,et al.  Moving average restoration of bandlimited signals from noisy observations , 1997, IEEE Trans. Signal Process..

[3]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[4]  Thierry Blu,et al.  Generalized smoothing splines and the optimal discretization of the Wiener filter , 2005, IEEE Transactions on Signal Processing.

[5]  Michael Unser Cardinal exponential splines: part II - think analog, act digital , 2005, IEEE Transactions on Signal Processing.

[6]  Yonina C. Eldar,et al.  Oblique dual frames and shift-invariant spaces , 2004 .

[7]  Akram Aldroubi,et al.  Nonuniform Sampling and Reconstruction in Shift-Invariant Spaces , 2001, SIAM Rev..

[8]  Robert J. Marks,et al.  III-posed sampling theorems , 1985 .

[9]  M. Unser,et al.  Approximation Error for Quasi-Interpolators and (Multi-)Wavelet Expansions , 1999 .

[10]  Adam Krzyzak,et al.  Postfiltering versus prefiltering for signal recovery from noisy samples , 2003, IEEE Trans. Inf. Theory.

[11]  E. Meijering A chronology of interpolation: from ancient astronomy to modern signal and image processing , 2002, Proc. IEEE.

[12]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[13]  I J Schoenberg,et al.  SPLINE FUNCTIONS AND THE PROBLEM OF GRADUATION. , 1964, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Yonina C. Eldar,et al.  A Minimum Squared-Error Framework for Sampling and Reconstruction in Arbitrary Spaces , 2004 .

[15]  David C. Munson,et al.  A linear, time-varying system framework for noniterative discrete-time band-limited signal extrapolation , 1991, IEEE Trans. Signal Process..

[16]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[17]  Ge Wang,et al.  Minimum error bound of signal reconstruction , 1999, IEEE Signal Process. Lett..

[18]  Jan P. Allebach,et al.  Analysis of error in reconstruction of two-dimensional signals from irregularly spaced samples , 1987, IEEE Trans. Acoust. Speech Signal Process..

[19]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[20]  C. Heil Harmonic Analysis and Applications , 2006 .

[21]  Yonina C. Eldar Sampling Without Input Constraints: Consistent Reconstruction in Arbitrary Spaces , 2004 .

[22]  A. Aldroubi,et al.  Sampling procedures in function spaces and asymptotic equivalence with shannon's sampling theory , 1994 .

[23]  A. J. Jerri Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[24]  Yonina C. Eldar,et al.  General Framework for Consistent Sampling in Hilbert Spaces , 2005, Int. J. Wavelets Multiresolution Inf. Process..

[25]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[26]  Thierry Blu,et al.  Cardinal exponential splines: part I - theory and filtering algorithms , 2005, IEEE Transactions on Signal Processing.

[27]  C. Brezinski Interpolation and Extrapolation , 2001 .

[28]  Håkan Johansson,et al.  Reconstruction of nonuniformly sampled bandlimited signals by means of digital fractional delay filters , 2002, IEEE Trans. Signal Process..

[29]  Alfred K. Louis,et al.  A unified approach to regularization methods for linear ill-posed problems , 1999 .

[30]  Yonina C. Eldar,et al.  Linear minimax regret estimation of deterministic parameters with bounded data uncertainties , 2004, IEEE Transactions on Signal Processing.

[31]  Yonina C. Eldar,et al.  Robust mean-squared error estimation in the presence of model uncertainties , 2005, IEEE Transactions on Signal Processing.

[32]  Anastasios N. Venetsanopoulos,et al.  Regularization theory in image restoration-the stabilizing functional approach , 1990, IEEE Trans. Acoust. Speech Signal Process..