A minimum squared-error framework for generalized sampling

We treat the problem of reconstructing a signal from its nonideal samples where the sampling and reconstruction spaces as well as the class of input signals can be arbitrary subspaces of a Hilbert space. Our formulation is general, and includes as special cases reconstruction from finitely many samples as well as uniform-sampling of continuous-time signals, which are not necessarily bandlimited. To obtain a good approximation of the signal in the reconstruction space from its samples, we suggest two design strategies that attempt to minimize the squared-norm error between the signal and its reconstruction. The approaches we propose differ in their assumptions on the input signal: If the signal is known to lie in an appropriately chosen subspace, then we propose a method that achieves the minimal squared error. On the other hand, when the signal is not restricted, we show that the minimal-norm reconstruction cannot generally be obtained. Instead, we suggest minimizing the worst-case squared error between the reconstructed signal, and the best possible (but usually unattainable) approximation of the signal within the reconstruction space. We demonstrate both theoretically and through simulations that the suggested methods can outperform the consistent reconstruction approach previously proposed for this problem.

[1]  Thierry Blu,et al.  Least-squares image resizing using finite differences , 2001, IEEE Trans. Image Process..

[2]  Yonina C. Eldar,et al.  Oblique dual frames and shift-invariant spaces , 2004 .

[3]  Jonathan G. Fiscus,et al.  DARPA TIMIT:: acoustic-phonetic continuous speech corpus CD-ROM, NIST speech disc 1-1.1 , 1993 .

[4]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[5]  R. Young,et al.  An introduction to nonharmonic Fourier series , 1980 .

[6]  Wai-Shing Tang,et al.  Oblique projections, biorthogonal Riesz bases and multiwavelets in Hilbert spaces , 1999 .

[7]  Akram Aldroubi,et al.  Nonuniform Sampling and Reconstruction in Shift-Invariant Spaces , 2001, SIAM Rev..

[8]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[9]  P. Vaidyanathan Generalizations of the sampling theorem: Seven decades after Nyquist , 2001 .

[10]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[11]  Yonina C. Eldar Sampling with Arbitrary Sampling and Reconstruction Spaces and Oblique Dual Frame Vectors , 2003 .

[12]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART II-EFFICIENT DESIGN AND APPLICATIONS , 1993 .

[13]  Michael Unser,et al.  B-spline signal processing. I. Theory , 1993, IEEE Trans. Signal Process..

[14]  A. Aldroubi,et al.  Sampling procedures in function spaces and asymptotic equivalence with shannon's sampling theory , 1994 .

[15]  Akram Aldroubi,et al.  B-spline signal processing. II. Efficiency design and applications , 1993, IEEE Trans. Signal Process..

[16]  Yonina C. Eldar,et al.  General Framework for Consistent Sampling in Hilbert Spaces , 2005, Int. J. Wavelets Multiresolution Inf. Process..

[17]  O. Christensen An introduction to frames and Riesz bases , 2002 .

[18]  Howard L. Weinert,et al.  Oblique projections: Formulas, algorithms, and error bounds , 1989, Math. Control. Signals Syst..

[19]  P. P. Vaidyanathan,et al.  Generalized sampling theorems in multiresolution subspaces , 1997, IEEE Trans. Signal Process..

[20]  A. Aldroubi Non-uniform weighted average sampling and reconstruction in shift-invariant and wavelet spaces , 2002 .

[21]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Yonina C. Eldar Sampling Without Input Constraints: Consistent Reconstruction in Arbitrary Spaces , 2004 .

[23]  Yonina C. Eldar,et al.  General Framework for Consistent Sampling in Hilbert Spaces , 2005, Int. J. Wavelets Multiresolution Inf. Process..

[24]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART I-THEORY , 1993 .

[25]  Yonina C. Eldar,et al.  A competitive minimax approach to robust estimation of random parameters , 2004, IEEE Transactions on Signal Processing.

[26]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[27]  Yonina C. Eldar,et al.  Linear minimax regret estimation of deterministic parameters with bounded data uncertainties , 2004, IEEE Transactions on Signal Processing.

[28]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .