Performance Bounds and Design Criteria for Estimating Finite Rate of Innovation Signals

In this paper, we consider the problem of estimating finite rate of innovation (FRI) signals from noisy measurements, and specifically analyze the interaction between FRI techniques and the underlying sampling methods. We first obtain a fundamental limit on the estimation accuracy attainable regardless of the sampling method. Next, we provide a bound on the performance achievable using any specific sampling approach. Essential differences between the noisy and noise-free cases arise from this analysis. In particular, we identify settings in which noise-free recovery techniques deteriorate substantially under slight noise levels, thus quantifying the numerical instability inherent in such methods. This instability, which is only present in some families of FRI signals, is shown to be related to a specific type of structure, which can be characterized by viewing the signal model as a union of subspaces. Finally, we develop a methodology for choosing the optimal sampling kernels for linear reconstruction, based on a generalization of the Karhunen-Loève transform. The results are illustrated for several types of time-delay estimation problems.

[1]  W. L. Miranker,et al.  The recovery of distorted band-limited signals , 1961 .

[2]  飛田 武幸,et al.  超多時間理論のWhite Noise Theoryによる表現 , 2007 .

[3]  Thierry Blu,et al.  Sampling Piecewise Sinusoidal Signals With Finite Rate of Innovation Methods , 2010, IEEE Transactions on Signal Processing.

[4]  Yonina C. Eldar,et al.  Nonlinear and Nonideal Sampling Revisited , 2010, IEEE Signal Processing Letters.

[5]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[6]  Wanquan Liu,et al.  Generalized Karhunen-Loeve transform , 1998, IEEE Signal Process. Lett..

[7]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[8]  Yonina C. Eldar Sampling with Arbitrary Sampling and Reconstruction Spaces and Oblique Dual Frame Vectors , 2003 .

[9]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[10]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[11]  Martin Vetterli,et al.  Sampling and reconstruction of signals with finite rate of innovation in the presence of noise , 2005, IEEE Transactions on Signal Processing.

[12]  Thierry Blu,et al.  Extrapolation and Interpolation) , 2022 .

[13]  Akram Aldroubi,et al.  Error Analysis of Frame Reconstruction From Noisy Samples , 2008, IEEE Transactions on Signal Processing.

[14]  Yonina C. Eldar,et al.  The Cramér-Rao Bound for Estimating a Sparse Parameter Vector , 2010, IEEE Transactions on Signal Processing.

[15]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[16]  Yonina C. Eldar,et al.  Innovation Rate Sampling of Pulse Streams With Application to Ultrasound Imaging , 2010, IEEE Transactions on Signal Processing.

[17]  Yonina C. Eldar,et al.  Identification of Underspread Linear Systems with Application to Super-Resolution Radar , 2010, ArXiv.

[18]  Thierry Blu,et al.  Analytic Sensing: Noniterative Retrieval of Point Sources from Boundary Measurements , 2009, SIAM J. Sci. Comput..

[19]  I. W. Sandberg On the properties of some systems that distort signals — II , 1963 .

[20]  P. Lachenbruch Mathematical Statistics, 2nd Edition , 1972 .

[21]  R. F.,et al.  Mathematical Statistics , 1944, Nature.

[22]  Yonina C. Eldar,et al.  Nonideal sampling and interpolation from noisy observations in shift-invariant spaces , 2006, IEEE Transactions on Signal Processing.

[23]  Yonina C. Eldar,et al.  Low Rate Sampling of Pulse Streams with Application to Ultrasound Imaging , 2010, ArXiv.

[24]  R. Z. Khasʹminskiĭ,et al.  Statistical estimation : asymptotic theory , 1981 .

[25]  Omar M. Knio,et al.  Spectral Methods for Uncertainty Quantification , 2010 .

[26]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[27]  Yonina C. Eldar,et al.  Xampling at the Rate of Innovation , 2011, IEEE Transactions on Signal Processing.

[28]  Yonina C. Eldar,et al.  Time-Delay Estimation From Low-Rate Samples: A Union of Subspaces Approach , 2009, IEEE Transactions on Signal Processing.

[29]  Yonina C. Eldar Compressed Sensing of Analog Signals in Shift-Invariant Spaces , 2008, IEEE Transactions on Signal Processing.

[30]  C Mathematics ON THE PETTIS INTEGRAL , 1990 .

[31]  Hagit Messer,et al.  Lower bound on the achievable DSP performance for localizing step-like continuous signals in noise , 1998, IEEE Trans. Signal Process..

[32]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[33]  Qiyu Sun,et al.  Reconstructing Signals with Finite Rate of Innovation from Noisy Samples , 2009 .

[34]  Tapan K. Sarkar,et al.  Matrix pencil method for estimating parameters of exponentially damped/undamped sinusoids in noise , 1990, IEEE Trans. Acoust. Speech Signal Process..

[35]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[36]  Yonina C. Eldar,et al.  Beyond bandlimited sampling , 2009, IEEE Signal Processing Magazine.

[37]  Thierry Blu,et al.  Nonideal Sampling and Regularization Theory , 2008, IEEE Transactions on Signal Processing.

[38]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[39]  Yingbo Hua,et al.  Generalized Karhunen-Loeve transform , 1998, IEEE Signal Processing Letters.

[40]  Yonina C. Eldar,et al.  A minimum squared-error framework for generalized sampling , 2006, IEEE Transactions on Signal Processing.

[41]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[42]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[43]  Yonina C. Eldar,et al.  Identification of Parametric Underspread Linear Systems and Super-Resolution Radar , 2010, IEEE Transactions on Signal Processing.

[44]  C EldarYonina,et al.  Robust recovery of signals from a structured union of subspaces , 2009 .

[45]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[46]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound , 1989, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[47]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[48]  Yonina C. Eldar,et al.  Nonlinear and Nonideal Sampling: Theory and Methods , 2008, IEEE Transactions on Signal Processing.

[49]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[50]  Alfred M. Bruckstein,et al.  The resolution of overlapping echos , 1985, IEEE Trans. Acoust. Speech Signal Process..

[51]  Yukihiko Yamashita,et al.  Relative Karhunen-Loève transform , 1996, IEEE Trans. Signal Process..

[52]  Yonina C. Eldar,et al.  Multichannel Sampling of Pulse Streams at the Rate of Innovation , 2010, IEEE Transactions on Signal Processing.

[53]  Thierry Blu,et al.  Generalized smoothing splines and the optimal discretization of the Wiener filter , 2005, IEEE Transactions on Signal Processing.

[54]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .