Linear reconstructions and the analysis of the stable sampling rate

The theory of sampling and the reconstruction of data has a wide range of applications and a rich collection of techniques. For many methods a core problem is the estimation of the number of samples needed in order to secure a stable and accurate reconstruction. This can often be controlled by the Stable Sampling Rate (SSR). In this paper we discuss the SSR and how it is crucial for two key linear methods in sampling theory: generalized sampling and the recently developed Parametrized Background Data Weak (PBDW) method. Both of these approaches rely on estimates of the SSR in order to be accurate. In many areas of signal and image processing binary samples are crucial and such samples, which can be modelled by Walsh functions, are the core of our analysis. As we show, the SSR is linear when considering binary sampling with Walsh functions and wavelet reconstruction. Moreover, for certain wavelets it is possible to determine the SSR exactly, allowing sharp estimates for the performance of the methods.

[1]  P. Wojtaszczyk.  On greedy algorithm approximating Kolmogorov widths in Banach spaces , 2015 .

[2]  R. DeVore,et al.  Data assimilation and sampling in Banach spaces , 2016, 1602.06342.

[3]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[4]  P. Butzer,et al.  On dyadic analysis based on the pointwise dyadic derivative , 1975 .

[5]  Ben Adcock,et al.  Beyond Consistent Reconstructions: Optimality and Sharp Bounds for Generalized Sampling, and Application to the Uniform Resampling Problem , 2013, SIAM J. Math. Anal..

[6]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[7]  W. R. Wade,et al.  Walsh Series, An Introduction to Dyadic Harmonic Analysis , 1990 .

[8]  A. J. Jerri.  The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[9]  Ben Adcock,et al.  A Generalized Sampling Theorem for Stable Reconstructions in Arbitrary Bases , 2010, Journal of Fourier Analysis and Applications.

[10]  T. Blumensath,et al.  Theory and Applications , 2011 .

[11]  Vegard Antun.  Coherence estimates between Hadamard matrices and Daubechies wavelets , 2016 .

[12]  M. Unser.  Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  E. T. Quinto,et al.  An Introduction to X-ray tomography and Radon Transforms , 2006 .

[15]  Anders C. Hansen,et al.  On the approximation of spectra of linear operators on Hilbert spaces , 2008 .

[16]  Karlheinz Gröchenig,et al.  Pseudospectral Fourier reconstruction with the modified Inverse Polynomial Reconstruction Method , 2010, J. Comput. Phys..

[17]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[18]  Jackie Ma,et al.  Generalized sampling reconstruction from Fourier measurements using compactly supported shearlets , 2014 .

[19]  Michiel Müller,et al.  Introduction to confocal fluorescence microscopy , 2006 .

[20]  Wolfgang Dahmen,et al.  Convergence Rates for Greedy Algorithms in Reduced Basis Methods , 2010, SIAM J. Math. Anal..

[21]  Alex Jones,et al.  Continuous Compressed Sensing for Surface Dynamical Processes with Helium Atom Scattering , 2016, Scientific Reports.

[22]  J. Zerubia,et al.  A Generalized Sampling Theory without bandlimiting constraints , 1998 .

[23]  A. J. Jerri.  Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[24]  Ben Adcock,et al.  On asymptotic structure in compressed sensing , 2014, ArXiv.

[25]  L. Debnath,et al.  Walsh Functions and Their Applications , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  Marko Lindner,et al.  Infinite Matrices and their Finite Sections: An Introduction to the Limit Operator Method , 2006 .

[27]  A. Patera,et al.  A PRIORI CONVERGENCE OF THE GREEDY ALGORITHM FOR THE PARAMETRIZED REDUCED BASIS METHOD , 2012 .

[28]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[29]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[30]  Wolfgang Dahmen,et al.  Data Assimilation in Reduced Modeling , 2015, SIAM/ASA J. Uncertain. Quantification.

[31]  Anders C. Hansen,et al.  On the Solvability Complexity Index, the n-pseudospectrum and approximations of spectra of operators , 2011 .

[32]  Rowan Leary,et al.  Compressed sensing electron tomography. , 2013, Ultramicroscopy.

[33]  Clarice Poon,et al.  A Consistent and Stable Approach to Generalized Sampling , 2014 .

[34]  Thomas Strohmer,et al.  QUANTITATIVE ESTIMATES FOR THE FINITE SECTION METHOD , 2006 .

[35]  Ben Adcock,et al.  Generalized Sampling and Infinite-Dimensional Compressed Sensing , 2015, Foundations of Computational Mathematics.

[36]  Karlene A. Hoo,et al.  Wavelet-based model reduction of distributed parameter systems , 2000 .

[37]  Albert F. Lawrence,et al.  Electron Tomography and Multiscale Biology , 2012, Theory and Applications of Models of Computation.

[38]  Stephen P. Boyd,et al.  Compressed sensing based cone-beam computed tomography reconstruction with a first-order method. , 2010, Medical physics.

[39]  Ronald DeVore,et al.  Greedy Algorithms for Reduced Bases in Banach Spaces , 2012, Constructive Approximation.

[40]  I. Daubechies,et al.  Wavelets on the Interval and Fast Wavelet Transforms , 1993 .

[41]  Yonina C. Eldar.  Sampling with Arbitrary Sampling and Reconstruction Spaces and Oblique Dual Frame Vectors , 2003 .

[42]  E. Candès,et al.  Compressive fluorescence microscopy for biological and hyperspectral imaging , 2012, Proceedings of the National Academy of Sciences.

[43]  Clarice Poon,et al.  A Practical Guide to the Recovery of Wavelet Coefficients from Fourier Measurements , 2015, SIAM J. Sci. Comput..

[44]  Yonina C. Eldar,et al.  Robust and Consistent Sampling , 2009, IEEE Signal Processing Letters.

[45]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[46]  Anthony T. Patera,et al.  A parameterized‐background data‐weak approach to variational data assimilation: formulation, analysis, and application to acoustics , 2015 .

[47]  Klaas Paul Pruessmann,et al.  A Fast Wavelet-Based Reconstruction Method for Magnetic Resonance Imaging , 2011, IEEE Transactions on Medical Imaging.

[48]  A. Böttcher.  Infinite matrices and projection methods , 1995 .

[49]  Ben Adcock,et al.  On optimal wavelet reconstructions from Fourier samples: linearity and universality of the stable sampling rate , 2012, ArXiv.

[50]  Albert Cohen,et al.  Sparse polynomial approximation of parametric elliptic PDEs. Part II: lognormal coefficients , 2015, 1509.07050.

[51]  Anders C. Hansen,et al.  On the stable sampling rate for binary measurements and wavelet reconstruction , 2019, Applied and Computational Harmonic Analysis.

[52]  Gitta Kutyniok,et al.  Linear Stable Sampling Rate: Optimality of 2D Wavelet Reconstructions from Fourier Measurements , 2014, SIAM J. Math. Anal..