Denoising modulo samples: k-NN regression and tightness of SDP relaxation

Many modern applications involve the acquisition of noisy modulo samples of a function $f$, with the goal being to recover estimates of the original samples of $f$. For a Lipschitz function $f:[0,1]^d \to \mathbb{R}$, suppose we are given the samples $y_i = (f(x_i) + \eta_i)\bmod 1; \quad i=1,\dots,n$ where $\eta_i$ denotes noise. Assuming $\eta_i$ are zero-mean i.i.d Gaussian's, and $x_i$'s form a uniform grid, we derive a two-stage algorithm that recovers estimates of the samples $f(x_i)$ with a uniform error rate $O((\frac{\log n}{n})^{\frac{1}{d+2}})$ holding with high probability. The first stage involves embedding the points on the unit complex circle, and obtaining denoised estimates of $f(x_i)\bmod 1$ via a $k$NN (nearest neighbor) estimator. The second stage involves a sequential unwrapping procedure which unwraps the denoised mod $1$ estimates from the first stage. Recently, Cucuringu and Tyagi proposed an alternative way of denoising modulo $1$ data which works with their representation on the unit complex circle. They formulated a smoothness regularized least squares problem on the product manifold of unit circles, where the smoothness is measured with respect to the Laplacian of a proximity graph $G$ involving the $x_i$'s. This is a nonconvex quadratically constrained quadratic program (QCQP) hence they proposed solving its semidefinite program (SDP) based relaxation. We derive sufficient conditions under which the SDP is a tight relaxation of the QCQP. Hence under these conditions, the global solution of QCQP can be obtained in polynomial time.

[1]  P. Lauterbur,et al.  Image Formation by Induced Local Interactions: Examples Employing Nuclear Magnetic Resonance , 1973, Nature.

[2]  L. C. Graham,et al.  Synthetic interferometer radar for topographic mapping , 1974 .

[3]  K Itoh,et al.  Analysis of the phase unwrapping algorithm. , 1982, Applied optics.

[4]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[5]  R. Goldstein,et al.  Topographic mapping from interferometric synthetic aperture radar observations , 1986 .

[6]  R. DeVore,et al.  Interpolation of Besov-Spaces , 1988 .

[7]  E. Novak Deterministic and Stochastic Error Bounds in Numerical Analysis , 1988 .

[8]  Claudio Prati,et al.  SAR Interferometry: A 2-D Phase Unwrapping Technique Based On Phase And Absolute Values Informations , 1990, 10th Annual International Symposium on Geoscience and Remote Sensing.

[9]  C. D. Boor,et al.  Quasiinterpolants and Approximation Power of Multivariate Splines , 1990 .

[10]  Mark Hedley,et al.  A new two‐dimensional phase unwrapping algorithm for MRI images , 1992, Magnetic resonance in medicine.

[11]  Michael Braun,et al.  Two-dimensional phase unwrapping using a minimum spanning tree algorithm , 1992, IEEE Trans. Image Process..

[12]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.

[13]  Domenica Paoletti,et al.  Manipulation of speckle fringes for non-destructive testing of defects in composites , 1994 .

[14]  Mark D. Pritt,et al.  Least-squares two-dimensional phase unwrapping using FFT's , 1994, IEEE Trans. Geosci. Remote. Sens..

[15]  Mariano Rivera,et al.  Quadratic regularization functionals for phase unwrapping , 1995 .

[16]  Mitsuo Takeda,et al.  Phase unwrapping by a maximum cross‐amplitude spanning tree algorithm: a comparative study , 1996 .

[17]  Y. Y. Hung Shearography for non-destructive evaluation of composite structures , 1996 .

[18]  Arkadi Nemirovski,et al.  Topics in Non-Parametric Statistics , 2000 .

[19]  S. Chavez,et al.  Understanding phase maps in MRI: a new cutline phase unwrapping method , 2002, IEEE Transactions on Medical Imaging.

[20]  Youngjoong Joo,et al.  Wide dynamic range CMOS image sensor with pixel level ADC , 2003 .

[21]  L. Ying PHASE UNWRAPPING , 2005 .

[22]  Shuzhong Zhang,et al.  Complex Quadratic Optimization and Semidefinite Programming , 2006, SIAM J. Optim..

[23]  R. DeVore,et al.  Approximation of Functions of Few Variables in High Dimensions , 2011 .

[24]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[25]  Anton van den Hengel,et al.  Semidefinite Programming , 2014, Computer Vision, A Reference Guide.

[26]  Mihai Cucuringu,et al.  Sync-Rank: Robust Ranking, Constrained Ranking and Rank Aggregation via Eigenvector and SDP Synchronization , 2015, IEEE Transactions on Network Science and Engineering.

[27]  Takahiro Yamaguchi,et al.  Implantable self-reset CMOS image sensor and its application to hemodynamic response detection in living mouse brain , 2016 .

[28]  Ramesh Raskar,et al.  On unlimited sampling , 2017, 2017 International Conference on Sampling Theory and Applications (SampTA).

[29]  Anthony Man-Cho So,et al.  On the Estimation Performance and Convergence Rate of the Generalized Power Method for Phase Synchronization , 2016, SIAM J. Optim..

[30]  Amit Singer,et al.  Tightness of the maximum likelihood semidefinite relaxation for angular synchronization , 2014, Math. Program..

[31]  Chandra Sekhar Seelamantula,et al.  Wavelet-Based Reconstruction for Unlimited Sampling , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Norbert Goertz,et al.  Generalized Approximate Message Passing for Unlimited Sampling of Sparse Signals , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[33]  Ramesh Raskar,et al.  Unlimited Sampling of Sparse Signals , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Ramesh Raskar,et al.  Unlimited Sampling of Sparse Sinusoidal Mixtures , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[35]  Chinmay Hegde,et al.  Signal Reconstruction From Modulo Observations , 2018, 2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[36]  Heinrich Jiang,et al.  Non-Asymptotic Uniform Rates of Consistency for k-NN Regression , 2017, AAAI.

[37]  Hemant Tyagi,et al.  Provably robust estimation of modulo 1 samples of a smooth function with applications to phase unwrapping , 2018, J. Mach. Learn. Res..

[38]  Ayush Bhandari,et al.  HDR Imaging From Quantization Noise , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[39]  Hemant Tyagi Error analysis for denoising smooth modulo signals on a graph , 2021, Applied and Computational Harmonic Analysis.

[40]  Matthias Beckmann,et al.  The Modulo Radon Transform and its Inversion , 2021, 2020 28th European Signal Processing Conference (EUSIPCO).

[41]  Ramesh Raskar,et al.  On Unlimited Sampling and Reconstruction , 2019, IEEE Transactions on Signal Processing.