Variational Justification of Cycle Spinning for Wavelet-Based Solutions of Inverse Problems

Cycle spinning is a widely used approach for improving the performance of wavelet-based methods that solve linear inverse problems. Extensive numerical experiments have shown that it significantly improves the quality of the recovered signal without increasing the computational cost. In this letter, we provide the first theoretical convergence result for cycle spinning for solving general linear inverse problems. We prove that the sequence of reconstructed signals is guaranteed to converge to the minimizer of some global cost function that incorporates all wavelet shifts.

[1]  Michael Unser,et al.  Wavelet Shrinkage With Consistent Cycle Spinning Generalizes Total Variation Denoising , 2012, IEEE Signal Processing Letters.

[2]  Michael Unser,et al.  Bayesian Denoising: From MAP to MMSE Using Consistent Cycle Spinning , 2013, IEEE Signal Processing Letters.

[3]  Marc Teboulle,et al.  Gradient-based algorithms with applications to signal-recovery problems , 2010, Convex Optimization in Signal Processing and Communications.

[4]  Klaas Paul Pruessmann,et al.  A Fast Wavelet-Based Reconstruction Method for Magnetic Resonance Imaging , 2011, IEEE Transactions on Medical Imaging.

[5]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[6]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[7]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[8]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .

[9]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[10]  Mário A. T. Figueiredo,et al.  Signal restoration with overcomplete wavelet transforms: comparison of analysis and synthesis priors , 2009, Optical Engineering + Applications.

[11]  Jeffrey A. Fessler,et al.  A Hybrid Regularizer Combining Orthonormal Wavelets and Finite Differences for Statistical Reconstruction in 3-D CT , 2012 .

[12]  Martin Zinkevich,et al.  Online Convex Programming and Generalized Infinitesimal Gradient Ascent , 2003, ICML.

[13]  Kannan Ramchandran,et al.  Wavelet denoising by recursive cycle spinning , 2002, Proceedings. International Conference on Image Processing.

[14]  Michael Unser,et al.  MMSE Estimation of Sparse Lévy Processes , 2013, IEEE Transactions on Signal Processing.

[15]  Michael Unser,et al.  A Fast Multilevel Algorithm for Wavelet-Regularized Image Restoration , 2009, IEEE Transactions on Image Processing.

[16]  Antonin Chambolle,et al.  A l1-Unified Variational Framework for Image Restoration , 2004, ECCV.

[17]  Michael Unser,et al.  A Fast Thresholded Landweber Algorithm for Wavelet-Regularized Multidimensional Deconvolution , 2008, IEEE Transactions on Image Processing.

[18]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..