Solving RED via Weighted Proximal Methods

REgularization by Denoising (RED) is a recently introduced framework for solving inverse problems by incorporating state-of-the-art denoising algorithms as the priors. Actually, RED shows that solving inverse problems amounts to iterated denoising processes. However, the complexity of denoisers is generally high, which may lead to an overall slow algorithm for solving RED. In this paper, we apply a general framework named weighted proximal methods (WPMs) to address RED efficiently. Moreover, we also show two existing solvers (namely the fixed point and accelerated proximal gradient methods) for RED are two special variants of WPMs. Numerical experiments show that we can obtain a more efficient variant of WPMs for handling RED if an effective weighting is set.

[1]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[2]  Philip Schniter,et al.  Regularization by Denoising: Clarifications and New Interpretations , 2018, IEEE Transactions on Computational Imaging.

[3]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[4]  Brendt Wohlberg,et al.  Plug-and-Play priors for model based reconstruction , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[5]  A. Kirsch An Introduction to the Mathematical Theory of Inverse Problems , 1996, Applied Mathematical Sciences.

[6]  Stephen Becker,et al.  On Quasi-Newton Forward-Backward Splitting: Proximal Calculus and Convergence , 2018, SIAM J. Optim..

[7]  B. C. Penney,et al.  Two-dimensional filtering of SPECT images using the Metz and Wiener filters. , 1984, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[8]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[9]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[10]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Stanley H. Chan,et al.  Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications , 2016, IEEE Transactions on Computational Imaging.

[12]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[13]  Michael Elad,et al.  Acceleration of RED via Vector Extrapolation , 2018, J. Vis. Commun. Image Represent..

[14]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[15]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[16]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[17]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[19]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[20]  Richard G. Baraniuk,et al.  Optimal recovery from compressive measurements via denoising-based approximate message passing , 2015, 2015 International Conference on Sampling Theory and Applications (SampTA).

[21]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[22]  Charles A. Bouman,et al.  Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation , 2015, IEEE Transactions on Computational Imaging.

[23]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[24]  Yong Cheng,et al.  Comments on "Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering" , 2011, IEEE Trans. Image Process..

[25]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[26]  Michael Elad,et al.  The Little Engine That Could: Regularization by Denoising (RED) , 2016, SIAM J. Imaging Sci..

[27]  Mohamed-Jalal Fadili,et al.  A quasi-Newton proximal splitting method , 2012, NIPS.

[28]  Amir Beck,et al.  First-Order Methods in Optimization , 2017 .

[29]  Alfio Borzì,et al.  A New Optimization Approach to Sparse Reconstruction of Log-Conductivity in Acousto-Electric Tomography , 2018, SIAM J. Imaging Sci..