A support-denoiser-driven framework for single image restoration

Abstract Model-based methods have been the powerful strategies for solving a variety of imaging inverse problems. Particularly, the sparsity-enforcing regularization models have been especially widely investigated and adopted over the past decades. Along this research direction, one of the most important topics is the model formulation that is able to incorporate the more suitable image priors. In this paper, we propose a universal and flexible image restoration model that exploits the local sparsity, support and nonlocal denoiser priors simultaneously. While the proposed model is nonconvex as a whole, we show that it can be naturally tackled via a multi-stage convex relaxation procedure based on an extended alternating direction method of multiplier (ADMM) algorithm. Comprehensive numerical experiments demonstrate the effectiveness of our proposed algorithm over many existing state-of-the-art methods, in both objective and perceptual quality.

[1]  Yilun Wang,et al.  Wavelet frame truncated ℓ1-regularized image deblurring , 2016, 2016 8th International Conference on Wireless Communications & Signal Processing (WCSP).

[2]  Charles A. Bouman,et al.  Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibrium , 2017, SIAM J. Imaging Sci..

[3]  José M. Bioucas-Dias,et al.  Adaptive total variation image deblurring: A majorization-minimization approach , 2009, Signal Process..

[4]  Tong Zhang,et al.  Analysis of Multi-stage Convex Relaxation for Sparse Regularization , 2010, J. Mach. Learn. Res..

[5]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[6]  José M. Bioucas-Dias,et al.  Image restoration and reconstruction using variable splitting and class-adapted image priors , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Yilun Wang,et al.  Iterative Support Detection-Based Split Bregman Method for Wavelet Frame-Based Image Inpainting , 2014, IEEE Transactions on Image Processing.

[8]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[9]  Ting-Zhu Huang,et al.  Image inpainting using reproducing kernel Hilbert space and Heaviside functions , 2017, J. Comput. Appl. Math..

[10]  David B. Dunson,et al.  Nonparametric Bayesian Dictionary Learning for Analysis of Noisy and Incomplete Images , 2012, IEEE Transactions on Image Processing.

[11]  Jian-Feng Cai,et al.  Data-driven tight frame construction and image denoising , 2014 .

[12]  Ling Shao,et al.  Single image super-resolution using multi-scale deep encoder-decoder with phase congruency edge map guidance , 2019, Inf. Sci..

[13]  Ling Shao,et al.  Lightweight group convolutional network for single image super-resolution , 2020, Inf. Sci..

[14]  Jian Zhang,et al.  Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Charles A. Bouman,et al.  Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation , 2015, IEEE Transactions on Computational Imaging.

[17]  Javier Portilla,et al.  Image restoration through l0 analysis-based sparse optimization in tight frames , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Fang Li,et al.  An efficient nonconvex regularization for wavelet frame and total variation based image restoration , 2015, J. Comput. Appl. Math..

[19]  Wotao Yin,et al.  Sparse Signal Reconstruction via Iterative Support Detection , 2009, SIAM J. Imaging Sci..

[20]  Michael Elad,et al.  The Little Engine That Could: Regularization by Denoising (RED) , 2016, SIAM J. Imaging Sci..

[21]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Cong Phuoc Huynh,et al.  Category-Specific Object Image Denoising , 2017, IEEE Transactions on Image Processing.

[24]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[25]  Stanley H. Chan,et al.  Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications , 2016, IEEE Transactions on Computational Imaging.

[26]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[27]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[28]  Hassan Mansour,et al.  A Plug-and-Play Priors Approach for Solving Nonlinear Imaging Inverse Problems , 2017, IEEE Signal Processing Letters.

[29]  Shunsuke Ono,et al.  Primal-Dual Plug-and-Play Image Restoration , 2017, IEEE Signal Processing Letters.

[30]  José M. Bioucas-Dias,et al.  A Convergent Image Fusion Algorithm Using Scene-Adapted Gaussian-Mixture-Based Denoising , 2019, IEEE Transactions on Image Processing.

[31]  Bernhard Schölkopf,et al.  A Machine Learning Approach for Non-blind Image Deconvolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Inverse simulation for retrieving the undeformed position for hyperelastic materials : application to breast simulations , 2020 .

[33]  Christian Desrosiers,et al.  High-quality Image Restoration Using Low-Rank Patch Regularization and Global Structure Sparsity , 2019, IEEE Transactions on Image Processing.

[34]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Fang Li,et al.  Regularized iterative Weiner filter method for blind image deconvolution , 2018, J. Comput. Appl. Math..

[36]  M. Sellier An iterative method for the inverse elasto-static problem , 2011 .

[37]  Ting-Zhu Huang,et al.  A nonstationary accelerating alternating direction method for frame-based Poissonian image deblurring , 2019, J. Comput. Appl. Math..

[38]  Brendt Wohlberg,et al.  Plug-and-Play priors for model based reconstruction , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[39]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[40]  Yiqiu Dong,et al.  Simultaneous image fusion and denoising by using fractional-order gradient information , 2019, J. Comput. Appl. Math..

[41]  Y. Payan,et al.  A biomechanical breast model evaluated with respect to MRI data collected in three different positions , 2018, Clinical biomechanics.

[42]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[43]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[45]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[46]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[47]  Raja Giryes,et al.  Image Restoration by Iterative Denoising and Backward Projections , 2017, IEEE Transactions on Image Processing.

[48]  Ting-Zhu Huang,et al.  A fast image recovery algorithm based on splitting deblurring and denoising , 2015, J. Comput. Appl. Math..

[49]  Luc Van Gool,et al.  Integrating Local and Non-local Denoiser Priors for Image Restoration , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).