Gradient-domain image decomposition for image recovery

This paper aims to introduce a convex prior based on gradient-domain image decomposition (GID) for image recovery. As a useful class of convex priors, total variation (TV) and its variants have been widely investigated. Among them, total generalized variation (TGV) is paid much attention recently, because it provides rich visual quality around edges and gradation regions in recovered images. This paper gives a general perspective: the TGV can be regarded as a GID and thus can be extended to more general formulation. Specifically, by introducing some priors promoting desired properties on gradient components which cannot be treated efficiently by the TGV, the restored image would attain better visual quality. As a practical instance, we incorporate block nuclear norm (BNN), which can characterize local low rankness, into the GID framework to keep the visual quality of well-patterned textures. Consequently, the GID provides better subjective visual quality and less reconstruction error in missing pixel recovery, than the TGV-based and the TV/BNN-based regularization methods.

[1]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[2]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[3]  Patrick L. Combettes,et al.  Proximal Algorithms for Multicomponent Image Recovery Problems , 2011, Journal of Mathematical Imaging and Vision.

[4]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[5]  Kristian Bredies,et al.  A TGV Regularized Wavelet Based Zooming Model , 2013, SSVM.

[6]  Nelly Pustelnik,et al.  Parallel Proximal Algorithm for Image Restoration Using Hybrid Regularization , 2009, IEEE Transactions on Image Processing.

[7]  Kristian Bredies,et al.  Total Generalized Variation in Diffusion Tensor Imaging , 2013, SIAM J. Imaging Sci..

[8]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[9]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[10]  Shunsuke Ono,et al.  Cartoon-Texture Image Decomposition Using Blockwise Low-Rank Texture Characterization , 2014, IEEE Transactions on Image Processing.

[11]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[12]  Mohamed-Jalal Fadili,et al.  Image Decomposition and Separation Using Sparse Representations: An Overview , 2010, Proceedings of the IEEE.

[13]  Shunsuke Ono,et al.  Second-order total Generalized Variation constraint , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Shunsuke Ono,et al.  Flash/no-flash image integration using convex optimization , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Yang Gao,et al.  Speckle Reduction via Higher Order Total Variation Approach , 2014, IEEE Transactions on Image Processing.

[16]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[17]  Ilker Bayram,et al.  Directional Total Variation , 2012, IEEE Signal Processing Letters.

[18]  Stanley Osher,et al.  A Low Patch-Rank Interpretation of Texture , 2013, SIAM J. Imaging Sci..

[19]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[20]  Shunsuke Ono,et al.  Image Recovery by Decomposition with Component-Wise Regularization , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[21]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[22]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[23]  Raymond H. Chan,et al.  An Efficient Two-Phase ${\rm L}^{1}$-TV Method for Restoring Blurred Images with Impulse Noise , 2010, IEEE Transactions on Image Processing.

[24]  Kristian Bredies,et al.  Recovering Piecewise Smooth Multichannel Images by Minimization of Convex Functionals with Total Generalized Variation Penalty , 2011, Efficient Algorithms for Global Optimization Methods in Computer Vision.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Shunsuke Ono,et al.  Optimized JPEG image decompression with super-resolution interpolation using multi-order total variation , 2013, 2013 IEEE International Conference on Image Processing.

[27]  P. L. Combettes,et al.  A proximal decomposition method for solving convex variational inverse problems , 2008, 0807.2617.

[28]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[29]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[30]  Antonin Chambolle,et al.  Image Decomposition into a Bounded Variation Component and an Oscillating Component , 2005, Journal of Mathematical Imaging and Vision.

[31]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[32]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[33]  Bang Công Vu,et al.  A splitting algorithm for dual monotone inclusions involving cocoercive operators , 2011, Advances in Computational Mathematics.

[34]  S. Osher,et al.  IMAGE DECOMPOSITION AND RESTORATION USING TOTAL VARIATION MINIMIZATION AND THE H−1 NORM∗ , 2002 .

[35]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .