A parallel primal-dual splitting method for image restoration

We develop a parallel primal-dual splitting method to solve large-scale image restoration problems, which involve the sum of several linear-operator-coupled nonsmooth but proximable terms. With the proposed method, the objective function is decomposed into pieces that can be processed individually. No inverse operator is involved in our method and the highly parallel structure makes it preferable in distributed computation. The convergence is proven and the convergence rate is analyzed. Besides, its equivalence to the relaxed parallel linearized alternating direction method of multipliers (PLADMM) is addressed. Applications to image restoration problems with compound l1-regularizer and comparisons with state-of-the-art methods are detailed to show the superiority of the proposed method.

[1]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[2]  Fei Gao,et al.  Biologically inspired image quality assessment , 2016, Signal Process..

[3]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[4]  Xuelong Li,et al.  Learning Multiple Linear Mappings for Efficient Single Image Super-Resolution , 2015, IEEE Transactions on Image Processing.

[5]  Xuelong Li,et al.  A Variational Approach to Simultaneous Image Segmentation and Bias Correction , 2015, IEEE Transactions on Cybernetics.

[6]  Antonin Chambolle,et al.  On the ergodic convergence rates of a first-order primal–dual algorithm , 2016, Math. Program..

[7]  Raymond H. Chan,et al.  A Multiplicative Iterative Algorithm for Box-Constrained Penalized Likelihood Image Restoration , 2012, IEEE Transactions on Image Processing.

[8]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[9]  Wei Zhang,et al.  A parallel alternating direction method with application to compound l1-regularized imaging inverse problems , 2016, Inf. Sci..

[10]  Gilles Aubert,et al.  Efficient Schemes for Total Variation Minimization Under Constraints in Image Processing , 2009, SIAM J. Sci. Comput..

[11]  Anand Rangarajan,et al.  Image Denoising Using the Higher Order Singular Value Decomposition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Xuelong Li,et al.  Automatic segmentation of breast lesions for interaction in ultrasonic computer-aided diagnosis , 2015, Inf. Sci..

[14]  Bingsheng He,et al.  On the O(1/n) Convergence Rate of the Douglas-Rachford Alternating Direction Method , 2012, SIAM J. Numer. Anal..

[15]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[16]  Wotao Yin,et al.  Parallel Multi-Block ADMM with o(1 / k) Convergence , 2013, Journal of Scientific Computing.

[17]  Weiguo Gong,et al.  Dual-sparsity regularized sparse representation for single image super-resolution , 2015, Inf. Sci..

[18]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[19]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[20]  Wotao Yin,et al.  Edge Guided Reconstruction for Compressive Imaging , 2012, SIAM J. Imaging Sci..

[21]  Raymond H. Chan,et al.  Constrained Total Variation Deblurring Models and Fast Algorithms Based on Alternating Direction Method of Multipliers , 2013, SIAM J. Imaging Sci..

[22]  Shunsuke Ono,et al.  Cartoon-Texture Image Decomposition Using Blockwise Low-Rank Texture Characterization , 2014, IEEE Transactions on Image Processing.

[23]  Xiang Ren,et al.  Linearized Alternating Direction Method with Adaptive Penalty and Warm Starts for Fast Solving Transform Invariant Low-Rank Textures , 2012, International Journal of Computer Vision.

[24]  Wei Zhang,et al.  A Fast Adaptive Parameter Estimation for Total Variation Image Restoration , 2014, IEEE Transactions on Image Processing.

[25]  Damek Davis,et al.  Convergence Rate Analysis of Primal-Dual Splitting Schemes , 2014, SIAM J. Optim..

[26]  Raymond H. Chan,et al.  Parameter selection for total-variation-based image restoration using discrepancy principle , 2012, IEEE Transactions on Image Processing.

[27]  Wotao Yin,et al.  A New Detail-Preserving Regularization Scheme , 2014, SIAM J. Imaging Sci..

[28]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[29]  Zhixun Su,et al.  Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning , 2013, Machine Learning.

[30]  Lise Getoor,et al.  Lifted graphical models: a survey , 2011, Machine Learning.

[31]  Laurent Condat,et al.  A Generic Proximal Algorithm for Convex Optimization—Application to Total Variation Minimization , 2014, IEEE Signal Processing Letters.

[32]  Xiaoqun Zhang,et al.  A primal–dual fixed point algorithm for convex separable minimization with applications to image restoration , 2013 .

[33]  Simon Setzer,et al.  Operator Splittings, Bregman Methods and Frame Shrinkage in Image Processing , 2011, International Journal of Computer Vision.

[34]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[35]  Ting-Zhu Huang,et al.  Image restoration using total variation with overlapping group sparsity , 2013, Inf. Sci..

[36]  Wei Zhang,et al.  Adaptive shearlet-regularized image deblurring via alternating direction method , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[37]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.