Variational Multiplicative Noise Removal by DC Programming

This paper proposes a difference of convex algorithm (DCA) to deal with a non-convex data fidelity term, proposed by Aubert and Aujol referred to as the AA model. The AA model was adopted in many subsequent works for multiplicative noise removal, most of which focused on convex approximation so that numerical algorithms with guaranteed convergence can be designed. Noting that the AA model can be naturally split into a difference of two convex functions, we apply the DCA to solve the original AA model. Compared to the gradient projection algorithm considered by Aubert and Aujol, the DCA often converges faster and leads to a better solution. We prove that the DCA sequence converges to a stationary point, which satisfies the first order optimality condition. In the experiments, we consider two applications, image denoising and deblurring, both of which involve multiplicative Gamma noise. Numerical results demonstrate that the proposed algorithm outperforms the state-of-the-art methods for multiplicative noise removal.

[1]  Émilie Chouzenoux,et al.  A nonconvex regularized approach for phase retrieval , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[2]  Jack Xin,et al.  A Weighted Difference of Anisotropic and Isotropic Total Variation Model for Image Processing , 2015, SIAM J. Imaging Sci..

[3]  Jack Xin,et al.  Minimization of ℓ1-2 for Compressed Sensing , 2015, SIAM J. Sci. Comput..

[4]  Le Thi Hoai An,et al.  A D.C. Optimization Algorithm for Solving the Trust-Region Subproblem , 1998, SIAM J. Optim..

[5]  Christoph Schnörr,et al.  Variational Reconstruction with DC-Programming , 2007 .

[6]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[7]  Stanley Osher,et al.  Image Recovery via Nonlocal Operators , 2010, J. Sci. Comput..

[8]  Jack Xin,et al.  Computing Sparse Representation in a Highly Coherent Dictionary Based on Difference of $$L_1$$L1 and $$L_2$$L2 , 2015, J. Sci. Comput..

[9]  Tieyong Zeng,et al.  A Convex Variational Model for Restoring Blurred Images with Multiplicative Noise , 2013, SIAM J. Imaging Sci..

[10]  Le Thi Hoai An,et al.  The DC (Difference of Convex Functions) Programming and DCA Revisited with DC Models of Real World Nonconvex Optimization Problems , 2005, Ann. Oper. Res..

[11]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[12]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[13]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[14]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[15]  Jong-Shi Pang,et al.  A New Decomposition Method for Multiuser DC-Programming and Its Applications , 2014, IEEE Transactions on Signal Processing.

[16]  Mirjam Dür,et al.  Testing copositivity with the help of difference-of-convex optimization , 2013, Math. Program..

[17]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method for Blurry Images with Poisson or Multiplicative Gamma Noise , 2014, SIAM J. Imaging Sci..

[18]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[19]  Michael K. Ng,et al.  On the Convergence of Nonconvex Minimization Methods for Image Recovery , 2015, IEEE Transactions on Image Processing.

[20]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[21]  Jianing Shi,et al.  A Nonlinear Inverse Scale Space Method for a Convex Multiplicative Noise Model , 2008, SIAM J. Imaging Sci..

[22]  Xiaojun Chen,et al.  Non-Lipschitz $\ell_{p}$-Regularization and Box Constrained Model for Image Restoration , 2012, IEEE Transactions on Image Processing.

[23]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[24]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[25]  Stanley Osher,et al.  Multiplicative Denoising and Deblurring: Theory and Algorithms , 2003 .

[26]  Jian-Feng Cai,et al.  Framelet-Based Blind Motion Deblurring From a Single Image , 2012, IEEE Transactions on Image Processing.

[27]  Benjamin F. Hobbs,et al.  Collusive game solutions via optimization , 2005, Math. Program..

[28]  Gabriele Steidl,et al.  Combined SVM-Based Feature Selection and Classification , 2005, Machine Learning.

[29]  Jing Yuan,et al.  A Convex Max-Flow Approach to Distribution-Based Figure-Ground Separation , 2012, SIAM J. Imaging Sci..

[30]  Le Thi Hoai An,et al.  DC programming in communication systems: challenging problems and methods , 2014, Vietnam Journal of Computer Science.

[31]  Thomas Brox,et al.  An Iterated L1 Algorithm for Non-smooth Non-convex Optimization in Computer Vision , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Michael K. Ng,et al.  A New Total Variation Method for Multiplicative Noise Removal , 2009, SIAM J. Imaging Sci..

[33]  C. Floudas,et al.  A global optimization approach for Lennard‐Jones microclusters , 1992 .

[34]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[35]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[36]  Xiaojun Chen,et al.  Smoothing Nonlinear Conjugate Gradient Method for Image Restoration Using Nonsmooth Nonconvex Minimization , 2010, SIAM J. Imaging Sci..

[37]  Le Thi Hoai An,et al.  An efficient algorithm for globally minimizing a quadratic function under convex quadratic constraints , 2000, Math. Program..

[38]  T. P. Dinh,et al.  Convex analysis approach to d.c. programming: Theory, Algorithm and Applications , 1997 .

[39]  Ismail Ben Ayed,et al.  Pseudo-bound Optimization for Binary Energies , 2014, ECCV.