Edge-Preserving Image Denoising via Group Coordinate Descent on the GPU

Image denoising is a fundamental operation in image processing, and its applications range from the direct (photographic enhancement) to the technical (as a subproblem in image reconstruction algorithms). In many applications, the number of pixels has continued to grow, while the serial execution speed of computational hardware has begun to stall. New image processing algorithms must exploit the power offered by massively parallel architectures like graphics processing units (GPUs). This paper describes a family of image denoising algorithms well-suited to the GPU. The algorithms iteratively perform a set of independent, parallel 1D pixel-update subproblems. To match GPU memory limitations, they perform these pixel updates in-place and only store the noisy data, denoised image, and problem parameters. The algorithms can handle a wide range of edge-preserving roughness penalties, including differentiable convex penalties and anisotropic total variation. Both algorithms use the majorize-minimize framework to solve the 1D pixel update subproblem. Results from a large 2D image denoising problem and a 3D medical imaging denoising problem demonstrate that the proposed algorithms converge rapidly in terms of both iteration and run-time.

[1]  Jeffrey A. Fessler,et al.  Sparse shift-varying FIR preconditioners for fast volume denoising , 2013 .

[2]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[3]  Jeffrey A. Fessler,et al.  Spatial resolution properties of penalized-likelihood image reconstruction: space-invariant tomographs , 1996, IEEE Trans. Image Process..

[4]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[5]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[6]  Jeffrey A. Fessler,et al.  A Splitting-Based Iterative Algorithm for Accelerated Statistical X-Ray CT Reconstruction , 2012, IEEE Transactions on Medical Imaging.

[7]  Hakan Erdogan,et al.  Ordered subsets algorithms for transmission tomography. , 1999, Physics in medicine and biology.

[8]  J. Fessler,et al.  Spatial resolution properties of penalized-likelihood image reconstruction: space-invariant tomographs , 1996, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[9]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[10]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[11]  D. Hunter,et al.  A Tutorial on MM Algorithms , 2004 .

[12]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[13]  Jeffrey A. Fessler,et al.  Accelerating Ordered Subsets Image Reconstruction for X-ray CT Using Spatially Nonuniform Optimization Transfer , 2013, IEEE Transactions on Medical Imaging.

[14]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[15]  José M. Bioucas-Dias,et al.  Adaptive total variation image deblurring: A majorization-minimization approach , 2009, Signal Process..

[16]  Stephen J. Wright,et al.  Duality-based algorithms for total-variation-regularized image restoration , 2010, Comput. Optim. Appl..

[17]  K. Lange Convergence of EM image reconstruction algorithms with Gibbs smoothing. , 1990, IEEE transactions on medical imaging.

[18]  永井 豊,et al.  海外文献紹介 Proc. of SPIE IS & T Electronic Imaging特集 , 2005 .

[19]  W P Segars,et al.  Realistic CT simulation using the 4D XCAT phantom. , 2008, Medical physics.

[20]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  M. Sion On general minimax theorems , 1958 .

[22]  S. Lauritzen,et al.  Globally convergent algorithms for maximizing a likelihood function , 1991 .

[23]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[24]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[25]  Jeffrey A. Fessler,et al.  An Expanded Theoretical Treatment of Iteration-Dependent Majorize-Minimize Algorithms , 2007, IEEE Transactions on Image Processing.

[26]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[27]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[28]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[29]  Jeffrey A. Fessler,et al.  Fast edge-preserving image denoising via group coordinate descent on the GPU , 2014, Electronic Imaging.

[30]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[31]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[32]  Mitsuru Kawamoto,et al.  A Matrix Pseudo-Inversion Lemma and Its Application to Block-Based Adaptive Blind Deconvolution for MIMO Systems , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[33]  Mitsuru Kawamoto,et al.  A Matrix Pseudoinversion Lemma and Its Application to Block-Based Adaptive Blind Deconvolution for MIMO Systems , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[34]  Jeffrey A. Fessler,et al.  Reduced memory augmented Lagrangian algorithm for 3D iterative x-ray CT image reconstruction , 2012, Medical Imaging.

[35]  Jeffrey A. Fessler,et al.  Regularization for uniform spatial resolution properties in penalized-likelihood image reconstruction , 2000, IEEE Transactions on Medical Imaging.

[36]  Jean-Baptiste Thibault,et al.  A three-dimensional statistical approach to improved image quality for multislice helical CT. , 2007, Medical physics.

[37]  Jeffrey A. Fessler,et al.  Grouped-coordinate ascent algorithms for penalized-likelihood transmission image reconstruction , 1997, IEEE Transactions on Medical Imaging.