Multi-channel expected patch log likelihood for color image denoising

Abstract Due to its flexibility and good restoration performance, the Expected Patch Log Likelihood (EPLL) method has attracted extensive attention and has been further developed. However, the basic EPLL method is mainly applied for gray image restoration. For color image denoising with different channel noise levels, concatenating the RGB values into a vector and applying the basic EPLL directly can produce false colors and artifacts. In this paper, a Multi-Channel Expected Patch Log Likelihood (MC-EPLL) method is proposed for color image denoising with different channel noise levels. Considering the within and between channel correlation, the noise model of the concatenated vector of RGB channels can be constructed as a Matrix Normal Distribution. Under the KL divergence framework, the MC-EPLL model can be derived by combining the noise model and Gaussian Mixture Model (GMM) based patch prior. Based on the half quadratic splitting (HQS) strategy, the MC-EPLL model is decomposed into two sub-minimization problems and the closed-form solution of each sub-problem can be obtained. Experiments show the feasibility and superiority of the proposed MC-EPLL over the compared denoising methods.

[1]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[2]  Shih-Fu Chang,et al.  Discriminative Indexing for Probabilistic Image Patch Priors , 2014, ECCV.

[3]  Michael S. Brown,et al.  A Software Platform for Manipulating the Camera Imaging Pipeline , 2016, ECCV.

[4]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Truong Q. Nguyen,et al.  Image Denoising with Generalized Gaussian Mixture Model Patch Priors , 2018, SIAM J. Imaging Sci..

[7]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Gwanggil Jeon,et al.  Least-Squares Luma–Chroma Demultiplexing Algorithm for Bayer Demosaicking , 2011, IEEE Transactions on Image Processing.

[9]  Yair Weiss,et al.  The Return of the Gating Network: Combining Generative Models and Discriminative Training in Natural Image Priors , 2015, NIPS.

[10]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[11]  David Zhang,et al.  External Prior Guided Internal Prior Learning for Real-World Noisy Image Denoising , 2017, IEEE Transactions on Image Processing.

[12]  Benjamin Schrauwen,et al.  The student-t mixture as a natural image patch prior with application to image compression , 2014, J. Mach. Learn. Res..

[13]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[14]  L. Devroye.  A Course in Density Estimation , 1987 .

[15]  Michael Elad,et al.  Example-Based Image Synthesis via Randomized Patch-Matching , 2016, IEEE Transactions on Image Processing.

[16]  William T. Freeman,et al.  Computational Imaging for VLBI Image Reconstruction , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Yair Weiss,et al.  "Natural Images, Gaussian Mixtures and Dead Leaves" , 2012, NIPS.

[18]  P. Dutilleul.  The mle algorithm for the matrix normal distribution , 1999 .

[19]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[20]  Michael Elad,et al.  Expected Patch Log Likelihood with a Sparse Prior , 2014, EMMCVPR.

[21]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[22]  Truong Q. Nguyen,et al.  Accelerating GMM-Based Patch Priors for Image Restoration: Three Ingredients for a $100{\times}$ Speed-Up , 2019, IEEE Transactions on Image Processing.

[23]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[24]  David Zhang,et al.  Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoising , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Truong Q. Nguyen,et al.  Adaptive Image Denoising by Mixture Adaptation , 2016, IEEE Transactions on Image Processing.

[26]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[27]  Yasuyuki Matsushita,et al.  A Holistic Approach to Cross-Channel Image Noise Modeling and Its Application to Image Denoising , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[29]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[30]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).