Combined Internal and External Category-Specific Image Denoising

In this paper, we present a category-specific image denoising algorithm that exploits patch similarity within the input image and between the input image and an external dataset. We rely on standard internal denoising for smooth regions while consulting external images in the same category as the input to denoise textured regions. The external denoising component estimates the latent patches using the statistics, i.e. means and covariance matrices, of external patches, subject to a low-rank constraint. In the final stage, we aggregate results of internal and external denoising using a weighting rule based on the patch SNR measure. Our experimental results on five datasets confirms that the proposed algorithm produces superior results compared with state-of-the-art denoising methods both qualitatively and quantitatively.

[1]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Guillermo Sapiro,et al.  DCT image denoising: a simple and effective image denoising algorithm , 2011, Image Process. Line.

[3]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[4]  Truong Q. Nguyen,et al.  Image denoising by targeted external databases , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Xiaoyan Sun,et al.  Image Denoising by Exploring External and Internal Correlations , 2015, IEEE Transactions on Image Processing.

[7]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[8]  Michal Irani,et al.  Internal statistics of a single natural image , 2011, CVPR 2011.

[9]  Frédo Durand,et al.  Patch Complexity, Finite Pixel Correlations and Optimal Denoising , 2012, ECCV.

[10]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[11]  Kostadin Dabov,et al.  BM3D Image Denoising with Shape-Adaptive Principal Component Analysis , 2009 .

[12]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[13]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[14]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[15]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[19]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[20]  Truong Q. Nguyen,et al.  Adaptive Image Denoising by Targeted Databases , 2014, IEEE Transactions on Image Processing.

[21]  Stefano Soatto,et al.  Nonlocal Similarity Image Filtering , 2009, ICIAP.

[22]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[24]  Matthias Zwicker,et al.  Progressive Image Denoising , 2014, IEEE Transactions on Image Processing.

[25]  Michal Irani,et al.  Combining the power of Internal and External denoising , 2013, IEEE International Conference on Computational Photography (ICCP).

[26]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  Matthias Zwicker,et al.  Dual-domain image denoising , 2013, 2013 IEEE International Conference on Image Processing.

[28]  Ruomei Yan,et al.  Improved Nonlocal Means Based on Pre-Classification and Invariant Block Matching , 2012, Journal of Display Technology.

[29]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[30]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[31]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[32]  Xiaoyan Sun,et al.  CID: Combined Image Denoising in Spatial and Frequency Domains Using Web Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[35]  Stefan Harmeling,et al.  Learning How to Combine Internal and External Denoising Methods , 2013, GCPR.

[36]  Arnak S. Dalalyan,et al.  Image denoising with patch based PCA: local versus global , 2011, BMVC.