Structured Dictionary Learning for Image Denoising Under Mixed Gaussian and Impulse Noise

Although image denoising as a basic task of image restoration has been widely studied in the past decades, there are not many studies on mixed noise denoising. In this paper, we propose two structured dictionary learning models to recover images corrupted by mixed Gaussian and impulse noise. These two models can be merged as <inline-formula> <tex-math notation="LaTeX">$\ell _{p}$ </tex-math></inline-formula>-norm fidelity plus <inline-formula> <tex-math notation="LaTeX">$\ell _{q}$ </tex-math></inline-formula>-norm regularization. The fidelity term is used to fit image patches and the regularization term is employed for sparse coding. Particularly, we utilize proximal (and proximal linearized) alternating minimization methods as the main solvers to deal with these two models. We remove the Gaussian noise under the assumption that the uncorrupted image can be approximated with a linear representation under an appropriate orthogonal basis. We use different ways to remove impulse noise for these two models. The experimental results are reported to compare the existing methods and demonstrate the performance of the proposed denoising model is better than the other existing methods in terms of some quality assessment metrics.

[1]  Rama Chellappa,et al.  Sparse Representations, Compressive Sensing and dictionaries for pattern recognition , 2011, The First Asian Conference on Pattern Recognition.

[2]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[3]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[4]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[6]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Hédy Attouch,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality , 2008, Math. Oper. Res..

[8]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[9]  Tamer F. Rabie,et al.  Adaptive hybrid mean and median filtering of high-ISO long-exposure sensor noise for digital photography , 2004, J. Electronic Imaging.

[10]  Sung-Jea Ko,et al.  Center weighted median filters and their applications to image enhancement , 1991 .

[11]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[12]  Jian Yu,et al.  Restoration of images corrupted by mixed Gaussian-impulse noise via l1-l0 minimization , 2011, Pattern Recognit..

[13]  Yufeng Nie,et al.  Mixed Noise Removal Algorithm Combining Adaptive Directional Weighted Mean Filter and Improved Adaptive Anisotropic Diffusion Model , 2018 .

[14]  Hong Zhu,et al.  Large sparse signal recovery by conjugate gradient algorithm based on smoothing technique , 2013, Comput. Math. Appl..

[15]  A. Venetsanopoulos,et al.  A multichannel order-statistic technique for cDNA microarray image processing , 2004, IEEE Transactions on NanoBioscience.

[16]  Shaoping Xu,et al.  A Blind CNN Denoising Model for Random-Valued Impulse Noise , 2019, IEEE Access.

[17]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[18]  Jong Chul Ye,et al.  Sparse and Low-Rank Decomposition of a Hankel Structured Matrix for Impulse Noise Removal , 2018, IEEE Transactions on Image Processing.

[19]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[20]  Michael J. Black,et al.  Efficient Belief Propagation with Learned Higher-Order Markov Random Fields , 2006, ECCV.

[21]  Onur G. Guleryuz,et al.  Sparse orthonormal transforms for image compression , 2008, 2008 15th IEEE International Conference on Image Processing.

[22]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Rama Chellappa,et al.  Rotation invariant simultaneous clustering and dictionary learning , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Jian Yang,et al.  Mixed Noise Removal by Weighted Encoding With Sparse Nonlocal Regularization , 2014, IEEE Transactions on Image Processing.

[25]  Zhongliang Jing,et al.  Discriminative Structured Dictionary Learning on Grassmann Manifolds and Its Application on Image Restoration , 2018, IEEE Transactions on Cybernetics.

[26]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[27]  K. Kurdyka On gradients of functions definable in o-minimal structures , 1998 .

[28]  Lei Zhang,et al.  RFSIM: A feature based image quality assessment metric using Riesz transforms , 2010, 2010 IEEE International Conference on Image Processing.

[29]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[30]  Yan Cui,et al.  Mixed noise removal by weighted low rank model , 2015, Neurocomputing.

[31]  Charles K. Chui,et al.  A universal noise removal algorithm with an impulse detector , 2005, IEEE Transactions on Image Processing.

[32]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[33]  Xue-Cheng Tai,et al.  A Weighted Dictionary Learning Model for Denoising Images Corrupted by Mixed Noise , 2013, IEEE Transactions on Image Processing.

[34]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[35]  Banshidhar Majhi,et al.  An improved adaptive impulsive noise suppression scheme for digital images , 2010 .

[36]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[38]  Naoto Wakatsuki,et al.  Noise reduction in ultrasonic computerized tomography by preprocessing for projection data , 2015 .

[39]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[40]  Raymond H. Chan,et al.  Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization , 2005, IEEE Transactions on Image Processing.

[41]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[42]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[43]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[44]  Stefan Roth,et al.  Shrinkage Fields for Effective Image Restoration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[46]  Yong Cheng,et al.  Modified directional weighted filter for removal of salt & pepper noise , 2014, Pattern Recognit. Lett..

[47]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[48]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[49]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[50]  Stéphane Mallat,et al.  Image modeling and enhancement via structured sparse model selection , 2010, 2010 IEEE International Conference on Image Processing.

[51]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[52]  D. R. K. Brownrigg,et al.  The weighted median filter , 1984, CACM.

[53]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[54]  Jian-Feng Cai,et al.  Two-phase approach for deblurring images corrupted by impulse plus gaussian noise , 2008 .

[55]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[56]  M. Omair Ahmad,et al.  Mixed Gaussian-impulse noise reduction from images using convolutional neural network , 2018, Signal Process. Image Commun..

[57]  H. Wu,et al.  Adaptive impulse detection using center-weighted median filters , 2001, IEEE Signal Processing Letters.

[58]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[59]  Adrian Barbu,et al.  Training an Active Random Field for Real-Time Image Denoising , 2009, IEEE Transactions on Image Processing.

[60]  Ilke TURKMEN,et al.  The ANN based detector to remove random-valued impulse noise in images , 2016, J. Vis. Commun. Image Represent..

[61]  M. R. Osborne,et al.  A new approach to variable selection in least squares problems , 2000 .

[62]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[63]  Mathews Jacob,et al.  A Fast Algorithm for Convolutional Structured Low-Rank Matrix Recovery , 2016, IEEE Transactions on Computational Imaging.

[65]  Brendt Wohlberg,et al.  MIxed gaussian-impulse noise image restoration via total variation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[66]  Richard A. Haddad,et al.  Adaptive median filters: new algorithms and results , 1995, IEEE Trans. Image Process..

[67]  G. Deng,et al.  An adaptive Gaussian filter for noise reduction and edge detection , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[68]  Marshall F. Tappen,et al.  Utilizing Variational Optimization to Learn Markov Random Fields , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.