Discriminative Structured Dictionary Learning on Grassmann Manifolds and Its Application on Image Restoration

Image restoration is a difficult and challenging problem in various imaging applications. However, despite of the benefits of a single overcomplete dictionary, there are still several challenges for capturing the geometric structure of image of interest. To more accurately represent the local structures of the underlying signals, we propose a new problem formulation for sparse representation with block-orthogonal constraint. There are three contributions. First, a framework for discriminative structured dictionary learning is proposed, which leads to a smooth manifold structure and quotient search spaces. Second, an alternating minimization scheme is proposed after taking both the cost function and the constraints into account. This is achieved by iteratively alternating between updating the block structure of the dictionary defined on Grassmann manifold and sparsifying the dictionary atoms automatically. Third, Riemannian conjugate gradient is considered to track local subspaces efficiently with a convergence guarantee. Extensive experiments on various datasets demonstrate that the proposed method outperforms the state-of-the-art methods on the removal of mixed Gaussian-impulse noise.

[1]  Henry Leung,et al.  A discrete-time learning algorithm for image restoration using a novel L2-norm noise constrained estimation , 2016, Neurocomputing.

[2]  Jian-Feng Cai,et al.  Fast Sparsity-Based Orthogonal Dictionary Learning for Image Restoration , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[4]  Li Zhang,et al.  Correlation Filter Learning Toward Peak Strength for Visual Tracking , 2018, IEEE Transactions on Cybernetics.

[5]  Qionghai Dai,et al.  Reweighted Low-Rank Matrix Recovery and its Application in Image Restoration , 2014, IEEE Transactions on Cybernetics.

[6]  Zhang Yi,et al.  Trajectory Predictor by Using Recurrent Neural Networks in Visual Tracking , 2017, IEEE Transactions on Cybernetics.

[7]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[8]  Pierre-Antoine Absil,et al.  RTRMC: A Riemannian trust-region method for low-rank matrix completion , 2011, NIPS.

[9]  Richard A. Haddad,et al.  Adaptive median filters: new algorithms and results , 1995, IEEE Trans. Image Process..

[10]  David J. Kriegman,et al.  Clustering appearances of objects under varying illumination conditions , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Charles K. Chui,et al.  A universal noise removal algorithm with an impulse detector , 2005, IEEE Transactions on Image Processing.

[13]  Xuelong Li,et al.  SERF: A Simple, Effective, Robust, and Fast Image Super-Resolver From Cascaded Linear Regression , 2016, IEEE Transactions on Image Processing.

[14]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[15]  Yasushi Yagi,et al.  Gait Recognition Based on Normal Distance Maps , 2018, IEEE Transactions on Cybernetics.

[16]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[17]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..

[18]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[19]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[20]  Brendt Wohlberg,et al.  MIxed gaussian-impulse noise image restoration via total variation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Xuelong Li,et al.  A Comprehensive Survey to Face Hallucination , 2013, International Journal of Computer Vision.

[22]  Peng Qiao,et al.  Fast and Accurate Poisson Denoising With Trainable Nonlinear Diffusion , 2018, IEEE Transactions on Cybernetics.

[23]  Stéphane Canu,et al.  Recovering Sparse Signals With a Certain Family of Nonconvex Penalties and DC Programming , 2009, IEEE Transactions on Signal Processing.

[24]  Marko Filipovic,et al.  Restoration of images corrupted by mixed Gaussian-impulse noise by iterative soft-hard thresholding , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[25]  Jian Yu,et al.  Restoration of images corrupted by mixed Gaussian-impulse noise via l1-l0 minimization , 2011, Pattern Recognit..

[26]  Bogdan Dumitrescu,et al.  Block orthonormal overcomplete dictionary learning , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[27]  Yonina C. Eldar,et al.  Dictionary Optimization for Block-Sparse Representations , 2010, IEEE Transactions on Signal Processing.

[28]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[29]  L. Eldén,et al.  Grassmann algorithms for low rank approximation of matrices with missing values , 2010 .

[30]  Fei Zhou,et al.  MDID: A multiply distorted image database for image quality assessment , 2017, Pattern Recognit..

[31]  Brian C. Lovell,et al.  Extrinsic Methods for Coding and Dictionary Learning on Grassmann Manifolds , 2014, International Journal of Computer Vision.

[32]  Bart Vandereycken,et al.  Low-Rank Matrix Completion by Riemannian Optimization , 2013, SIAM J. Optim..

[33]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[34]  Youshen Xia,et al.  Poissonian Hyperspectral Image Superresolution Using Alternating Direction Optimization , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  H. Wu,et al.  Adaptive impulse detection using center-weighted median filters , 2001, IEEE Signal Processing Letters.

[36]  Brian C. Lovell,et al.  Dictionary Learning and Sparse Coding on Grassmann Manifolds: An Extrinsic Solution , 2013, 2013 IEEE International Conference on Computer Vision.

[37]  Peter Meer,et al.  Conjugate gradient on Grassmann manifolds for robust subspace estimation , 2012, Image Vis. Comput..

[38]  Jian-Feng Cai,et al.  Two-phase approach for deblurring images corrupted by impulse plus gaussian noise , 2008 .

[39]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[40]  Donghua Zhou,et al.  Single image haze removal via depth-based contrast stretching transform , 2014, Science China Information Sciences.

[41]  Mohamed S. Kamel,et al.  Novel Cooperative Neural Fusion Algorithms for Image Restoration and Image Fusion , 2007, IEEE Transactions on Image Processing.

[42]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[43]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[44]  Stéphane Mallat,et al.  Image modeling and enhancement via structured sparse model selection , 2010, 2010 IEEE International Conference on Image Processing.

[45]  Jie Li,et al.  Bayesian Face Sketch Synthesis , 2017, IEEE Transactions on Image Processing.

[46]  Bahadir K. Gunturk,et al.  Image Restoration , 2012 .

[47]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).