A Comparative Study for the Weighted Nuclear Norm Minimization and Nuclear Norm Minimization

Nuclear norm minimization (NNM) tends to over-shrink the rank components and treats the different rank components equally, thus limits its capability and flexibility. Recent studies have shown that the weighted nuclear norm minimization (WNNM) is expected to be more accurate than NNM. However, it still lacks a plausible mathematical explanation why WNNM is more accurate than NNM. This paper analyzes the WNNM and NNM from the perspective of the group sparse representation (GSR). In particular, an adaptive dictionary for each group is designed to connect the rank minimization and GSR models. Then, we prove that the rank minimization model is equivalent to GSR model. Based on that conclusion, we show mathematically that WNNM is more accurate than NNM. To make the proposed model tractable and robust, the alternative direction multiplier method (ADMM) framework is developed to solve the proposed model. We exploit the proposed scheme to three low level vision tasks, including image deblurring, image inpainting and image compressive sensing (CS) recovery. Experimental results demonstrate that the proposed scheme outperforms many state-of-the-art methods in terms of both quantitative measures and visual perception quality.

[1]  Lei Zhang,et al.  External Patch Prior Guided Internal Clustering for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Jian Dong,et al.  Accelerated low-rank visual recovery by random projection , 2011, CVPR 2011.

[3]  Xinggan Zhang,et al.  Analyzing the group sparsity based on the rank minimization methods , 2016, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[4]  Xuelong Li,et al.  Graph Regularized Non-Negative Low-Rank Matrix Factorization for Image Clustering , 2017, IEEE Transactions on Cybernetics.

[5]  Brendt Wohlberg,et al.  A nonconvex ADMM algorithm for group sparsity with sparse groups , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Henrik Ohlsson,et al.  Robust Subspace System Identification via Weighted Nuclear Norm Optimization , 2013, ArXiv.

[7]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[8]  陈飞 External Patch Prior Guided Internal Clustering for Image Denoising , 2015 .

[9]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[10]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[11]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[13]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[15]  XieQi,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2017 .

[16]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Wen Gao,et al.  Structural Group Sparse Representation for Image Compressive Sensing Recovery , 2013, 2013 Data Compression Conference.

[18]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[19]  Karen O. Egiazarian,et al.  Compressed Sensing Image Reconstruction Via Recursive Spatially Adaptive Filtering , 2007, ICIP.

[20]  Xuelong Li,et al.  Robust Semi-Supervised Subspace Clustering via Non-Negative Low-Rank Representation , 2016, IEEE Transactions on Cybernetics.

[21]  John Wright,et al.  RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[23]  A. Lewis The Convex Analysis of Unitarily Invariant Matrix Functions , 1995 .

[24]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[25]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[26]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[27]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[28]  Ruslan Salakhutdinov,et al.  Collaborative Filtering in a Non-Uniform World: Learning with the Weighted Trace Norm , 2010, NIPS.

[29]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[30]  James E. Fowler,et al.  Block Compressed Sensing of Images Using Directional Transforms , 2010, 2010 Data Compression Conference.

[31]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[32]  Jong Chul Ye,et al.  Annihilating Filter-Based Low-Rank Hankel Matrix Approach for Image Inpainting , 2015, IEEE Transactions on Image Processing.

[33]  Wen Gao,et al.  Nonconvex Lp Nuclear Norm based ADMM Framework for Compressed Sensing , 2016, 2016 Data Compression Conference (DCC).

[34]  Shuicheng Yan,et al.  Nonconvex Nonsmooth Low Rank Minimization via Iteratively Reweighted Nuclear Norm , 2015, IEEE Transactions on Image Processing.

[35]  Wotao Yin,et al.  A fast patch-dictionary method for whole image recovery , 2014, ArXiv.

[36]  Michael Elad,et al.  Multi-Scale Patch-Based Image Restoration , 2016, IEEE Transactions on Image Processing.

[37]  Licheng Jiao,et al.  Discriminative Dictionary Learning With Two-Level Low Rank and Group Sparse Decomposition for Image Classification , 2017, IEEE Transactions on Cybernetics.

[38]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[39]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[40]  Shuicheng Yan,et al.  Generalized Nonconvex Nonsmooth Low-Rank Minimization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Lan Tang,et al.  Non-Convex Weighted Schatten p-Norm Minimization based ADMM Framework for Image Restoration , 2017, ArXiv.

[42]  Zuowei Shen,et al.  Robust Video Restoration by Joint Sparse and Low Rank Matrix Approximation , 2011, SIAM J. Imaging Sci..

[43]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[44]  Lei Zhang,et al.  Image reconstruction with locally adaptive sparsity and nonlocal robust regularization , 2012, Signal Process. Image Commun..