Depth Image Denoising Using Nuclear Norm and Learning Graph Model

Depth image denoising is increasingly becoming the hot research topic nowadays, because it reflects the three-dimensional scene and can be applied in various fields of computer vision. But the depth images obtained from depth camera usually contain stains such as noise, which greatly impairs the performance of depth-related applications. In this article, considering that group-based image restoration methods are more effective in gathering the similarity among patches, a group-based nuclear norm and learning graph (GNNLG) model was proposed. For each patch, we find and group the most similar patches within a searching window. The intrinsic low-rank property of the grouped patches is exploited in our model. In addition, we studied the manifold learning method and devised an effective optimized learning strategy to obtain the graph Laplacian matrix, which reflects the topological structure of image, to further impose the smoothing priors to the denoised depth image. To achieve fast speed and high convergence, the alternating direction method of multipliers is proposed to solve our GNNLG. The experimental results show that the proposed method is superior to other current state-of-the-art denoising methods in both subjective and objective criterion.

[1]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[2]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[3]  D. Donoho,et al.  Redundant Multiscale Transforms and Their Application for Morphological Component Separation , 2004 .

[4]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[6]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[7]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[8]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[9]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[10]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.

[11]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[12]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[14]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[15]  Colin Studholme,et al.  A Supervised Patch-Based Approach for Human Brain Labeling , 2011, IEEE Transactions on Medical Imaging.

[16]  Xue-Cheng Tai,et al.  A Weighted Dictionary Learning Model for Denoising Images Corrupted by Mixed Noise , 2013, IEEE Transactions on Image Processing.

[17]  X. Zhang,et al.  Two-Direction Nonlocal Model for Image Denoising , 2013, IEEE Transactions on Image Processing.

[18]  Oscar C. Au,et al.  Depth map denoising using graph-based transform and group sparsity , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[19]  Rongrong Ji,et al.  Weakly Supervised Multi-Graph Learning for Robust Image Reranking , 2014, IEEE Transactions on Multimedia.

[20]  Xavier Bresson,et al.  Matrix Completion on Graphs , 2014, NIPS 2014.

[21]  Zhiliang Zhu,et al.  Fast Single Image Super-Resolution via Self-Example Learning and Sparse Representation , 2014, IEEE Transactions on Multimedia.

[22]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[23]  Feng Liu,et al.  Depth Enhancement via Low-Rank Matrix Completion , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Angshul Majumdar,et al.  Split Bregman algorithms for sparse / joint-sparse and low-rank signal recovery: Application in compressive hyperspectral imaging , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[25]  Li-Wei Kang,et al.  Self-Learning Based Image Decomposition With Applications to Single Image Denoising , 2014, IEEE Transactions on Multimedia.

[26]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Y. Hao,et al.  Iterative Total Variation Image Deblurring with Varying Regularized Parameter , 2014, 2014 Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics.

[28]  Diego H. Milone,et al.  Wavelet shrinkage using adaptive structured sparsity constraints , 2015, Signal Process..

[29]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[30]  Rogério Schmidt Feris,et al.  Joint Super Resolution and Denoising From a Single Depth Image , 2015, IEEE Transactions on Multimedia.

[31]  Lorenzo Bruzzone,et al.  Region-Based Retrieval of Remote Sensing Images Using an Unsupervised Graph-Theoretic Approach , 2016, IEEE Geoscience and Remote Sensing Letters.

[32]  Michael Elad,et al.  Dual Graph Regularized Dictionary Learning , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[33]  Xianming Liu,et al.  Random Walk Graph Laplacian-Based Smoothness Prior for Soft Decoding of JPEG Images , 2016, IEEE Transactions on Image Processing.

[34]  Wenzhong Guo,et al.  Sparse Multigraph Embedding for Multimodal Feature Representation , 2017, IEEE Transactions on Multimedia.

[35]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[36]  Deng Cai,et al.  Depth Image Inpainting: Improving Low Rank Matrix Completion With Low Gradient Regularization , 2017, IEEE Transactions on Image Processing.

[37]  Ulugbek Kamilov,et al.  A Parallel Proximal Algorithm for Anisotropic Total Variation Minimization , 2017, IEEE Transactions on Image Processing.

[38]  Chenggang Clarence Yan,et al.  CFMDA: collaborative filtering-based MiRNA-disease association prediction , 2017, Multimedia Tools and Applications.

[39]  Rong Chen,et al.  Depth Image Denoising via Collaborative Graph Fourier Transform , 2017, IFTC.

[40]  Xinggan Zhang,et al.  Nonconvex Weighted $\ell _p$ Minimization Based Group Sparse Representation Framework for Image Denoising , 2017, IEEE Signal Processing Letters.

[41]  Zhenhua Guo,et al.  Color-Guided Depth Recovery via Joint Local Structural and Nonlocal Low-Rank Regularization , 2017, IEEE Transactions on Multimedia.

[42]  Ivan W. Selesnick,et al.  Total Variation Denoising Via the Moreau Envelope , 2017, IEEE Signal Processing Letters.

[43]  Yun Fu,et al.  Marginalized Denoising Dictionary Learning With Locality Constraint , 2018, IEEE Transactions on Image Processing.

[44]  Yongdong Zhang,et al.  A Fast Uyghur Text Detector for Complex Background Images , 2018, IEEE Transactions on Multimedia.

[45]  Qionghai Dai,et al.  Cross-Modality Bridging and Knowledge Transferring for Image Understanding , 2019, IEEE Transactions on Multimedia.

[46]  Ce Zhu,et al.  Image Completion Using Low Tensor Tree Rank and Total Variation Minimization , 2019, IEEE Transactions on Multimedia.

[47]  Biyao Shao,et al.  3D Room Layout Estimation From a Single RGB Image , 2020, IEEE Transactions on Multimedia.

[48]  Yongdong Zhang,et al.  STAT: Spatial-Temporal Attention Mechanism for Video Captioning , 2020, IEEE Transactions on Multimedia.

[49]  Yue Gao,et al.  Deep Multi-View Enhancement Hashing for Image Retrieval , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.