Truncated nuclear norm regularization for low-rank tensor completion

Recently, low-rank tensor completion has become increasingly attractive in recovering incomplete visual data. Considering a color image or video as a three-dimensional (3D) tensor, existing studies have put forward several definitions of tensor nuclear norm. However, they are limited and may not accurately approximate the real rank of a tensor, and they do not explicitly use the low-rank property in optimization. It is proved that the recently proposed truncated nuclear norm (TNN) can replace the traditional nuclear norm, as an improved approximation to the rank of a matrix. In this paper, we propose a new method called the tensor truncated nuclear norm (T-TNN), which suggests a new definition of tensor nuclear norm. The truncated nuclear norm is generalized from the matrix case to the tensor case. With the help of the low rankness of TNN, our approach improves the efficacy of tensor completion. We adopt the definition of the previously proposed tensor singular value decomposition, the alternating direction method of multipliers, and the accelerated proximal gradient line search method in our algorithm. Substantial experiments on real-world videos and images illustrate that the performance of our approach is better than those of previous methods.

[1]  Shiping Wang,et al.  Salient object detection with low-rank approximation and ℓ2, 1-norm minimization , 2017, Image Vis. Comput..

[2]  Yi Liu,et al.  Salient object detection based on super-pixel clustering and unified low-rank representation , 2017, Comput. Vis. Image Underst..

[3]  Hongbin Zha,et al.  Factorization for projective and metric reconstruction via truncated nuclear norm , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[4]  Zhao Wang,et al.  Motion Capture Data Completion via Truncated Nuclear Norm Regularization , 2018, IEEE Signal Processing Letters.

[5]  Ying Tai,et al.  Nuclear Norm Based Matrix Regression with Applications to Face Recognition with Occlusion and Illumination Changes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Yao Hu,et al.  Large scale multi-class classification with truncated nuclear norm regularization , 2015, Neurocomputing.

[7]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[8]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jian Yang,et al.  Learning robust and discriminative low-rank representations for face recognition with occlusion , 2017, Pattern Recognit..

[10]  Misha Elena Kilmer,et al.  Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging , 2013, SIAM J. Matrix Anal. Appl..

[11]  Handong Zhao,et al.  Learning Fast Low-Rank Projection for Image Classification , 2016, IEEE Transactions on Image Processing.

[12]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[13]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Fan Liu,et al.  Low-Rank Tensor Completion by Truncated Nuclear Norm Regularization , 2017, 2018 24th International Conference on Pattern Recognition (ICPR).

[15]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.

[16]  Chun Chen,et al.  Image Alignment by Online Robust PCA via Stochastic Gradient Descent , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Xuelong Li,et al.  Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Xinyu Jin,et al.  Robust classwise and projective low-rank representation for image classification , 2017, Signal, Image and Video Processing.

[19]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Edmund Y. Lam,et al.  Computationally Efficient Truncated Nuclear Norm Minimization for High Dynamic Range Imaging , 2016, IEEE Transactions on Image Processing.

[21]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[22]  Yao Hu,et al.  Online robust principal component analysis via truncated nuclear norm regularization , 2016, Neurocomputing.

[23]  Qing Liu,et al.  A Truncated Nuclear Norm Regularization Method Based on Weighted Residual Error for Matrix Completion , 2016, IEEE Transactions on Image Processing.

[24]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Xiaodong Wang,et al.  Adaptive Sampling of RF Fingerprints for Fine-Grained Indoor Localization , 2015, IEEE Transactions on Mobile Computing.

[26]  Eric L. Miller,et al.  Tensor-Based Formulation and Nuclear Norm Regularization for Multienergy Computed Tomography , 2013, IEEE Transactions on Image Processing.

[27]  Wenrui Hu,et al.  Nonlocal image denoising via adaptive tensor nuclear norm minimization , 2015, Neural Computing and Applications.

[28]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[29]  Yun Fu,et al.  Learning low-rank and discriminative dictionary for image classification , 2014, Image Vis. Comput..