Low-rank tensor train for tensor robust principal component analysis

Abstract Recently, tensor train rank, defined by a well-balanced matricization scheme, has been shown the powerful capacity to capture the hidden correlations among different modes of a tensor, leading to great success in tensor completion problem. Most of the high-dimensional data in the real world are more likely to be grossly corrupted with sparse noise. In this paper, based on tensor train rank, we consider a new model for tensor robust principal component analysis which aims to recover a low-rank tensor corrupted by sparse noise. The alternating direction method of multipliers algorithm is developed to solve the proposed model. A tensor augmentation tool called ket augmentation is used to convert lower-order tensors to higher-order tensors to enhance the performance of our method. Experiments of simulated data show the superiority of the proposed method in terms of PSNR and SSIM values. Moreover, experiments of the real rain streaks removal and the real stripe noise removal also illustrate the effectiveness of the proposed method.

[1]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[2]  John Wright,et al.  Provable Models for Robust Low-Rank Tensor Completion , 2015 .

[3]  Reinhold Schneider,et al.  Tensor completion in hierarchical tensor representations , 2014, ArXiv.

[4]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Minh N. Do,et al.  Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train , 2016, IEEE Transactions on Image Processing.

[6]  Andrzej Cichocki,et al.  Very Large-Scale Singular Value Decomposition Using Tensor Train Networks , 2014, ArXiv.

[7]  Ting-Zhu Huang,et al.  Total variation and high-order total variation adaptive model for restoring blurred images with Cauchy noise , 2019, Comput. Math. Appl..

[8]  Ting-Zhu Huang,et al.  Group-based image decomposition using 3-D cartoon and texture priors , 2016, Inf. Sci..

[9]  Bo Yang,et al.  Robust Volume Minimization-Based Matrix Factorization for Remote Sensing and Document Clustering , 2016, IEEE Transactions on Signal Processing.

[10]  Xiongjun Zhang,et al.  A Nonconvex Relaxation Approach to Low-Rank Tensor Completion , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Deyu Meng,et al.  A block coordinate descent approach for sparse principal component analysis , 2015, Neurocomputing.

[12]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Minh N. Do,et al.  Concatenated image completion via tensor augmentation and completion , 2016, 2016 10th International Conference on Signal Processing and Communication Systems (ICSPCS).

[14]  Ting-Zhu Huang,et al.  Total variation with overlapping group sparsity for deblurring images under Cauchy noise , 2019, Appl. Math. Comput..

[15]  J. Pereira,et al.  O papel da difusão por ressonância magnética na doença de Parkinson e no diagnóstico diferencial com parkinsonismo atípico , 2017 .

[16]  Hongyang Lu,et al.  MF-LRTC: Multi-filters guided low-rank tensor coding for image restoration , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[17]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[19]  Jin Wang,et al.  Convergence analysis of the augmented Lagrange multiplier algorithm for a class of matrix compressive recovery , 2016, Appl. Math. Lett..

[20]  Max L. N. Gonçalves On the pointwise iteration-complexity of a dynamic regularized ADMM with over-relaxation stepsize , 2018, Appl. Math. Comput..

[21]  J. Pereira,et al.  The role of diffusion magnetic resonance imaging in Parkinson's disease and in the differential diagnosis with atypical parkinsonism , 2017, Radiologia brasileira.

[22]  Misha Elena Kilmer,et al.  Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging , 2013, SIAM J. Matrix Anal. Appl..

[23]  R. W. Liu,et al.  Generalized total variation-based MRI Rician denoising model with spatially adaptive regularization parameters. , 2014, Magnetic resonance imaging.

[24]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..

[25]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Eric L. Miller,et al.  Tensor-Based Formulation and Nuclear Norm Regularization for Multienergy Computed Tomography , 2013, IEEE Transactions on Image Processing.

[27]  Ting-Zhu Huang,et al.  Destriping of Multispectral Remote Sensing Image Using Low-Rank Tensor Decomposition , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Michael K. Ng,et al.  A New Convex Optimization Model for Multiplicative Noise and Blur Removal , 2014, SIAM J. Imaging Sci..

[29]  Ting-Zhu Huang,et al.  A total variation and group sparsity based tensor optimization model for video rain streak removal , 2019, Signal Process. Image Commun..

[30]  Ting-Zhu Huang,et al.  FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors , 2018, IEEE Transactions on Image Processing.

[31]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[32]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[33]  Ting-Zhu Huang,et al.  Low-rank tensor completion via smooth matrix factorization , 2019, Applied Mathematical Modelling.

[34]  Xi-Le Zhao,et al.  Total Variation Structured Total Least Squares Method for Image Restoration , 2013, SIAM J. Sci. Comput..

[35]  Yuhao Wang,et al.  MF-LRTC: Multi-filters guided low-rank tensor coding for image restoration , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[36]  Bin Ran,et al.  Tensor completion via a multi-linear low-n-rank factorization model , 2014, Neurocomputing.

[37]  Michael K. Ng,et al.  Robust quaternion matrix completion with applications to image inpainting , 2019, Numer. Linear Algebra Appl..

[38]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[39]  Andrzej Cichocki,et al.  Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements , 2015, IEEE Transactions on Image Processing.

[40]  Yangquan Chen,et al.  Fractional-order total variation image denoising based on proximity algorithm , 2015, Appl. Math. Comput..

[41]  Sheng Zhong,et al.  Remote Sensing Image Stripe Noise Removal: From Image Decomposition Perspective , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Paul Tseng,et al.  Hankel Matrix Rank Minimization with Applications to System Identification and Realization , 2013, SIAM J. Matrix Anal. Appl..

[43]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..