Stable Tensor Principal Component Pursuit: Error Bounds and Efficient Algorithms

The rapid development of sensor technology gives rise to the emergence of huge amounts of tensor (i.e., multi-dimensional array) data. For various reasons such as sensor failures and communication loss, the tensor data may be corrupted by not only small noises but also gross corruptions. This paper studies the Stable Tensor Principal Component Pursuit (STPCP) which aims to recover a tensor from its corrupted observations. Specifically, we propose a STPCP model based on the recently proposed tubal nuclear norm (TNN) which has shown superior performance in comparison with other tensor nuclear norms. Theoretically, we rigorously prove that under tensor incoherence conditions, the underlying tensor and the sparse corruption tensor can be stably recovered. Algorithmically, we first develop an ADMM algorithm and then accelerate it by designing a new algorithm based on orthogonal tensor factorization. The superiority and efficiency of the proposed algorithms is demonstrated through experiments on both synthetic and real data sets.

[1]  Yong Peng,et al.  Discriminative extreme learning machine with supervised sparsity preserving for image classification , 2017, Neurocomputing.

[2]  Emmanuel J. Candès,et al.  The Power of Convex Relaxation: Near-Optimal Matrix Completion , 2009, IEEE Transactions on Information Theory.

[3]  Ming Yuan,et al.  Incoherent Tensor Norms and Their Applications in Higher Order Tensor Completion , 2016, IEEE Transactions on Information Theory.

[4]  Yong Peng,et al.  Robust structured sparse representation via half-quadratic optimization for face recognition , 2016, Multimedia Tools and Applications.

[5]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[7]  Guangdong Feng,et al.  A Tensor Based Method for Missing Traffic Data Completion , 2013 .

[8]  Christopher J. Hillar,et al.  Most Tensor Problems Are NP-Hard , 2009, JACM.

[9]  Shuicheng Yan,et al.  Exact Low Tubal Rank Tensor Recovery from Gaussian Measurements , 2018, IJCAI.

[10]  Lei Huang,et al.  Tensor Completion via Generalized Tensor Tubal Rank Minimization Using General Unfolding , 2018, IEEE Signal Processing Letters.

[11]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[12]  Andong Wang,et al.  Noisy low-tubal-rank tensor completion , 2019, Neurocomputing.

[13]  Michael K. Ng,et al.  Exact Tensor Completion from Sparsely Corrupted Observations via Convex Optimization , 2017, ArXiv.

[14]  Bo Wang,et al.  Tensor Completion Using Spectral $(k,p)$ -Support Norm , 2018, IEEE Access.

[15]  Ryota Tomioka,et al.  Estimation of low-rank tensors via convex optimization , 2010, 1010.0789.

[16]  Yuan Xie,et al.  On Unifying Multi-view Self-Representations for Clustering by Tensor Multi-rank Minimization , 2016, International Journal of Computer Vision.

[17]  Donald Goldfarb,et al.  Robust Low-Rank Tensor Recovery: Models and Algorithms , 2013, SIAM J. Matrix Anal. Appl..

[18]  Jiawei Han,et al.  Robust Tensor Decomposition with Gross Corruption , 2014, NIPS.

[19]  Qi Xie,et al.  A Novel Sparsity Measure for Tensor Recovery , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Taiji Suzuki,et al.  Convex Tensor Decomposition via Structured Schatten Norm Regularization , 2013, NIPS.

[21]  Andong Wang,et al.  Robust tensor decomposition via t-SVD: Near-optimal statistical guarantee and scalable algorithms , 2020, Signal Process..

[22]  Xiaodong Wang,et al.  Adaptive Sampling of RF Fingerprints for Fine-Grained Indoor Localization , 2015, IEEE Transactions on Mobile Computing.

[23]  Navid Ghadermarzy,et al.  Learning Tensors From Partial Binary Measurements , 2018, IEEE Transactions on Signal Processing.

[24]  Pan Zhou,et al.  Tensor Factorization for Low-Rank Tensor Completion , 2018, IEEE Transactions on Image Processing.

[25]  Carla D. Martin,et al.  An Order-p Tensor Factorization with Applications in Imaging , 2013, SIAM J. Sci. Comput..

[26]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[27]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Xiaodong Wang,et al.  Low-Tubal-Rank Tensor Completion Using Alternating Minimization , 2016, IEEE Transactions on Information Theory.

[29]  Yang Zhou,et al.  Bayesian Low-Tubal-Rank Robust Tensor Factorization with Multi-Rank Determination , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Andrzej Cichocki,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 1 Low-Rank Tensor Decompositions , 2016, Found. Trends Mach. Learn..

[31]  M. Kilmer,et al.  Tensor-Tensor Products with Invertible Linear Transforms , 2015 .

[32]  Shuchin Aeron,et al.  5D seismic data completion and denoising using a novel class of tensor decompositions , 2015 .

[33]  Özgür Yilmaz,et al.  Near-optimal sample complexity for convex tensor completion , 2017, Information and Inference: A Journal of the IMA.

[34]  Misha Elena Kilmer,et al.  Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging , 2013, SIAM J. Matrix Anal. Appl..

[35]  Yunchao Wei,et al.  Low-Rank Tensor Completion With a New Tensor Nuclear Norm Induced by Invertible Linear Transforms , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Xiaodong Wang,et al.  Fourth-order Tensors with Multidimensional Discrete Transforms , 2017, ArXiv.

[37]  Andong Wang,et al.  A Factorization Strategy for Tensor Robust PCA , 2019, ACPR.

[38]  Yik-Chung Wu,et al.  Subspace Identification for DOA Estimation in Massive/Full-Dimension MIMO Systems: Bad Data Mitigation and Automatic Source Enumeration , 2015, IEEE Transactions on Signal Processing.

[39]  Shuicheng Yan,et al.  Active Subspace: Toward Scalable Low-Rank Learning , 2012, Neural Computation.

[40]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[41]  Sajid Javed,et al.  Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery , 2017, IEEE Signal Processing Magazine.

[42]  Liqing Zhang,et al.  Bayesian Robust Tensor Factorization for Incomplete Multiway Data , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Ming Yuan,et al.  On Tensor Completion via Nuclear Norm Minimization , 2014, Foundations of Computational Mathematics.

[44]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Yik-Chung Wu,et al.  Irregular Array Manifold Aided Channel Estimation in Massive MIMO Communications , 2019, IEEE Journal of Selected Topics in Signal Processing.

[46]  Hong Cheng,et al.  Generalized Higher-Order Orthogonal Iteration for Tensor Decomposition and Completion , 2014, NIPS.

[47]  Qiang Jiang,et al.  Robust Low-Tubal-Rank Tensor Completion via Convex Optimization , 2019, IJCAI.

[48]  Wei Liu,et al.  Tensor Robust Principal Component Analysis with a New Tensor Nuclear Norm , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Yuanyuan Liu,et al.  An Efficient Matrix Factorization Method for Tensor Completion , 2013, IEEE Signal Processing Letters.

[50]  Wotao Yin,et al.  Parallel matrix factorization for low-rank tensor completion , 2013, ArXiv.

[51]  Bo Wang,et al.  Noisy Low-Tubal-Rank Tensor Completion Through Iterative Singular Tube Thresholding , 2018, IEEE Access.

[52]  Eric L. Miller,et al.  Tensor-Based Formulation and Nuclear Norm Regularization for Multienergy Computed Tomography , 2013, IEEE Transactions on Image Processing.

[53]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[54]  Bo Huang,et al.  Square Deal: Lower Bounds and Improved Relaxations for Tensor Recovery , 2013, ICML.

[55]  Tianwen Wei,et al.  Sensing Tensors With Gaussian Filters , 2015, IEEE Transactions on Information Theory.

[56]  Xiaodong Li,et al.  Stable Principal Component Pursuit , 2010, 2010 IEEE International Symposium on Information Theory.