Enhanced Nonconvex Low-Rank Approximation of Tensor Multi-Modes for Tensor Completion

Higher-order low-rank tensor arises in many data processing applications and has attracted great interests. Inspired by low-rank approximation theory, researchers have proposed a series of effective tensor completion methods. However, most of these methods directly consider the global low-rankness of underlying tensors, which is not sufficient for a low sampling rate; in addition, the single nuclear norm or its relaxation is usually adopted to approximate the rank function, which would lead to suboptimal solution deviated from the original one. To alleviate the above problems, in this paper, we propose a novel low-rank approximation of tensor multi-modes (LRATM), in which a double nonconvex $L_{\gamma}$ norm is designed to represent the underlying joint-manifold drawn from the modal factorization factors of the underlying tensor. A block successive upper-bound minimization method-based algorithm is designed to efficiently solve the proposed model, and it can be demonstrated that our numerical scheme converges to the coordinatewise minimizers. Numerical results on three types of public multi-dimensional datasets have tested and shown that our algorithm can recover a variety of low-rank tensors with significantly fewer samples than the compared methods.

[1]  Zhouchen Lin,et al.  Tensor Q-Rank: A New Data Dependent Tensor Rank , 2019, ArXiv.

[2]  Ting-Zhu Huang,et al.  Low-rank tensor completion via smooth matrix factorization , 2019, Applied Mathematical Modelling.

[3]  Jonathan Cheung-Wai Chan,et al.  Nonlocal Low-Rank Regularized Tensor Decomposition for Hyperspectral Image Denoising , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Wotao Yin,et al.  Parallel matrix factorization for low-rank tensor completion , 2013, ArXiv.

[6]  Xue-Cheng Tai,et al.  Noise removal using smoothed normals and surface fitting , 2004, IEEE Transactions on Image Processing.

[7]  Jonathan Cheung-Wai Chan,et al.  Enhanced Sparsity Prior Model for Low-Rank Tensor Completion , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Jack Xin,et al.  Computing Sparse Representation in a Highly Coherent Dictionary Based on Difference of $$L_1$$L1 and $$L_2$$L2 , 2015, J. Sci. Comput..

[9]  Wei Liu,et al.  Tensor Robust Principal Component Analysis with a New Tensor Nuclear Norm , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yipeng Liu,et al.  Provable Model for Tensor Ring Completion , 2019, Signal Process..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Jifeng Ning,et al.  Hyperspectral Image Restoration via Global L1-2 Spatial–Spectral Total Variation Regularized Local Low-Rank Tensor Recovery , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Xi-Le Zhao,et al.  Low-Rank Tensor Completion Using Matrix Factorization Based on Tensor Train Rank and Total Variation , 2019, Journal of Scientific Computing.

[14]  Jean-Yves Tourneret,et al.  Bayesian 3D Reconstruction of Subsampled Multispectral Single-Photon Lidar Signals , 2019, IEEE Transactions on Computational Imaging.

[15]  Jian Yang,et al.  LRR for Subspace Segmentation via Tractable Schatten- $p$ Norm Minimization and Factorization , 2019, IEEE Transactions on Cybernetics.

[16]  Stéphane Gaïffas,et al.  Weighted algorithms for compressed sensing and matrix completion , 2011, ArXiv.

[17]  Michael K. Ng,et al.  Tensor Factorization with Total Variation and Tikhonov Regularization for Low-Rank Tensor Completion in Imaging Data , 2019, Journal of Mathematical Imaging and Vision.

[18]  A. B. Lefkoff,et al.  Expert system-based mineral mapping in northern death valley, California/Nevada, using the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1993 .

[19]  Alfred O. Hero,et al.  3D image reconstruction for a Compton SPECT camera model , 1999 .

[20]  Jifeng Ning,et al.  Hyperspectral Image Denoising via Global Spatial-Spectral Total Variation Regularized Nonconvex Local Low-Rank Tensor Approximation , 2020, Signal Process..

[21]  Yuan Zhao,et al.  Hyperspectral image restoration via CNN denoiser prior regularized low-rank tensor recovery , 2020, Comput. Vis. Image Underst..

[22]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[23]  Jonathan Cheung-Wai Chan,et al.  Nonconvex tensor rank minimization and its applications to tensor recovery , 2019, Inf. Sci..

[24]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Shuicheng Yan,et al.  Generalized Nonconvex Nonsmooth Low-Rank Minimization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Zhi-Quan Luo,et al.  A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization , 2012, SIAM J. Optim..

[27]  Mehmet Akcakaya,et al.  Low-Rank Tensor Models for Improved Multidimensional MRI: Application to Dynamic Cardiac $T_1$ Mapping , 2020, IEEE Transactions on Computational Imaging.

[28]  Dong Wang,et al.  Denoising of Hyperspectral Images Using Nonconvex Low Rank Matrix Approximation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jianjun Yuan MRI denoising via sparse tensors with reweighted regularization , 2019 .

[30]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[31]  Misha Elena Kilmer,et al.  Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging , 2013, SIAM J. Matrix Anal. Appl..

[32]  Zongben Xu,et al.  Folded-concave penalization approaches to tensor completion , 2015, Neurocomputing.

[33]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[34]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.

[35]  Guillermo Sapiro,et al.  Video Inpainting Under Constrained Camera Motion , 2007, IEEE Transactions on Image Processing.

[36]  Shuicheng Yan,et al.  Nonconvex Nonsmooth Low Rank Minimization via Iteratively Reweighted Nuclear Norm , 2015, IEEE Transactions on Image Processing.

[37]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[38]  Yicong Zhou,et al.  Tensor Nuclear Norm-Based Low-Rank Approximation With Total Variation Regularization , 2018, IEEE Journal of Selected Topics in Signal Processing.

[39]  HeQi,et al.  Computing Sparse Representation in a Highly Coherent Dictionary Based on Difference of L1 and L2 , 2015 .

[40]  Huan Liu,et al.  CubeSVD: a novel approach to personalized Web search , 2005, WWW '05.

[41]  R. Harshman,et al.  PARAFAC: parallel factor analysis , 1994 .

[42]  S. Osher,et al.  Nonlinear inverse scale space methods , 2006 .

[43]  Jifeng Ning,et al.  Hyperspectral Image Denoising via Combined Non-Local Self-Similarity and Local Low-Rank Regularization , 2020, IEEE Access.

[44]  Tingzhu Huang,et al.  A non-convex tensor rank approximation for tensor completion , 2017 .

[45]  Nadia Kreimer,et al.  A tensor higher-order singular value decomposition for prestack seismic data noise reduction and interpolation , 2012 .

[46]  Zhi-Quan Luo,et al.  Bilinear Factor Matrix Norm Minimization for Robust PCA: Algorithms and Applications , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[48]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[49]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .