Low-rank tensor completion via smooth matrix factorization

Abstract Low-rank modeling has achieved great success in tensor completion. However, the low-rank prior is not sufficient for the recovery of the underlying tensor, especially when the sampling rate (SR) is extremely low. Fortunately, many real world data exhibit the piecewise smoothness prior along both the spatial and the third modes (e.g., the temporal mode in video data and the spectral mode in hyperspectral data). Motivated by this observation, we propose a novel low-rank tensor completion model using smooth matrix factorization (SMF-LRTC), which exploits the piecewise smoothness prior along all modes of the underlying tensor by introducing smoothness constraints on the factor matrices. An efficient block successive upper-bound minimization (BSUM)-based algorithm is developed to solve the proposed model. The developed algorithm converges to the set of the coordinate-wise minimizers under some mild conditions. Extensive experimental results demonstrate the superiority of the proposed method over the compared ones.

[1]  Hidekata Hontani,et al.  Simultaneous Visual Data Completion and Denoising Based on Tensor Rank and Total Variation Minimization and Its Primal-Dual Splitting Algorithm , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[3]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .

[4]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[5]  Ting-Zhu Huang,et al.  Hyperspectral image restoration using framelet-regularized low-rank nonnegative matrix factorization , 2018, Applied Mathematical Modelling.

[6]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Michael K. Ng,et al.  A New Convex Optimization Model for Multiplicative Noise and Blur Removal , 2014, SIAM J. Imaging Sci..

[9]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[10]  Zuowei Shen,et al.  Deconvolution: a wavelet frame approach , 2007, Numerische Mathematik.

[11]  A. Ron,et al.  Affine Systems inL2(Rd): The Analysis of the Analysis Operator , 1997 .

[12]  Pan Zhou,et al.  Tensor Factorization for Low-Rank Tensor Completion , 2018, IEEE Transactions on Image Processing.

[13]  Yiqiu Dong,et al.  Cauchy Noise Removal by Nonconvex ADMM with Convergence Guarantees , 2017, Journal of Scientific Computing.

[14]  Liangpei Zhang,et al.  Total Variation Regularized Reweighted Sparse Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Vishal M. Patel,et al.  Convolutional Sparse and Low-Rank Coding-Based Rain Streak Removal , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[16]  Sheng Zhong,et al.  Hyperspectral image denoising via spectral and spatial low-rank approximation , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[17]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[18]  Wotao Yin,et al.  Parallel matrix factorization for low-rank tensor completion , 2013, ArXiv.

[19]  Marko Filipovic,et al.  Tucker factorization with missing data with application to low-$$n$$n-rank tensor completion , 2015, Multidimens. Syst. Signal Process..

[20]  Michael K. Ng,et al.  Coupled segmentation and denoising/deblurring models for hyperspectral material identification , 2012, Numer. Linear Algebra Appl..

[21]  Christopher Rasmussen,et al.  Spatiotemporal Inpainting for Recovering Texture Maps of Occluded Building Facades , 2007, IEEE Transactions on Image Processing.

[22]  Tingzhu Huang,et al.  A non-convex tensor rank approximation for tensor completion , 2017 .

[23]  Guixu Zhang,et al.  Framelet-Based Sparse Unmixing of Hyperspectral Images , 2016, IEEE Transactions on Image Processing.

[24]  Jian-Feng Cai,et al.  A framelet-based image inpainting algorithm , 2008 .

[25]  Ting-Zhu Huang,et al.  FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors , 2018, IEEE Transactions on Image Processing.

[26]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[27]  Hidekata Hontani,et al.  Missing Slice Recovery for Tensors Using a Low-Rank Model in Embedded Space , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  José M. Bioucas-Dias,et al.  Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Zuowei Shen Affine systems in L 2 ( IR d ) : the analysis of the analysis operator , 1995 .

[30]  Christopher J. Hillar,et al.  Most Tensor Problems Are NP-Hard , 2009, JACM.

[31]  Yunming Ye,et al.  Low-Rank Tensor Completion with Total Variation for Visual Data Inpainting , 2017, AAAI.

[32]  Bin Ran,et al.  Tensor completion via a multi-linear low-n-rank factorization model , 2014, Neurocomputing.

[33]  Zhi-Quan Luo,et al.  A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization , 2012, SIAM J. Optim..

[34]  Xiaodong Wang,et al.  Low-Tubal-Rank Tensor Completion Using Alternating Minimization , 2016, IEEE Transactions on Information Theory.

[35]  M. Sabarimalai Manikandan,et al.  Adaptive MRI image denoising using total-variation and local noise estimation , 2012, IEEE-International Conference On Advances In Engineering, Science And Management (ICAESM -2012).

[36]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[37]  Michael K. Ng,et al.  Deblurring and Sparse Unmixing for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[39]  José M. Bioucas-Dias,et al.  Semiblind Hyperspectral Unmixing in the Presence of Spectral Library Mismatches , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Ting-Zhu Huang,et al.  Truncated l1-2 Models for Sparse Recovery and Rank Minimization , 2017, SIAM J. Imaging Sci..

[41]  Andrzej Cichocki,et al.  Robust Multilinear Tensor Rank Estimation Using Higher Order Singular Value Decomposition and Information Criteria , 2017, IEEE Transactions on Signal Processing.

[42]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[43]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[44]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[45]  Andrzej Cichocki,et al.  Smooth PARAFAC Decomposition for Tensor Completion , 2015, IEEE Transactions on Signal Processing.

[46]  Ting-Zhu Huang,et al.  Total variation with overlapping group sparsity for deblurring images under Cauchy noise , 2019, Appl. Math. Comput..

[47]  Ting-Zhu Huang,et al.  Total variation and high-order total variation adaptive model for restoring blurred images with Cauchy noise , 2019, Comput. Math. Appl..

[48]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[49]  Ting-Zhu Huang,et al.  Matrix factorization for low-rank tensor completion using framelet prior , 2018, Inf. Sci..

[50]  Yi Ma,et al.  Generalized Tensor Total Variation minimization for visual data recovery? , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.