Adaptive total variation and second-order total variation-based model for low-rank tensor completion

Recently, low-rank regularization has achieved great success in tensor completion. However, only considering the global low-rankness is not sufficient, especially for a low sampling rate (SR). Total variation (TV) is introduced into low-rank tensor completion (LRTC) problem to promote the local smoothness by incorporating the first-order derivatives information. However, TV usually leads to undesirable staircase effects. To alleviate these staircase effects, we suggest a first- and second-order TV-based parallel matrix factorization model for LRTC problem, which integrates the local smoothness and global low-rankness by simultaneously exploiting the first- and second-order derivatives information. To solve the proposed model, an efficient proximal alternating optimization (PAO)-based algorithm is developed with theoretical guarantee. Moreover, we suggest a regularization parameter selection strategy to automatically update two regularization parameters, which is able to take advantage of the best properties of each of the two regularization terms. Extensive experiments on different tensor data show the superiority of the proposed method over other methods, particularly for extremely low SRs.

[1]  Xi-Le Zhao,et al.  Low-rank tensor train for tensor robust principal component analysis , 2020, Appl. Math. Comput..

[2]  Deyu Meng,et al.  Hyperspectral Image Restoration under Complex Multi-Band Noises , 2018, Remote. Sens..

[3]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ting-Zhu Huang,et al.  FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors , 2018, IEEE Transactions on Image Processing.

[5]  Chaomin Shen,et al.  Image restoration combining a total variational filter and a fourth-order filter , 2007, J. Vis. Commun. Image Represent..

[6]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Xiongjun Zhang,et al.  A Nonconvex Relaxation Approach to Low-Rank Tensor Completion , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.

[10]  Yin Zhang,et al.  An alternating direction algorithm for matrix completion with nonnegative factors , 2011, Frontiers of Mathematics in China.

[11]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[12]  Kai Li,et al.  Restoration of remote sensing images based on nonconvex constrained high-order total variation regularization , 2019, Journal of Applied Remote Sensing.

[13]  Alfred O. Hero,et al.  3D image reconstruction for a Compton SPECT camera model , 1999 .

[14]  Ting-Zhu Huang,et al.  Remote sensing images destriping using unidirectional hybrid total variation and nonconvex low-rank regularization , 2020, J. Comput. Appl. Math..

[15]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[16]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[17]  Ting-Zhu Huang,et al.  Low-rank tensor completion via combined non-local self-similarity and low-rank regularization , 2019, Neurocomputing.

[18]  M. Sabarimalai Manikandan,et al.  Adaptive MRI image denoising using total-variation and local noise estimation , 2012, IEEE-International Conference On Advances In Engineering, Science And Management (ICAESM -2012).

[19]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[20]  Jie Huang,et al.  Speckle noise removal in ultrasound images by first- and second-order total variation , 2018, Numerical Algorithms.

[21]  Ting-Zhu Huang,et al.  Total variation and high-order total variation adaptive model for restoring blurred images with Cauchy noise , 2019, Comput. Math. Appl..

[22]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[23]  Chuan Chen,et al.  Total variation based tensor decomposition for multi‐dimensional data with time dimension , 2015, Numer. Linear Algebra Appl..

[24]  Michael K. Ng,et al.  Coupled segmentation and denoising/deblurring models for hyperspectral material identification , 2012, Numer. Linear Algebra Appl..

[25]  Raveendran Paramesran,et al.  Image denoising using combined higher order non-convex total variation with overlapping group sparsity , 2019, Multidimens. Syst. Signal Process..

[26]  Jie Huang,et al.  Hyperspectral Image Denoising Via Convex Low-Fibered-Rank Regularization , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Xi-Le Zhao,et al.  Total Variation Structured Total Least Squares Method for Image Restoration , 2013, SIAM J. Sci. Comput..

[28]  Ting-Zhu Huang,et al.  Low-rank tensor completion via smooth matrix factorization , 2019, Applied Mathematical Modelling.

[29]  Xi-Le Zhao,et al.  Mixed Noise Removal in Hyperspectral Image via Low-Fibered-Rank Regularization , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..

[31]  Christopher J. Hillar,et al.  Most Tensor Problems Are NP-Hard , 2009, JACM.

[32]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[33]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .

[34]  Yunming Ye,et al.  Low-Rank Tensor Completion with Total Variation for Visual Data Inpainting , 2017, AAAI.

[35]  Hédy Attouch,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality , 2008, Math. Oper. Res..

[36]  Bin Ran,et al.  Tensor completion via a multi-linear low-n-rank factorization model , 2014, Neurocomputing.

[37]  Wotao Yin,et al.  Parallel matrix factorization for low-rank tensor completion , 2013, ArXiv.

[38]  Jian-Feng Cai,et al.  A framelet-based image inpainting algorithm , 2008 .

[39]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[40]  Ting-Zhu Huang,et al.  Matrix factorization for low-rank tensor completion using framelet prior , 2018, Inf. Sci..

[41]  Michael K. Ng,et al.  Deblurring and Sparse Unmixing for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[42]  BolteJérôme,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems , 2010 .

[43]  Xuelong Li,et al.  A Unified Tensor Level Set for Image Segmentation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[44]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[45]  Shutao Li,et al.  Fusing Hyperspectral and Multispectral Images via Coupled Sparse Tensor Factorization , 2018, IEEE Transactions on Image Processing.

[46]  Mathews Jacob,et al.  Higher Degree Total Variation (HDTV) Regularization for Image Recovery , 2012, IEEE Transactions on Image Processing.

[47]  Xue-Cheng Tai,et al.  Iterative Image Restoration Combining Total Variation Minimization and a Second-Order Functional , 2005, International Journal of Computer Vision.