Low-Rank Tensor Completion and Total Variation Minimization for Color Image Inpainting

Low-rank (LR) and total variation (TV) are two most frequent priors that occur in image processing problems, and they have sparked a tremendous amount of researches, particularly for moving from scalar to vector, matrix or even high-order based functions. However, discretization schemes used for TV regularization often ignore the difference of the intrinsic properties, so it will lead to the problem that local smoothness cannot be effectively generated, let alone the problem of blurred edges. To address the image inpainting problem with corrupted data, in this paper, the color images are naturally considered as three-dimensional tensors, whose prior of smoothness can be measured by varietal TV norm along different dimensions. Specifically, we propose incorporating Shannon total variation (STV) and low-rank tensor completion (LRTC) into the construction of the final cost function, in which a new nonconvex low-rank constraint, namely truncated $\gamma $ -norm, is involved for closer rank approximation. Moreover, two methods are developed, i.e., LRRSTV and LRRSTV-T, due to the fact that LRTC can be represented by tensor unfolding and tensor decomposition. The final solution can be achieved by a practical variant of the augmented Lagrangian alternating direction method (ALADM). Experiments on color image inpainting tasks demonstrate that the proposed methods perform better then the state-of-the-art algorithms, both qualitatively and quantitatively.

[1]  Dong Wang,et al.  Denoising of Hyperspectral Images Using Nonconvex Low Rank Matrix Approximation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Thomas S. Huang,et al.  Free-Form Image Inpainting With Gated Convolution , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Hengyong Yu,et al.  Improved Material Decomposition With a Two-Step Regularization for Spectral CT , 2019, IEEE Access.

[4]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bart Vandereycken,et al.  Low-rank tensor completion by Riemannian optimization , 2014 .

[6]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[7]  Yunchao Wei,et al.  Low-Rank Tensor Completion With a New Tensor Nuclear Norm Induced by Invertible Linear Transforms , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yuanyuan Liu,et al.  Scalable Algorithms for Tractable Schatten Quasi-Norm Minimization , 2016, AAAI.

[9]  Ivan Markovsky Applications of structured low-rank approximation , 2009 .

[10]  Hidekata Hontani,et al.  Simultaneous Visual Data Completion and Denoising Based on Tensor Rank and Total Variation Minimization and Its Primal-Dual Splitting Algorithm , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Lionel Moisan,et al.  The Shannon Total Variation , 2017, Journal of Mathematical Imaging and Vision.

[12]  Andrzej Cichocki,et al.  Smooth PARAFAC Decomposition for Tensor Completion , 2015, IEEE Transactions on Signal Processing.

[13]  P. Jidesh,et al.  Estimation of Noise Using Non-local Regularization Frameworks for Image Denoising and Analysis , 2018, Arabian Journal for Science and Engineering.

[14]  Qian Wang,et al.  Low-dose spectral CT reconstruction using image gradient ℓ 0-norm and tensor dictionary. , 2018, Applied mathematical modelling.

[15]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Nikos Komodakis,et al.  Image Completion Using Global Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[19]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[20]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[21]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[22]  Luoyu Zhou,et al.  Fraction-order total variation blind image restoration based on L1-norm , 2017 .

[23]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[24]  Yunming Ye,et al.  Low-Rank Tensor Completion with Total Variation for Visual Data Inpainting , 2017, AAAI.

[25]  Y. Zhang,et al.  Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization , 2014, Optim. Methods Softw..

[26]  David Zhang,et al.  Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoising , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Minh N. Do,et al.  Semantic Image Inpainting with Deep Generative Models , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Jian Yang,et al.  LRR for Subspace Segmentation via Tractable Schatten- $p$ Norm Minimization and Factorization , 2019, IEEE Transactions on Cybernetics.

[29]  Stéphane Gaïffas,et al.  Weighted algorithms for compressed sensing and matrix completion , 2011, ArXiv.

[30]  Chuan Wang,et al.  Video Inpainting by Jointly Learning Temporal Structure and Spatial Details , 2018, AAAI.

[31]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[32]  Bo Wen,et al.  A proximal difference-of-convex algorithm with extrapolation , 2016, Computational Optimization and Applications.

[33]  A. A. Bini,et al.  Image restoration via DOST and total variation regularisation , 2019, IET Image Process..

[34]  Shiguang Shan,et al.  Shift-Net: Image Inpainting via Deep Feature Rearrangement , 2018, ECCV.

[35]  Jonathan D. Hauenstein,et al.  Homotopy techniques for tensor decomposition and perfect identifiability , 2014, Journal für die reine und angewandte Mathematik (Crelles Journal).