Multi-filters guided low-rank tensor coding for image inpainting

Image inpainting is a classical inverse ill-posed problem. In this paper, we introduce a multi-filters guided low-rank tensor coding as a priori information to tackle it. The key innovation is to formulate multiple feature-domain tensors by convoluting the target image with multi-filters. Furthermore, by exploring a low-rank tensor coding, it can reduce the redundancy between sparse feature vectors at neighboring locations and improve the efficiency of the overall representation. The resulting non-convex model is iteratively tackled by gradient descent and low-rank pursuit procedure. The experimental results demonstrate that the proposed algorithm can faithfully recover image and outperform the current state-of-the-art approach.

[1]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[2]  Simon Masnou,et al.  Disocclusion: a variational approach using level lines , 2002, IEEE Trans. Image Process..

[3]  Ce Zhu,et al.  Image Completion Using Low Tensor Tree Rank and Total Variation Minimization , 2019, IEEE Transactions on Multimedia.

[4]  Andrzej Cichocki,et al.  Robust Multilinear Tensor Rank Estimation Using Higher Order Singular Value Decomposition and Information Criteria , 2017, IEEE Transactions on Signal Processing.

[5]  Zhi-Pei Liang,et al.  Accelerated High-Dimensional MR Imaging With Sparse Sampling Using Low-Rank Tensors , 2016, IEEE Transactions on Medical Imaging.

[6]  Yann Strozecki,et al.  Patch reprojections for Non-Local methods , 2012, Signal Process..

[7]  Mohamed-Jalal Fadili,et al.  Inpainting and Zooming Using Sparse Representations , 2009, Comput. J..

[8]  Hussein M. Yahia,et al.  A Non-Local Low-Rank Approach to Enforce Integrability , 2016, IEEE Transactions on Image Processing.

[9]  Miki Haseyama,et al.  Missing Image Data Reconstruction Based on Adaptive Inverse Projection via Sparse Representation , 2011, IEEE Transactions on Multimedia.

[10]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[11]  Andrzej Cichocki,et al.  Smooth PARAFAC Decomposition for Tensor Completion , 2015, IEEE Transactions on Signal Processing.

[12]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[13]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[14]  Raymond H. Chan,et al.  Simultaneously inpainting in image and transformed domains , 2009, Numerische Mathematik.

[15]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2016, International Journal of Computer Vision.

[16]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[17]  Lixin Shen,et al.  Adaptive Inpainting Algorithm Based on DCT Induced Wavelet Regularization , 2013, IEEE Transactions on Image Processing.

[18]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[19]  Xia Wang,et al.  Non-Local Means Image Denoising With a Soft Threshold , 2015, IEEE Signal Processing Letters.

[20]  Hong-Yuan Mark Liao,et al.  Simultaneous Tensor Decomposition and Completion Using Factor Priors , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[22]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Zongben Xu,et al.  Image Inpainting by Patch Propagation Using Patch Sparsity , 2010, IEEE Transactions on Image Processing.

[24]  Andrzej Cichocki,et al.  Multilinear tensor rank estimation via Sparse Tucker Decomposition , 2014, 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS).

[25]  Shuyuan Yang,et al.  Dual-Geometric Neighbor Embedding for Image Super Resolution With Sparse Tensor , 2014, IEEE Transactions on Image Processing.

[26]  Anand Rangarajan,et al.  Image Denoising Using the Higher Order Singular Value Decomposition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[28]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  A. Iusem On the convergence properties of the projected gradient method for convex optimization , 2003 .

[30]  Stefan Roth,et al.  Shrinkage Fields for Effective Image Restoration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Onur G. Guleryuz,et al.  Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part I: theory , 2006, IEEE Transactions on Image Processing.

[32]  Dong Liang,et al.  MR Image Reconstruction with Convolutional Characteristic Constraint (CoCCo) , 2015, IEEE Signal Processing Letters.

[33]  Rick Chartrand,et al.  Fast algorithms for nonconvex compressive sensing: MRI reconstruction from very few data , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[34]  Nicu Sebe,et al.  Neighborhood issue in single-frame image super-resolution , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[35]  Ce Zhu,et al.  Tensor rank learning in CP decomposition via convolutional neural network , 2019, Signal Process. Image Commun..

[36]  Andrea L. Bertozzi,et al.  Inpainting of Binary Images Using the Cahn–Hilliard Equation , 2007, IEEE Transactions on Image Processing.

[37]  Armando Manduca,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction via Homotopic $\ell_{0}$ -Minimization , 2009, IEEE Transactions on Medical Imaging.

[38]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[39]  Andrea L. Bertozzi,et al.  A Wavelet-Laplace Variational Technique for Image Deconvolution and Inpainting , 2008, IEEE Transactions on Image Processing.

[40]  Dong Liang,et al.  Field-of-Experts Filters Guided Tensor Completion , 2018, IEEE Transactions on Multimedia.

[41]  Max A. Viergever,et al.  Adaptive Stochastic Gradient Descent Optimisation for Image Registration , 2009, International Journal of Computer Vision.

[42]  Charles-Alban Deledalle,et al.  Non-local Methods with Shape-Adaptive Patches (NLM-SAP) , 2012, Journal of Mathematical Imaging and Vision.

[43]  Guillermo Sapiro,et al.  A Comprehensive Framework for Image Inpainting , 2010, IEEE Transactions on Image Processing.

[44]  Driss Aboutajdine,et al.  Robust Surface Reconstruction via Triple Sparsity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Stuart Crozier,et al.  Multidimensional Compressed Sensing MRI Using Tensor Decomposition-Based Sparsifying Transform , 2014, PloS one.

[47]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[48]  Tony F. Chan,et al.  Total Variation Wavelet Inpainting , 2006, Journal of Mathematical Imaging and Vision.

[49]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Dong Liang,et al.  Adaptive Dictionary Learning in Sparse Gradient Domain for Image Recovery , 2013, IEEE Transactions on Image Processing.

[51]  Guillermo Sapiro,et al.  Learning transformations for clustering and classification , 2013, J. Mach. Learn. Res..

[52]  Joseph Salmon,et al.  On Two Parameters for Denoising With Non-Local Means , 2010, IEEE Signal Processing Letters.

[53]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[54]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .

[55]  Meng Wang,et al.  Image-Based Three-Dimensional Human Pose Recovery by Multiview Locality-Sensitive Sparse Retrieval , 2015, IEEE Transactions on Industrial Electronics.

[56]  Nikos Komodakis,et al.  Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning , 2007, IEEE Transactions on Image Processing.