MF-LRTC: Multi-filters guided low-rank tensor coding for image restoration

Abstract Image prior information is a determinative factor to tackling with the ill-posed problem. In this paper, we present multi-filters guided low-rank tensor coding (MF-LRTC) model for image restoration. The appeal of constructing a low-rank tensor is obvious in many cases for data that naturally comes from different scales and directions. The MF-LRTC takes advantages of the low-rank tensor coding to capture the sparse convolutional features generated by multi-filters representation. Using such a low-rank tensor coding would reduce the redundancy between feature vectors at neighboring locations and improve the efficiency of the overall sparse representation. In this work, we are committed to achieving this goal by convoluting the target image with Filed-of-Experts (FoE) filters to formulate multi-feature images. Then similarity-grouped cube set extracted from the multi-features images is regarded as a low-rank tensor. The resulting non-convex model is addressed by an efficient ADMM technique. The potential effectiveness of this tensor construction strategy is demonstrated in image restoration including image deblurring and compressed sensing (CS) applications.

[1]  Driss Aboutajdine,et al.  Robust Surface Reconstruction via Triple Sparsity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Di Guo,et al.  Hankel Matrix Nuclear Norm Regularized Tensor Completion for $N$-dimensional Exponential Signals , 2016, IEEE Transactions on Signal Processing.

[3]  Dong Liang,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction Using Two-Level Bregman Method With Dictionary Updating , 2013, IEEE Transactions on Medical Imaging.

[4]  Xiaochun Cao,et al.  Image Deblurring via Enhanced Low-Rank Prior , 2016, IEEE Transactions on Image Processing.

[5]  Zhi-Pei Liang,et al.  Accelerated High-Dimensional MR Imaging With Sparse Sampling Using Low-Rank Tensors , 2016, IEEE Transactions on Medical Imaging.

[6]  Armando Manduca,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction via Homotopic $\ell_{0}$ -Minimization , 2009, IEEE Transactions on Medical Imaging.

[7]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Guangming Shi,et al.  Low-Rank Tensor Approximation with Laplacian Scale Mixture Modeling for Multiframe Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[10]  David A. Clausi,et al.  Sparse Reconstruction of Breast MRI Using Homotopic $L_0$ Minimization in a Regional Sparsified Domain , 2013, IEEE Transactions on Biomedical Engineering.

[11]  Ke Lu,et al.  Fields of Experts Based Multichannel Compressed Sensing , 2017, J. Signal Process. Syst..

[12]  Shuicheng Yan,et al.  Nonconvex Nonsmooth Low Rank Minimization via Iteratively Reweighted Nuclear Norm , 2015, IEEE Transactions on Image Processing.

[13]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[14]  Stefan Roth,et al.  Shrinkage Fields for Effective Image Restoration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Edward H. Adelson,et al.  Learning Gaussian Conditional Random Fields for Low-Level Vision , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Russell Zaretzki,et al.  Beta Process Joint Dictionary Learning for Coupled Feature Spaces with Application to Single Image Super-Resolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[18]  Erik G. Larsson,et al.  The Higher-Order Singular Value Decomposition: Theory and an Application [Lecture Notes] , 2010, IEEE Signal Processing Magazine.

[19]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Dong Liang,et al.  MR Image Reconstruction with Convolutional Characteristic Constraint (CoCCo) , 2015, IEEE Signal Processing Letters.

[21]  Rick Chartrand,et al.  Fast algorithms for nonconvex compressive sensing: MRI reconstruction from very few data , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[22]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[23]  Bart Vandereycken,et al.  Low-rank tensor completion by Riemannian optimization , 2014 .

[24]  Lizhe Wang,et al.  Reference Information Based Remote Sensing Image Reconstruction with Generalized Nonconvex Low-Rank Approximation , 2016, Remote. Sens..

[25]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[26]  Jun Yu,et al.  Multi-view ensemble manifold regularization for 3D object recognition , 2015, Inf. Sci..

[27]  Hisashi Kashima,et al.  Tensor factorization using auxiliary information , 2011, Data Mining and Knowledge Discovery.

[28]  Nikolas P. Galatsanos,et al.  Variational Bayesian Image Restoration With a Product of Spatially Weighted Total Variation Image Priors , 2010, IEEE Transactions on Image Processing.

[29]  Shuicheng Yan,et al.  Smoothed Low Rank and Sparse Matrix Recovery by Iteratively Reweighted Least Squares Minimization , 2014, IEEE Transactions on Image Processing.

[30]  Meng Wang,et al.  Multimodal Deep Autoencoder for Human Pose Recovery , 2015, IEEE Transactions on Image Processing.

[31]  Javier Portilla,et al.  Image restoration through l0 analysis-based sparse optimization in tight frames , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[32]  Sebastian Nowozin,et al.  Discriminative Non-blind Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Stuart Crozier,et al.  Multidimensional Compressed Sensing MRI Using Tensor Decomposition-Based Sparsifying Transform , 2014, PloS one.

[35]  Meng Wang,et al.  Image-Based Three-Dimensional Human Pose Recovery by Multiview Locality-Sensitive Sparse Retrieval , 2015, IEEE Transactions on Industrial Electronics.

[36]  Dong Liang,et al.  Adaptive Dictionary Learning in Sparse Gradient Domain for Image Recovery , 2013, IEEE Transactions on Image Processing.

[37]  Di Guo,et al.  Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[38]  Guillermo Sapiro,et al.  Learning transformations for clustering and classification , 2013, J. Mach. Learn. Res..

[39]  Daniel Kressner,et al.  A literature survey of low‐rank tensor approximation techniques , 2013, 1302.7121.

[40]  Ivan W. Selesnick,et al.  Efficient and Robust Image Restoration Using Multiple-Feature L2-Relaxed Sparse Analysis Priors , 2015, IEEE Transactions on Image Processing.

[41]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[42]  D. Louis Collins,et al.  Non-local MRI upsampling , 2010, Medical Image Anal..

[43]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[44]  Xuanqin Mou,et al.  Tensor-based dictionary learning for dynamic tomographic reconstruction , 2015, Physics in medicine and biology.

[45]  Dong Liang,et al.  Augmented Lagrangian-Based Sparse Representation Method with Dictionary Updating for Image Deblurring , 2013, SIAM J. Imaging Sci..

[46]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[47]  Gang Liu,et al.  Tensor completion using total variation and low-rank matrix factorization , 2016, Inf. Sci..

[48]  Wenrui Hu,et al.  Nonlocal image denoising via adaptive tensor nuclear norm minimization , 2015, Neural Computing and Applications.

[49]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[51]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[52]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[53]  Shuyuan Yang,et al.  Dual-Geometric Neighbor Embedding for Image Super Resolution With Sparse Tensor , 2014, IEEE Transactions on Image Processing.

[54]  D. Louis Collins,et al.  New methods for MRI denoising based on sparseness and self-similarity , 2012, Medical Image Anal..

[55]  Anand Rangarajan,et al.  Image Denoising Using the Higher Order Singular Value Decomposition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.