A tensor-based nonlocal total variation model for multi-channel image recovery

Abstract In this paper, a new nonlocal total variation (NLTV) regularizer is proposed for solving the inverse problems in multi-channel image processing. Different from the existing nonlocal total variation regularizers that rely on the graph gradient, the proposed nonlocal total variation involves the standard image gradient and simultaneously exploits three important properties inherent in multi-channel images through a tensor nuclear norm, hence we call this proposed functional as tensor-based nonlocal total variation (TenNLTV). In specific, these three properties are the local structural image regularity, the nonlocal image self-similarity, and the image channel correlation, respectively. By fully utilizing these three properties, TenNLTV can provide a more robust measure of image variation. Then, based on the proposed regularizer TenNLTV, a novel regularization model for inverse imaging problems is presented. Moreover, an effective algorithm is designed for the proposed model, and a closed-form solution is derived for a two-order complex eigen system in our algorithm. Extensive experimental results on several inverse imaging problems demonstrate that the proposed regularizer is systematically superior over other competing local and nonlocal regularization approaches, both quantitatively and visually.

[1]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[2]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[3]  Zemin Zhang,et al.  Exact Tensor Completion Using t-SVD , 2015, IEEE Transactions on Signal Processing.

[4]  E. Adalsteinsson,et al.  Vectorial total generalized variation for accelerated multi-channel multi-contrast MRI. , 2016, Magnetic resonance imaging.

[5]  Tieyong Zeng,et al.  Low Rank Prior and Total Variation Regularization for Image Deblurring , 2017, J. Sci. Comput..

[6]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[7]  Petros Maragos,et al.  Structure Tensor Total Variation , 2015, SIAM J. Imaging Sci..

[8]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[9]  Misha Elena Kilmer,et al.  Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging , 2013, SIAM J. Matrix Anal. Appl..

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[12]  Stanley Osher,et al.  Nonlocal Structure Tensor Functionals for Image Regularization , 2015, IEEE Transactions on Computational Imaging.

[13]  Jun Liu,et al.  A Block Nonlocal TV Method for Image Restoration , 2017, SIAM J. Imaging Sci..

[14]  Tieyong Zeng,et al.  Regularized Non-local Total Variation and Application in Image Restoration , 2017, Journal of Mathematical Imaging and Vision.

[15]  Michael Unser,et al.  Hessian Schatten-Norm Regularization for Linear Inverse Problems , 2012, IEEE Transactions on Image Processing.

[16]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[17]  Shiqian Ma,et al.  On the Global Linear Convergence of the ADMM with MultiBlock Variables , 2014, SIAM J. Optim..

[18]  Mathews Jacob,et al.  Generalized Higher Degree Total Variation (HDTV) Regularization , 2014, IEEE Transactions on Image Processing.

[19]  Eric L. Miller,et al.  Tensor-Based Formulation and Nuclear Norm Regularization for Multienergy Computed Tomography , 2013, IEEE Transactions on Image Processing.

[20]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[21]  M. Grasmair,et al.  Anisotropic Total Variation Filtering , 2010 .

[22]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  A. Ruszczynski,et al.  Nonlinear Optimization , 2006 .

[24]  Liangpei Zhang,et al.  Inpainting for Remotely Sensed Images With a Multichannel Nonlocal Total Variation Model , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[26]  Jie Li,et al.  Hyperspectral image recovery employing a multidimensional nonlocal total variation model , 2015, Signal Process..

[27]  Yehoshua Y. Zeevi,et al.  Variational denoising of partly textured images by spatially varying constraints , 2006, IEEE Transactions on Image Processing.

[28]  Markus Grasmair,et al.  Locally Adaptive Total Variation Regularization , 2009, SSVM.

[29]  Tieyong Zeng,et al.  Image Deblurring Via Total Variation Based Structured Sparse Model Selection , 2016, J. Sci. Comput..

[30]  Wensheng Zhang,et al.  The Twist Tensor Nuclear Norm for Video Completion , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[32]  Lei Zhang,et al.  Image Restoration: From Sparse and Low-Rank Priors to Deep Priors [Lecture Notes] , 2017, IEEE Signal Processing Magazine.

[33]  Wei Liu,et al.  Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[35]  Y Ichioka,et al.  Image restoration by Wiener filtering in the presence of signal-dependent noise. , 1977, Applied optics.

[36]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[37]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[38]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[39]  Jian Sun,et al.  Color Image Denoising via Discriminatively Learned Iterative Shrinkage , 2015, IEEE Transactions on Image Processing.

[40]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.