A Low-Rank Tensor Dictionary Learning Method for Hyperspectral Image Denoising

As a 3-order tensor, a hyperspectral image (HSI) has dozens of spectral bands, which can deliver more information of real scenes. However, real HSIs are often corrupted by noises in the sensing process, which deteriorates the performance of higher-level detection tasks. In this paper, we propose a Low-rank Tensor Dictionary Learning (LTDL) method for HSI denoising. Differing to existing low-rank based methods, we consider a nearly low-rank approximation, which is closer to the latent low-rank structure of the clean groups of real HSIs. Furthermore, the proposed method benefits from multitask learning gain by learning a spatial dictionary and a spectral dictionary shared among different tensor groups. While most existing work usually consider sparse representations, we exploit a simultaneously sparse and low-rank tensor representation model to enhance the capability of dictionary learning, which is inspired from the observation of the low rank structure in HSI tensor groups. Experiments on synthetic data validate the effectiveness of dictionary learning by the LTDL. Experiments on real HSIs demonstrate the superior denoising performance of the proposed method both visually and quantitatively as compared with state-of-the-art methods along this line of research.

[1]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[2]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jiangjun Peng,et al.  Hyperspectral Image Restoration Via Total Variation Regularized Low-Rank Tensor Decomposition , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Xiaowei Yang,et al.  Color Image and Multispectral Image Denoising Using Block Diagonal Representation , 2019, IEEE Transactions on Image Processing.

[5]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[6]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[7]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[8]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[9]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[11]  Zemin Zhang,et al.  Denoising and Completion of 3D Data via Multidimensional Dictionary Learning , 2015, IJCAI.

[12]  Sheng Zhong,et al.  HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Gangyao Kuang,et al.  Hyperspectral Image Restoration Using Low-Rank Tensor Recovery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Misha Elena Kilmer,et al.  A tensor-based dictionary learning approach to tomographic image reconstruction , 2015, BIT Numerical Mathematics.

[16]  Xiaoyan Sun,et al.  Multi-Dimensional Sparse Models , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[18]  Lei Zhang,et al.  Multispectral Images Denoising by Intrinsic Tensor Sparsity Regularization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Andrzej Cichocki,et al.  Robust Multilinear Tensor Rank Estimation Using Higher Order Singular Value Decomposition and Information Criteria , 2017, IEEE Transactions on Signal Processing.

[20]  Qiang Zhang,et al.  Hyperspectral Image Denoising Employing a Spatial–Spectral Deep Residual Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Luciano Alparone,et al.  Information-theoretic assessment of sampled hyperspectral imagers , 2001, IEEE Trans. Geosci. Remote. Sens..

[23]  Qi Xie,et al.  Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Boaz Arad,et al.  Sparse Recovery of Hyperspectral Signal from Natural RGB Images , 2016, ECCV.

[25]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[26]  Hongtao Lu,et al.  Efficient Multi-Dimensional Tensor Sparse Coding Using t-Linear Combination , 2018, AAAI.

[27]  Dong Wang,et al.  Denoising of Hyperspectral Images Using Nonconvex Low Rank Matrix Approximation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Yi Shen,et al.  Structure tensor total variation-regularized weighted nuclear norm minimization for hyperspectral image mixed denoising , 2017, Signal Process..

[30]  Sheng Zhong,et al.  Hyper-Laplacian Regularized Unidirectional Low-Rank Tensor Recovery for Multispectral Image Denoising , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[32]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Jun Zhou,et al.  Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Syed Zubair,et al.  Tensor dictionary learning with sparse TUCKER decomposition , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[35]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[36]  Yicong Zhou,et al.  Tensor Nuclear Norm-Based Low-Rank Approximation With Total Variation Regularization , 2018, IEEE Journal of Selected Topics in Signal Processing.

[37]  Xiaoyan Sun,et al.  TenSR: Multi-dimensional Tensor Sparse Representation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Caroline Fossati,et al.  Denoising of Hyperspectral Images Using the PARAFAC Model and Statistical Performance Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[40]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[42]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[43]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[44]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[45]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[46]  Alexander F. H. Goetz,et al.  Determination of semi-arid landscape endmembers and seasonal trends using convex geometry spectral unmixing techniques , 1993 .

[47]  Yen-Wei Chen,et al.  K-CPD: Learning of overcomplete dictionaries for tensor sparse coding , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[48]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[49]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.