Hyperspectral image restoration via CNN denoiser prior regularized low-rank tensor recovery

Abstract Hyperspectral images (HSIs) are widely used in various tasks such as mineral detection and food safety. However, during the imaging process, they are often contaminated by various noises. In this paper for HSIs restoration tasks, we firstly investigate the advantages of traditional physical restoration models and the denoising convolutional neural networks (CNN). For the physical prior of HSIs, a Tucker decomposition based low-rank tensor approximation can fully explore the global correlations in both the spatial and spectral domains. And for the implicit prior, a CNN based method can represent the prior which cannot be designed by mathematical theory tools. Then, we combine the advantages of the two methods to introduce the HSI restoration CNN with the low-rank tensor approximation based regularization in the flexible and extensible plug-and-play framework. The proposed model can be quickly solved using the alternating direction method of multipliers method. Experiments with simulated data and real data show that, compared with competitive methods, the proposed method achieves better HSI restoration results in various quantitative evaluation indicators.

[1]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Stanley H. Chan Performance Analysis of Plug-and-Play ADMM: A Graph Signal Processing Perspective , 2018, IEEE Transactions on Computational Imaging.

[4]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[5]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[6]  Liqing Zhang,et al.  Tensor Ring Decomposition , 2016, ArXiv.

[7]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[8]  Michael Elad,et al.  Postprocessing of Compressed Images via Sequential Denoising , 2015, IEEE Transactions on Image Processing.

[9]  E. M. Winter,et al.  Anomaly detection from hyperspectral imagery , 2002, IEEE Signal Process. Mag..

[10]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Lei Zhang,et al.  Image Restoration: From Sparse and Low-Rank Priors to Deep Priors [Lecture Notes] , 2017, IEEE Signal Processing Magazine.

[12]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[13]  Ming Yuan,et al.  On Tensor Completion via Nuclear Norm Minimization , 2014, Foundations of Computational Mathematics.

[14]  Brendt Wohlberg,et al.  Plug-and-Play priors for model based reconstruction , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[15]  Prateek Jain,et al.  Tensor vs. Matrix Methods: Robust Tensor Decomposition under Block Sparse Perturbations , 2015, AISTATS.

[16]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Jifeng Ning,et al.  Hyperspectral Image Denoising via Combined Non-Local Self-Similarity and Local Low-Rank Regularization , 2020, IEEE Access.

[18]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[19]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[20]  Petros Maragos,et al.  Structure Tensor Total Variation , 2015, SIAM J. Imaging Sci..

[21]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[22]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[23]  Hassan Mansour,et al.  A Plug-and-Play Priors Approach for Solving Nonlinear Imaging Inverse Problems , 2017, IEEE Signal Processing Letters.

[24]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[25]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[26]  José M. Bioucas-Dias,et al.  Image restoration and reconstruction using variable splitting and class-adapted image priors , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[27]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Andrzej Cichocki,et al.  Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements , 2015, IEEE Transactions on Image Processing.

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  Jiangjun Peng,et al.  Hyperspectral Image Restoration Via Total Variation Regularized Low-Rank Tensor Decomposition , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[34]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[35]  Raja Giryes,et al.  Image Restoration by Iterative Denoising and Backward Projections , 2017, IEEE Transactions on Image Processing.

[36]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[37]  Liangpei Zhang,et al.  Hyperspectral Image Denoising via Noise-Adjusted Iterative Low-Rank Matrix Approximation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Edoardo Pasolli,et al.  An Active Learning Framework for Hyperspectral Image Classification Using Hierarchical Segmentation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[40]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).