Hyperspectral Imagery Restoration Using Nonlocal Spectral-Spatial Structured Sparse Representation With Noise Estimation

Noise reduction is an active research area in image processing due to its importance in improving the quality of image for object detection and classification. In this paper, we develop a sparse representation based noise reduction method for hyperspectral imagery, which is dependent on the assumption that the non-noise component in an observed signal can be sparsely decomposed over a redundant dictionary while the noise component does not have this property. The main contribution of the paper is in the introduction of nonlocal similarity and spectral-spatial structure of hyperspectral imagery into sparse representation. Non-locality means the self-similarity of image, by which a whole image can be partitioned into some groups containing similar patches. The similar patches in each group are sparsely represented with a shared subset of atoms in a dictionary making true signal and noise more easily separated. Sparse representation with spectral-spatial structure can exploit spectral and spatial joint correlations of hyperspectral imagery by using 3-D blocks instead of 2-D patches for sparse coding, which also makes true signal and noise more distinguished. Moreover, hyperspectral imagery has both signal-independent and signal-dependent noises, so a mixed Poisson and Gaussian noise model is used. In order to make sparse representation be insensitive to the various noise distribution in different blocks, a variance-stabilizing transformation (VST) is used to make their variance comparable. The advantages of the proposed methods are validated on both synthetic and real hyperspectral remote sensing data sets.

[1]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[2]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[3]  Minchao Ye,et al.  Mixed Poisson-Gaussian noise model based sparse denoising for hyperspectral imagery , 2012, 2012 4th Workshop on Hyperspectral Image and Signal Processing (WHISPERS).

[4]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[5]  Shuicheng Yan,et al.  Visual classification with multi-task joint sparse representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Julio Martín-Herrero,et al.  Anisotropic Diffusion in the Hypercube , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  David Mary,et al.  Sparsity-based denoising of hyperspectral astrophysical data with colored noise: Application to the MUSE instrument , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[8]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Marco Diani,et al.  Signal-Dependent Noise Modeling and Model Parameter Estimation in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Howland D. T. Jones,et al.  Weighting hyperspectral image data for improved multivariate curve resolution results , 2008 .

[11]  Michael Elad,et al.  Multi-Scale Dictionary Learning Using Wavelets , 2011, IEEE Journal of Selected Topics in Signal Processing.

[12]  Layne T. Watson,et al.  An Adaptive Noise-Filtering Algorithm for AVIRIS Data With Implications for Classification Accuracy , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Fionn Murtagh,et al.  Image restoration with noise suppression using a multiresolution support. , 1995 .

[14]  John F. Arnold,et al.  Reliably estimating the noise in AVIRIS hyperspectral images , 1996 .

[15]  Xi Chen,et al.  Accelerated Gradient Method for Multi-task Sparse Learning Problem , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[16]  Bo-Cai Gao,et al.  An operational method for estimating signal to noise ratios from data acquired with imaging spectrometers , 1993 .

[17]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[18]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Qi Wang,et al.  Noise reduction of hyperspectral imagery using nonlocal sparse representation with spectral-spatial structure , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[22]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[23]  E. LeDrew,et al.  Remote sensing of aquatic coastal ecosystem processes , 2006 .

[24]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[25]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[26]  Guangyi Chen,et al.  Denoising and dimensionality reduction of hyperspectral imagery using wavelet packets, neighbour shrinking and principal component analysis , 2009 .

[27]  Qian Du,et al.  A comparative study on noise estimation for hyperspectral imagery , 2012, 2012 4th Workshop on Hyperspectral Image and Signal Processing (WHISPERS).

[28]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[29]  Pierre Duhamel,et al.  Hyperspectral Image Compression: Adapting SPIHT and EZW to Anisotropic 3-D Wavelet Coding , 2008, IEEE Transactions on Image Processing.

[30]  A. Barducci,et al.  Noise modelling and estimation of hyperspectral data from airborne imaging spectrometers , 2006 .

[31]  R. Richter,et al.  Sensor: a tool for the simulation of hyperspectral remote sensing systems , 2001 .

[32]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[33]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[34]  Mark D. Plumbley,et al.  Fast Dictionary Learning for Sparse Representations of Speech Signals , 2011, IEEE Journal of Selected Topics in Signal Processing.

[35]  Trac D. Tran,et al.  Sparse Representation for Target Detection in Hyperspectral Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[36]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[37]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[38]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[39]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..

[40]  Guillermo Sapiro,et al.  Dictionary Learning for Noisy and Incomplete Hyperspectral Images , 2012, SIAM J. Imaging Sci..

[41]  Vladimir V. Lukin,et al.  Local Signal-Dependent Noise Variance Estimation From Hyperspectral Textural Images , 2011, IEEE Journal of Selected Topics in Signal Processing.

[42]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[43]  Jieping Ye,et al.  Multi-Task Feature Learning Via Efficient l2, 1-Norm Minimization , 2009, UAI.

[44]  D. H. Card,et al.  Thematic Mapper Image Quality: Registration, Noise, And Resolution , 1984, IEEE Transactions on Geoscience and Remote Sensing.

[45]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[46]  Qi Wang,et al.  3-D nonlocal means filter with noise estimation for hyperspectral imagery denoising , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[47]  Guillermo Sapiro,et al.  Learning Discriminative Sparse Representations for Modeling, Source Separation, and Mapping of Hyperspectral Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Peter Bühlmann.  Regression shrinkage and selection via the Lasso: a retrospective (Robert Tibshirani): Comments on the presentation , 2011 .

[49]  Mehran Yazdi,et al.  Noise Reduction of Hyperspectral Images Using Kernel Non-Negative Tucker Decomposition , 2011, IEEE Journal of Selected Topics in Signal Processing.

[50]  Jennifer L. Dungan,et al.  Estimation of signal-to-noise: a new procedure applied to AVIRIS data , 1989 .

[51]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[52]  LinLin Shen,et al.  Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Salah Bourennane,et al.  Denoising and Dimensionality Reduction Using Multilinear Tools for Hyperspectral Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[54]  Johannes R. Sveinsson,et al.  Hyperspectral image denoising using 3D wavelets , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[55]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.