Simultaneous Spatial and Spectral Low-Rank Representation of Hyperspectral Images for Classification

Arising from various environmental and atmos- pheric conditions and sensor interference, spectral variations are inevitable during hyperspectral remote sensing, which degrade the subsequent hyperspectral image analysis significantly. In this paper, we propose simultaneous spatial and spectral low-rank representation (S3LRR) that can effectively suppress the within-class spectral variations for classification purposes. The S3LRR recovers an intrinsic component with the same dimension as the original image, in which both spatial and spectral low-rank priors are adopted to regularize the intrinsic component simultaneously and compensate to each other, together with robust modeling of spectral variations. Compared with existing methods that explore only the spectral low-rank prior, the novel spatial low-rank prior (i.e., low-rank prior in band-wise) can take the spatial structure information of hyperspectral images into account, which has demonstrated to be very useful. Technically, we formulate S3LRR as a constrained convex optimization problem, and solve it using the efficient inexact augmented Lagrangian multiplier method. The resulting intrinsic component is less interfered by within-class spectral variations, and more discriminatory to offer higher classification accuracy. Comprehensive experiments on benchmark data sets demonstrate that the proposed S3LRR improves classification accuracy significantly, which outperforms state-of-the-art methods.

[1]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[2]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Yulong Wang,et al.  Graph-Regularized Low-Rank Representation for Destriping of Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Lap-Pui Chau,et al.  Robust laplacian matrix learning for smooth graph signals , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Houqiang Li,et al.  Denoising of Hyperspectral Images Employing Two-Phase Matrix Decomposition , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Guangyi Chen,et al.  Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Steve McLaughlin,et al.  Development of EMD-Based Denoising Methods Inspired by Wavelet Thresholding , 2009, IEEE Transactions on Signal Processing.

[9]  Qian Du,et al.  Low-Rank Subspace Representation for Supervised and Unsupervised Classification of Hyperspectral Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[11]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Nadia Magnenat-Thalmann,et al.  A Highly Efficient Compression Framework for Time-Varying 3-D Facial Expressions , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  K. C. Ho,et al.  Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing , 2014, IEEE Signal Processing Magazine.

[14]  Jing-Hao Xue,et al.  Denoising of Hyperspectral Images Using Group Low-Rank Representation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Seong G. Kong,et al.  Coupled Sparse Denoising and Unmixing With Low-Rank Constraint for Hyperspectral Image , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[18]  Dacheng Tao,et al.  GoDec: Randomized Lowrank & Sparse Matrix Decomposition in Noisy Case , 2011, ICML.

[19]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[20]  Liangpei Zhang,et al.  Hyperspectral Image Denoising via Noise-Adjusted Iterative Low-Rank Matrix Approximation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Hongyu Zhao,et al.  Low-Rank Modeling and Its Applications in Image Analysis , 2014, ACM Comput. Surv..

[22]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[23]  Bo Du,et al.  Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding , 2015, Pattern Recognit..

[24]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Minchao Ye,et al.  Hyperspectral Imagery Restoration Using Nonlocal Spectral-Spatial Structured Sparse Representation With Noise Estimation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jing-Hao Xue,et al.  Spectral Nonlocal Restoration of Hyperspectral Images With Low-Rank Property , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[29]  David A. Clausi,et al.  Intrinsic Representation of Hyperspectral Imagery for Unsupervised Feature Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Antonio J. Plaza,et al.  Probabilistic-Kernel Collaborative Representation for Spatial–Spectral Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Qian Du,et al.  Spectral Variation Alleviation by Low-Rank Matrix Approximation for Hyperspectral Image Analysis , 2016, IEEE Geoscience and Remote Sensing Letters.

[32]  Qian Du,et al.  A survey on representation-based classification and detection in hyperspectral remote sensing imagery , 2016, Pattern Recognit. Lett..

[33]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[35]  Jun Zhou,et al.  Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[37]  Jun Li,et al.  Simultaneous Sparse Graph Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Qian Du,et al.  Hyperspectral Image Classification by Exploring Low-Rank Property in Spectral or/and Spatial Domain , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[40]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[41]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[42]  Jon Atli Benediktsson,et al.  Intrinsic Image Decomposition for Feature Extraction of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[44]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Nadia Magnenat-Thalmann,et al.  Sparse Low-Rank Matrix Approximation for Data Compression , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[46]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[47]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[49]  Hongdong Li,et al.  A Simple Prior-Free Method for Non-rigid Structure-from-Motion Factorization , 2012, International Journal of Computer Vision.

[50]  Liangpei Zhang,et al.  Hyperspectral Image Denoising With a Spatial–Spectral View Fusion Strategy , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Antonio J. Plaza,et al.  Multiple Morphological Component Analysis Based Decomposition for Remote Sensing Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Shuicheng Yan,et al.  Practical low-rank matrix approximation under robust L1-norm , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.