Band Selection Using Improved Sparse Subspace Clustering for Hyperspectral Imagery Classification

An improved sparse subspace clustering (ISSC) method is proposed to select an appropriate band subset for hyperspectral imagery (HSI) classification. The ISSC assumes that band vectors are sampled from a union of low-dimensional orthogonal subspaces and each band can be sparsely represented as a linear or affine combination of other bands within its subspace. First, the ISSC represents band vectors with sparse coefficient vectors by solving the L2-norm optimization problem using the least square regression (LSR) algorithm. The sparse and block diagonal structure of the coefficient matrix from LSR leads to correct segmentation of band vectors. Second, the angular similarity measurement is presented and utilized to construct the similarity matrix. Third, the distribution compactness (DC) plot algorithm is used to estimate an appropriate size of the band subset. Finally, spectral clustering is implemented to segment the similarity matrix and the desired ISSC band subset is found. Four groups of experiments on three widely used HSI datasets are performed to test the performance of ISSC for selecting bands in classification. In addition, the following six state-of-the-art band selection methods are used to make comparisons: linear constrained minimum variance-based band correlation constraint (LCMV-BCC), affinity propagation (AP), spectral information divergence (SID), maximum-variance principal component analysis (MVPCA), sparse representation-based band selection (SpaBS), and sparse nonnegative matrix factorization (SNMF). Experimental results show that the ISSC has the second shortest computational time and also outperforms the other six methods in classification accuracy when using an appropriate band number obtained by the DC plot algorithm.

[1]  R. Patil,et al.  Edge based technique to estimate number of clusters in k-means color image segmentation , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[2]  Giles M. Foody,et al.  Feature Selection for Classification of Hyperspectral Data by SVM , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Bo Du,et al.  A Sparse Representation-Based Binary Hypothesis Model for Target Detection in Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Qian Du,et al.  Similarity-Based Unsupervised Band Selection for Hyperspectral Image Analysis , 2008, IEEE Geoscience and Remote Sensing Letters.

[5]  Cindy Ong,et al.  Using airborne hyperspectral data to characterize the surface pH and mineralogy of pyrite mine tailings , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[6]  René Vidal,et al.  Sparse subspace clustering , 2009, CVPR.

[7]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[8]  Antonio J. Plaza,et al.  Hyperspectral band selection using a collaborative sparse model , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[10]  Li Li,et al.  Support Vector Machines , 2015 .

[11]  Pai-Hui Hsu,et al.  Feature extraction of hyperspectral images using wavelet and matching pursuit , 2007 .

[12]  Christian Jutten,et al.  Fast Sparse Representation Based on Smoothed l0 Norm , 2007, ICA.

[13]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[14]  Trac D. Tran,et al.  Sparse Representation for Target Detection in Hyperspectral Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[15]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[16]  Claude Cariou,et al.  Assessing the performance of two unsupervised dimensionality reduction techniques on hyperspectral APEX data for high resolution urban land-cover mapping , 2014 .

[17]  D. Roberts,et al.  Urban tree species mapping using hyperspectral and lidar data fusion , 2014 .

[18]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[20]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[21]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[22]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale l1-Regularized Logistic Regression , 2007, J. Mach. Learn. Res..

[23]  Qian Du,et al.  Band selection and its impact on target detection and classification in hyperspectral image analysis , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[24]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[25]  William Bialek,et al.  How Many Clusters? An Information-Theoretic Perspective , 2003, Neural Computation.

[26]  Hairong Qi,et al.  Sparse representation based band selection for hyperspectral images , 2011, 2011 18th IEEE International Conference on Image Processing.

[27]  S. Kinast,et al.  Ground-level hyperspectral imagery for detecting weeds in wheat fields , 2013, Precision Agriculture.

[28]  Michael Elad,et al.  Efficient Implementation of the K-SVD Algorithm using Batch Orthogonal Matching Pursuit , 2008 .

[29]  Peter Fearns,et al.  Detecting trend and seasonal changes in bathymetry derived from HICO imagery: A case study of Shark Bay, Western Australia , 2014 .

[30]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[31]  P. Groves,et al.  Methodology For Hyperspectral Band Selection , 2004 .

[32]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[33]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[34]  S. Delwiche,et al.  Use of Airborne Hyperspectral Imagery to Map Soil Properties in Tilled Agricultural Fields , 2011 .

[35]  Sildomar T. Monteiro,et al.  Mapping the distribution of ferric iron minerals on a vertical mine face using derivative analysis of hyperspectral imagery (430-970 nm) , 2013 .

[36]  Constantine Kotropoulos,et al.  Speaker Diarization Exploiting the Eigengap Criterion and Cluster Ensembles , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[37]  Optimum Band Selection for Supervised Classification of Multispectral Data , 2007 .

[38]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[39]  Yun-tao Qian,et al.  Clustering-based hyperspectral band selection using sparse nonnegative matrix factorization , 2011, Journal of Zhejiang University SCIENCE C.

[40]  Christopher M. Gittins,et al.  Band selection in hyperspectral imagery using sparse support vector machines , 2014, Defense + Security Symposium.

[41]  LinLin Shen,et al.  Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Shuicheng Yan,et al.  Semi-supervised Learning by Sparse Representation , 2009, SDM.

[43]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Wenjun Zhou,et al.  Spectral clustering of high-dimensional data exploiting sparse representation vectors , 2014, Neurocomputing.

[45]  Shuicheng Yan,et al.  Efficient Subspace Segmentation via Quadratic Programming , 2011, AAAI.

[46]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Shuicheng Yan,et al.  Robust and Efficient Subspace Segmentation via Least Squares Regression , 2012, ECCV.

[48]  J. Caers,et al.  Stochastic Simulation of Patterns Using Distance-Based Pattern Modeling , 2010 .

[49]  Gang Hua,et al.  A nonnegative sparsity induced similarity measure with application to cluster analysis of spam images , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[50]  Wei Xia,et al.  Band Selection for Hyperspectral Imagery: A New Approach Based on Complex Networks , 2013, IEEE Geoscience and Remote Sensing Letters.

[51]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Luis O. Jimenez-Rodriguez,et al.  Unsupervised feature extraction and band subset selection techniques based on relative entropy criteria for hyperspectral data analysis , 2003, SPIE Defense + Commercial Sensing.

[53]  Zhen Ji,et al.  Band Selection for Hyperspectral Imagery Using Affinity Propagation , 2008, 2008 Digital Image Computing: Techniques and Applications.

[54]  J. Benedetto,et al.  Nonlinear Dimensionality Reduction via the ENH-LTSA Method for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  David W. Scott,et al.  The Curse of Dimensionality and Dimension Reduction , 2008 .

[56]  Bo Du,et al.  A Discriminative Metric Learning Based Anomaly Detection Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Gene H. Golub,et al.  Matrix computations , 1983 .