Unsupervised Manifold-Preserving and Weakly Redundant Band Selection Method for Hyperspectral Imagery

Hyperspectral band selection is of great value to alleviate the curse of dimensionality. For many band selection methods, however, the neglect of bandwise usefulness tends to result in the loss of valuable bands, but the retention of useless ones; consequently, this causes deterioration of the classification performance. In this sense, bandwise significance should be emphasized. To address this issue, this article proposes a manifold-preserving and weakly redundant (MPWR) unsupervised band selection method. In the method, a manifold-preserving band-importance metric is put forward to measure the bandwise essentiality. This ensures the retention of bands involving abundant intrinsic structures conductive to classification. Specifically, aimed at obtaining the presented band-importance metric, an attainment algorithm is presented, which mainly relies on the embedding learning and linear regression, followed by the introduction of multi-normalization combination. In addition, concerning the massive redundancy caused by the highly correlated bands, MPWR further establishes a constrained band-weight optimization model. Then, both bandwise manifold-preserving capability and intraband correlation are fully integrated into the band selection process. To solve the problem, a corresponding algorithm within the framework of the alternating direction method of multipliers (ADMM) is also developed. Regarding evaluating the effectiveness of the proposed method, comparative experiments with the state-of-the-art methods are conducted on three public hyperspectral data sets. Experimental results demonstrate the superiority and robustness of MPWR.

[1]  Weiwei Sun,et al.  A Band-Weighted Support Vector Machine Method for Hyperspectral Imagery Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[2]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jun Zhou,et al.  A hypergraph based semi-supervised band selection method for hyperspectral image classification , 2013, 2013 IEEE International Conference on Image Processing.

[4]  James E. Fowler,et al.  Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Weiwei Sun,et al.  A Dissimilarity-Weighted Sparse Self-Representation Method for Band Selection in Hyperspectral Imagery Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Shiming Xiang,et al.  Classification oriented semi-supervised band selection for hyperspectral images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Jacob Benesty,et al.  On the Importance of the Pearson Correlation Coefficient in Noise Reduction , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Kang Sun,et al.  A New Sparsity-Based Band Selection Method for Target Detection of Hyperspectral Image , 2015, IEEE Geoscience and Remote Sensing Letters.

[10]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Peg Shippert Why Use Hyperspectral Imagery , 2004 .

[12]  Feiping Nie,et al.  The Constrained Laplacian Rank Algorithm for Graph-Based Clustering , 2016, AAAI.

[13]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[14]  Qian Du,et al.  Kernel Collaborative Representation With Local Correlation Features for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[17]  Nanning Zheng,et al.  Correntropy Maximization via ADMM: Application to Robust Hyperspectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[19]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[20]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jocelyn Chanussot,et al.  Multiple Kernel Learning for Hyperspectral Image Classification: A Review , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Antonio J. Plaza,et al.  A Discontinuity Preserving Relaxation Scheme for Spectral–Spatial Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Qian Du,et al.  Tensor Low-Rank Discriminant Embedding for Hyperspectral Image Dimensionality Reduction , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[24]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[25]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[26]  Bernhard Schölkopf,et al.  Transductive Classification via Local Learning Regularization , 2007, AISTATS.

[27]  Renlong Hang,et al.  Dimensionality Reduction of Hyperspectral Image Using Spatial Regularized Local Graph Discriminant Embedding , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jun Li,et al.  Spatial Discontinuity-Weighted Sparse Unmixing of Hyperspectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[31]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[32]  Farid Melgani,et al.  Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Yongchao Zhao,et al.  A Fast Volume-Gradient-Based Band Selection Method for Hyperspectral Image , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[36]  Ronald Rousseau,et al.  Requirements for a cocitation similarity measure, with special reference to Pearson's correlation coefficient , 2003, J. Assoc. Inf. Sci. Technol..

[37]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Xiangtao Zheng,et al.  Discovering Diverse Subset for Unsupervised Hyperspectral Band Selection , 2017, IEEE Transactions on Image Processing.

[39]  Qian Du,et al.  Semisupervised Band Clustering for Dimensionality Reduction of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[40]  Chenhong Sui,et al.  Unsupervised Band Selection by Integrating the Overall Accuracy and Redundancy , 2015, IEEE Geoscience and Remote Sensing Letters.

[41]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[42]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[44]  Jun Zhou,et al.  Semisupervised Hyperspectral Band Selection Via Spectral–Spatial Hypergraph Model , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[46]  Feifei Xu,et al.  Unsupervised Hyperspectral Band Selection by Dominant Set Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Yan Guo,et al.  Local-Manifold-Learning-Based Graph Construction for Semisupervised Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[48]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[49]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[50]  Jon Y. Hardeberg,et al.  A Constrained Band Selection Method Based on Information Measures for Spectral Image Color Visualization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Yun-tao Qian,et al.  Clustering-based hyperspectral band selection using sparse nonnegative matrix factorization , 2011, Journal of Zhejiang University SCIENCE C.

[52]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[53]  Hairong Qi,et al.  Sparse representation based band selection for hyperspectral images , 2011, 2011 18th IEEE International Conference on Image Processing.

[54]  Jun Li,et al.  Simultaneous Sparse Graph Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[56]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[57]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.