Multiple-Feature Kernel-Based Probabilistic Clustering for Unsupervised Band Selection

This paper presents a new method to perform unsupervised band selection (UBS) with hyperspectral data. The method provides a probabilistic clustering approach. The band images are clustered in the image space by computing their posterior class probability. Then, for each cluster, the band exhibiting the highest probability of belonging to it is selected as cluster exemplar. More particularly, the proposed method falls into information-maximization clustering methods, where the posterior class probability is modeled and the parameters of the models are derived by maximizing the information between the data and the unknown cluster labels. In this context, we propose a new image representation for hyperspectral images, based on the first- and second-order statistics of multiple image features. We refer to this representation as multiple-feature local statistical descriptors (MLSD). The descriptors are computed with respect to regular grids, and a special pixel selection procedure reduces the number of samples within each block of the grid. A kernel-based model that embeds the MLSD is then proposed for the posterior class probability. The model is finally optimized according to an information-maximization criterion. We conduct several experiments to determine the best parameters for the proposed approach and compare the latter with other state-of-the-art UBS methods. Quantitative evaluations show that, by employing our band selection method, higher performance in terms of classification accuracy and endmember extraction can be achieved in comparison with the state of the art.

[1]  Anoop Cherian,et al.  Positive Definite Matrices : Data Representation and Applications to Computer Vision , 2015 .

[2]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[3]  Masashi Sugiyama,et al.  On Information-Maximization Clustering: Tuning Parameter Selection and Analytic Solution , 2011, ICML.

[4]  Maoguo Gong,et al.  Unsupervised Hyperspectral Band Selection by Fuzzy Clustering With Particle Swarm Optimization , 2017, IEEE Geoscience and Remote Sensing Letters.

[5]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[7]  Philip S. Yu,et al.  Fast algorithms for projected clustering , 1999, SIGMOD '99.

[8]  Qi Wang,et al.  Dual-Clustering-Based Hyperspectral Band Selection by Contextual Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Andreas Krause,et al.  Discriminative Clustering by Regularized Information Maximization , 2010, NIPS.

[10]  Kenneth W. Bauer,et al.  Hyperspectral anomaly detection using enhanced global factors , 2016, SPIE Defense + Security.

[11]  Yannick Berthoumieu,et al.  Unsupervised hyperspectral band selection via multi-feature information-maximization clustering , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[12]  M. Ahmad,et al.  A New Statistical Approach for Band Clustering and Band Selection Using K-Means Clustering , 2022 .

[13]  M. Samiuddin,et al.  On nonparametric kernel density estimates , 1990 .

[14]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[15]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jon Atli Benediktsson,et al.  Multiple Spectral–Spatial Classification Approach for Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[18]  Licheng Jiao,et al.  Supervised Band Selection Using Local Spatial Information for Hyperspectral Image , 2016, IEEE Geoscience and Remote Sensing Letters.

[19]  Vasilis Valdramidis,et al.  Recent applications of hyperspectral imaging in microbiology. , 2015, Talanta.

[20]  Volker Roth,et al.  Nonlinear Discriminant Analysis Using Kernel Functions , 1999, NIPS.

[21]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[22]  M. Eismann Hyperspectral Remote Sensing , 2012 .

[23]  Ashish Ghosh,et al.  Combination of Clustering and Ranking Techniques for Unsupervised Band Selection of Hyperspectral Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[25]  Zhen Ji,et al.  Band Selection for Hyperspectral Imagery Using Affinity Propagation , 2008, 2008 Digital Image Computing: Techniques and Applications.

[26]  Xiangtao Zheng,et al.  Discovering Diverse Subset for Unsupervised Hyperspectral Band Selection , 2017, IEEE Transactions on Image Processing.

[27]  S. Chatterjee,et al.  Regression Analysis by Example , 1979 .

[28]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[29]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[30]  Russell M. Mersereau,et al.  On the impact of PCA dimension reduction for hyperspectral detection of difficult targets , 2005, IEEE Geoscience and Remote Sensing Letters.

[31]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[32]  David Barber,et al.  Kernelized Infomax Clustering , 2005, NIPS.

[33]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[34]  Fatih Murat Porikli,et al.  Fast Construction of Covariance Matrices for Arbitrary Size Image Windows , 2006, 2006 International Conference on Image Processing.

[35]  Feifei Xu,et al.  Unsupervised Hyperspectral Band Selection by Dominant Set Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[36]  David Malah,et al.  Rank Estimation and Redundancy Reduction of High-Dimensional Noisy Signals With Preservation of Rare Vectors , 2007, IEEE Transactions on Signal Processing.

[37]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[38]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[39]  Kang Sun,et al.  Exemplar Component Analysis: A Fast Band Selection Method for Hyperspectral Imagery , 2015, IEEE Geoscience and Remote Sensing Letters.

[40]  LinLin Shen,et al.  Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Edward J. Milton,et al.  Supervised band selection for optimal use of data from airborne hyperspectral sensors , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[43]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Fabio Maselli,et al.  Selection of optimum bands from TM scenes through mutual information analysis , 1993 .

[45]  Melba M. Crawford,et al.  Manifold-Learning-Based Feature Extraction for Classification of Hyperspectral Data: A Review of Advances in Manifold Learning , 2014, IEEE Signal Processing Magazine.

[46]  Aleksandra Pizurica,et al.  Semisupervised Local Discriminant Analysis for Feature Extraction in Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[48]  Gang Niu,et al.  Information-Maximization Clustering Based on Squared-Loss Mutual Information , 2014, Neural Computation.

[49]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[50]  Hongdong Li,et al.  Kernel Methods on Riemannian Manifolds with Gaussian RBF Kernels , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.