MIMN-DPP: Maximum-information and minimum-noise determinantal point processes for unsupervised hyperspectral band selection

Abstract Band selection plays an important role in hyperspectral imaging for reducing the data and improving the efficiency of data acquisition and analysis whilst significantly lowering the cost of the imaging system. Without the category labels, it is challenging to select an effective and low-redundancy band subset. In this paper, a new unsupervised band selection algorithm is proposed based on a new band search criterion and an improved Determinantal Point Processes (DPP). First, to preserve the original information of hyperspectral image, a novel band search criterion is designed for searching the bands with high information entropy and low noise. Unfortunately, finding the optimal solution based on the search criteria to select a low-redundancy band subset is a NP-hard problem. To solve this problem, we consider the correlation of bands from both original hyperspectral image and its spatial information to construct a double-graph model to describe the relationship between spectral bands. Besides, an improved DPP algorithm is proposed for the approximate search of a low-redundancy band subset from the double-graph model. Experiment results on several well-known datasets show that the proposed optical band selection algorithm achieves better performance than many other state-of-the-art methods.

[1]  Chao Li,et al.  Active multi-kernel domain adaptation for hyperspectral image classification , 2017, Pattern Recognit..

[2]  Chein-I Chang,et al.  Spectral Inter-Band Discrimination Capacity of Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Chun Chang,et al.  A new hyperspectral band selection and classification framework based on combining multiple classifiers , 2016, Pattern Recognit. Lett..

[4]  Ben Taskar,et al.  Determinantal Point Processes for Machine Learning , 2012, Found. Trends Mach. Learn..

[5]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[6]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  O. Macchi.  The coincidence approach to stochastic point processes , 1975, Advances in Applied Probability.

[8]  Hao Wu,et al.  Semi-supervised dimensionality reduction of hyperspectral imagery using pseudo-labels , 2018, Pattern Recognit..

[9]  Maoguo Gong,et al.  Unsupervised Hyperspectral Band Selection by Fuzzy Clustering With Particle Swarm Optimization , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Farid Melgani,et al.  Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Wei Liu,et al.  Multi-Modal Curriculum Learning for Semi-Supervised Image Classification , 2016, IEEE Transactions on Image Processing.

[12]  Chenhong Sui,et al.  Unsupervised Band Selection by Integrating the Overall Accuracy and Redundancy , 2015, IEEE Geoscience and Remote Sensing Letters.

[13]  Fang Liu,et al.  Mutual-Information-Based Semi-Supervised Hyperspectral Band Selection With High Discrimination, High Information, and Low Redundancy , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Xiaohui Wei,et al.  Scalable One-Pass Self-Representation Learning for Hyperspectral Band Selection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Junwei Han,et al.  Novel Folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing , 2014 .

[16]  Chao Li,et al.  Active Transfer Learning Network: A Unified Deep Joint Spectral–Spatial Feature Learning Model for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Licheng Jiao,et al.  Hyperspectral Band Selection Based on Trivariate Mutual Information and Clonal Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Feiping Nie,et al.  Adaptive-weighting discriminative regression for multi-view classification , 2019, Pattern Recognit..

[20]  Peng Qiu,et al.  Fast calculation of pairwise mutual information for gene regulatory network reconstruction , 2009, Comput. Methods Programs Biomed..

[21]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Arif Mahmood,et al.  Hyperspectral Face Recognition With Spatiospectral Information Fusion and PLS Regression , 2015, IEEE Transactions on Image Processing.

[23]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[24]  Stephen Marshall,et al.  Effective Feature Extraction and Data Reduction in Remote Sensing Using Hyperspectral Imaging [Applications Corner] , 2014, IEEE Signal Processing Magazine.

[25]  Yunsong Li,et al.  High-quality spectral-spatial reconstruction using saliency detection and deep feature enhancement , 2019, Pattern Recognit..

[26]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[27]  Filiberto Pla,et al.  Supervised feature selection by clustering using conditional mutual information-based distances , 2010, Pattern Recognit..

[28]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[29]  Shigeru Shinomoto,et al.  Kernel bandwidth optimization in spike rate estimation , 2009, Journal of Computational Neuroscience.

[30]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[31]  Maoguo Gong,et al.  Unsupervised Hyperspectral Image Band Selection via Column Subset Selection , 2015, IEEE Geoscience and Remote Sensing Letters.

[32]  LinLin Shen,et al.  Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Zhi Zhang,et al.  A generally applicable noise-estimating method for remote sensing images , 2014 .

[34]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[35]  James E. Fowler,et al.  Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Xiangtao Zheng,et al.  Discovering Diverse Subset for Unsupervised Hyperspectral Band Selection , 2017, IEEE Transactions on Image Processing.

[38]  Stephen Marshall,et al.  MIMR-DGSA: Unsupervised hyperspectral band selection based on information theory and a modified discrete gravitational search algorithm , 2019, Inf. Fusion.

[39]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[40]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[41]  Yongchao Zhao,et al.  A Fast Volume-Gradient-Based Band Selection Method for Hyperspectral Image , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Bo-Cai Gao,et al.  An operational method for estimating signal to noise ratios from data acquired with imaging spectrometers , 1993 .

[43]  Fang Liu,et al.  Unsupervised feature selection based on maximum information and minimum redundancy for hyperspectral images , 2016, Pattern Recognit..

[44]  Ben Taskar,et al.  k-DPPs: Fixed-Size Determinantal Point Processes , 2011, ICML.

[45]  Feifei Xu,et al.  Unsupervised Hyperspectral Band Selection by Dominant Set Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[46]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.