Training redefinition with entropy-based structure set density for supervised hyperspectral imagery classification

ABSTRACT Reliable labelled samples have always played a vital role in the supervised paradigm of hyperspectral imagery (HSI) classification due to the fact that the inclusion of incorrect label information in the training set can seriously degrade the performance of classification methods. Recently, although some inter-class difference-based detection algorithms have been developed to remove mislabelled samples (i.e. noisy labels) in training set, the benefit of contextual information for each sample has not been fully explored yet. In this paper, a training redefinition with entropy-based structure set density (ESSD) method is designed, which consists of following main steps. First, the proposed ESSD method employs an over-segmentation technique to cluster the HSI into many shape-adaptive regions that correspond to sample sets. Then, each sample set is represented with an affine hull (AH) model, which exploits both the similarity and variance of samples within each sample set to adaptively characterize the set. Specifically, considering spectral and spatial weak assumptions among samples in each sample set, the idea of entropy trick-based -nearest neighbour is introduced into each sample set to redefine its structure by removing different class from the sample set. Next, the distance among AH corresponding to each training sample is calculated based on the AH model. Meanwhile, the set-to-set distance is fed to the density peak algorithm to obtain the density of training samples. Finally, a decision-making value is applied to the density of each training sample to cleanse mislabelled samples within noisy training set. Experimental results on real HSI date sets demonstrate the superiority of the proposed method over several well-known training redefinition methods in terms of detection accuracy.

[1]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[2]  Yi Yu,et al.  Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[3]  Giles M. Foody,et al.  Feature Selection for Classification of Hyperspectral Data by SVM , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Aditya Singh,et al.  Leaf and Canopy Level Detection of Fusarium Virguliforme (Sudden Death Syndrome) in Soybean , 2018, Remote. Sens..

[5]  Ajmal S. Mian,et al.  Sparse approximated nearest points for image set classification , 2011, CVPR 2011.

[6]  Chengle Zhou,et al.  Hyperspectral Classification With Noisy Label Detection via Superpixel-to-Pixel Weighting Distance , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Peijun Du,et al.  Rotation-Based Support Vector Machine Ensemble in Classification of Hyperspectral Data With Limited Training Samples , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Yi Wang,et al.  Classification of Hyperspectral Images by SVM Using a Composite Kernel by Employing Spectral, Spatial and Hierarchical Structure Information , 2018, Remote. Sens..

[9]  Rui Xue,et al.  Information-Assisted Density Peak Index for Hyperspectral Band Selection , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Gabor Kereszturi,et al.  Integrating Airborne Hyperspectral, Topographic, and Soil Data for Estimating Pasture Quality Using Recursive Feature Elimination with Random Forest Regression , 2018, Remote. Sens..

[11]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[12]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Chengle Zhou,et al.  Hyperspectral Anomaly Detection Using Dual Window Density , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Nikos Koutsias,et al.  SVM-Based Fuzzy Decision Trees for Classification of High Spatial Resolution Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Saurabh Prasad,et al.  Dirichlet Process Based Active Learning and Discovery of Unknown Classes for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Hector Erives,et al.  Automated registration of hyperspectral images for precision agriculture , 2005 .

[17]  Shutao Li,et al.  Detection and Correction of Mislabeled Training Samples for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  Spatial Density Peak Clustering for Hyperspectral Image Classification With Noisy Labels , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Junjun Jiang,et al.  Multiscale Union Regions Adaptive Sparse Representation for Hyperspectral Image Classification , 2017, Remote. Sens..

[22]  Wei He,et al.  Kernel Entropy Component Analysis-Based Robust Hyperspectral Image Supervised Classification , 2019, Remote. Sens..

[23]  Xianming Liu,et al.  Hyperspectral Image Classification in the Presence of Noisy Labels , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Philippa J. Mason,et al.  Hyperspectral remote sensing for mineral exploration in Pulang, Yunnan Province, China , 2011 .

[25]  Xiaofei Zhang,et al.  Density Peak-Based Noisy Label Detection for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Chengle Zhou,et al.  Spectral–Spatial Hyperspectral Classification via Structural-Kernel Collaborative Representation , 2021, IEEE Geoscience and Remote Sensing Letters.

[27]  Jon Atli Benediktsson,et al.  Random-Walker-Based Collaborative Learning for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Bing Tu,et al.  Hyperspectral Imagery Noisy Label Detection by Spectral Angle Local Outlier Factor , 2018, IEEE Geoscience and Remote Sensing Letters.

[29]  Qian Du,et al.  Structure-Aware Collaborative Representation for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Chun-Chieh Yang,et al.  Application of decision tree technology for image classification using remote sensing data , 2003 .

[31]  Jun Li,et al.  Feature-Driven Active Learning for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[33]  Junbin Gao,et al.  Laplacian Regularized Spatial-Aware Collaborative Graph for Discriminant Analysis of Hyperspectral Imagery , 2018, Remote. Sens..

[34]  Jun Li,et al.  Active Learning With Convolutional Neural Networks for Hyperspectral Image Classification Using a New Bayesian Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Bing Tu,et al.  Hierarchical Structure-Based Noisy Labels Detection for Hyperspectral Image Classification , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Lin Li,et al.  Spectral-spatial hyperspectral image ensemble classification via joint sparse representation , 2016, Pattern Recognit..

[37]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Jonathan Li,et al.  Bayesian Classification of Hyperspectral Imagery Based on Probabilistic Sparse Representation and Markov Random Field , 2014, IEEE Geoscience and Remote Sensing Letters.

[39]  Lorenzo Bruzzone,et al.  Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances , 2016, IEEE Geoscience and Remote Sensing Magazine.

[40]  Yu-Lin He,et al.  Non-Naive Bayesian Classifiers for Classification Problems With Continuous Attributes , 2014, IEEE Transactions on Cybernetics.

[41]  Jon Atli Benediktsson,et al.  Set-to-Set Distance-Based Spectral–Spatial Classification of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Ilkay Ulusoy,et al.  Hyperspectral Image Classification via Basic Thresholding Classifier , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Aleksandra Pizurica,et al.  A Robust Dynamic Classifier Selection Approach for Hyperspectral Images with Imprecise Label Information , 2020, Sensors.

[44]  Shutao Li,et al.  Super-resolution of hyperspectral image via superpixel-based sparse representation , 2018, Neurocomputing.

[45]  Shaoguang Zhou,et al.  Active Learning Improved by Neighborhoods and Superpixels for Hyperspectral Image Classification , 2018, IEEE Geoscience and Remote Sensing Letters.

[46]  Rama Chellappa,et al.  Entropy-Rate Clustering: Cluster Analysis via Maximizing a Submodular Function Subject to a Matroid Constraint , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[48]  Kang Sun,et al.  Exemplar Component Analysis: A Fast Band Selection Method for Hyperspectral Imagery , 2015, IEEE Geoscience and Remote Sensing Letters.

[49]  Junjun Jiang,et al.  Label Noise Cleansing with Sparse Graph for Hyperspectral Image Classification , 2019, Remote. Sens..

[50]  Shutao Li,et al.  Multiscale Superpixel-Based Sparse Representation for Hyperspectral Image Classification , 2017, Remote. Sens..

[51]  Ping Zhong,et al.  An MRF Model-Based Active Learning Framework for the Spectral-Spatial Classification of Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Signal Processing.

[52]  Nan Li,et al.  Optimization Performance Comparison of Three Different Group Intelligence Algorithms on a SVM for Hyperspectral Imagery Classification , 2019, Remote. Sens..

[53]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[55]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation , 2016, IEEE Transactions on Image Processing.

[56]  P. W. Scott,et al.  Evaluation of hyperspectral remote sensing as a means of environmental monitoring in the St. Austell China clay (kaolin) region, Cornwall, UK , 2004 .

[57]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Jiann-Der Lee,et al.  Halftone Image Classification Using LMS Algorithm and Naive Bayes , 2011, IEEE Transactions on Image Processing.

[59]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Richard Gloaguen,et al.  Drone-Borne Hyperspectral Monitoring of Acid Mine Drainage: An Example from the Sokolov Lignite District , 2018, Remote. Sens..

[61]  Qi Wang,et al.  Hyperspectral Image Classification via Multitask Joint Sparse Representation and Stepwise MRF Optimization , 2016, IEEE Transactions on Cybernetics.

[62]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..