Spatial Prior Fuzziness Pool-Based Interactive Classification of Hyperspectral Images

Acquisition of labeled data for supervised Hyperspectral Image (HSI) classification is expensive in terms of both time and costs. Moreover, manual selection and labeling are often subjective and tend to induce redundancy into the classifier. Active learning (AL) can be a suitable approach for HSI classification as it integrates data acquisition to the classifier design by ranking the unlabeled data to provide advice for the next query that has the highest training utility. However, multiclass AL techniques tend to include redundant samples into the classifier to some extent. This paper addresses such a problem by introducing an AL pipeline which preserves the most representative and spatially heterogeneous samples. The adopted strategy for sample selection utilizes fuzziness to assess the mapping between actual output and the approximated a-posteriori probabilities, computed by a marginal probability distribution based on discriminative random fields. The samples selected in each iteration are then provided to the spectral angle mapper-based objective function to reduce the inter-class redundancy. Experiments on five HSI benchmark datasets confirmed that the proposed Fuzziness and Spectral Angle Mapper (FSAM)-AL pipeline presents competitive results compared to the state-of-the-art sample selection techniques, leading to lower computational requirements.

[1]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Jayadeva,et al.  Feature Selection for classification of hyperspectral data by minimizing a tight bound on the VC dimension , 2015, ArXiv.

[3]  P. M. van Dijk,et al.  Spectral characterization of ophiolite lithologies in the Troodos Ophiolite complex of Cyprus and its potential in prospecting for massive sulphide deposits , 1997 .

[4]  Jun Li,et al.  Feature-Driven Active Learning for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[6]  Yi Yang,et al.  Early Active Learning with Pairwise Constraint for Person Re-identification , 2017, ECML/PKDD.

[7]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Bo Du,et al.  Spatial Coherence-Based Batch-Mode Active Learning for Remote Sensing Image Classification , 2015, IEEE Transactions on Image Processing.

[9]  Alessandro Rizzi,et al.  Review of Geometric and Radiometric Analyses of Paintings , 2011 .

[10]  Liping Yang,et al.  Visually-Enabled Active Deep Learning for (Geo) Text and Image Classification: A Review , 2018, ISPRS Int. J. Geo Inf..

[11]  Lawrence Carin,et al.  Semi-Supervised Classification , 2004, Encyclopedia of Database Systems.

[12]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[13]  Bo Du,et al.  Recent advances in hyperspectral image processing , 2012, Geo spatial Inf. Sci..

[14]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[15]  Tao Xiang,et al.  Active Learning using Dirichlet Processes for Rare Class Discovery and Classification , 2011, BMVC.

[16]  Xia Xu,et al.  Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Gustavo Camps-Valls,et al.  Semisupervised Classification of Remote Sensing Images With Active Queries , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[18]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[19]  Daniel Sánchez,et al.  Measures of Fuzziness under Different Uses of Fuzzy Sets , 2012, IPMU.

[20]  Lorenzo Bruzzone,et al.  Active and Semisupervised Learning for the Classification of Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Settimo Termini,et al.  A Definition of a Nonprobabilistic Entropy in the Setting of Fuzzy Sets Theory , 1972, Inf. Control..

[22]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Qian Du,et al.  A Novel Tri-Training Technique for the Semi-Supervised Classification of Hyperspectral Images Based on Regularized Local Discriminant Embedding Feature Extraction , 2019, Remote. Sens..

[24]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Julien Michel,et al.  Lazy yet efficient land-cover map generation for HR optical images , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[26]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[27]  Adil Mehmood Khan,et al.  Multi-layer Extreme Learning Machine-based Autoencoder for Hyperspectral Image Classification , 2019, VISIGRAPP.

[28]  Jun Li,et al.  3D-Gabor Inspired Multiview Active Learning for Spectral-Spatial Hyperspectral Image Classification , 2018, Remote. Sens..

[29]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Melba M. Crawford,et al.  Active Learning via Multi-View and Local Proximity Co-Regularization for Hyperspectral Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[31]  Hairong Qi,et al.  Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Xia Xu,et al.  R-VCANet: A New Deep-Learning-Based Hyperspectral Image Classification Method , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[34]  Feiping Nie,et al.  Early Active Learning via Robust Representation and Structured Sparsity , 2013, IJCAI.

[35]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[36]  Changyin Sun,et al.  Active Learning From Imbalanced Data: A Solution of Online Weighted Extreme Learning Machine , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[38]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[39]  Wajahat Ali Khan,et al.  Fuzziness-based active learning framework to enhance hyperspectral image classification performance for discriminative and generative classifiers , 2018, PloS one.

[40]  Du Pei HYPERSPECTRAL REMOTE SENSING IMAGE CLASSIFICATION BASED ON SUPPORT VECTOR MACHINE , 2008 .

[41]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[42]  Chelsea Finn,et al.  Active One-shot Learning , 2017, ArXiv.

[43]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Kun Tan,et al.  HYPERSPECTRAL REMOTE SENSING IMAGE CLASSIFICATION BASED ON SUPPORT VECTOR MACHINE: HYPERSPECTRAL REMOTE SENSING IMAGE CLASSIFICATION BASED ON SUPPORT VECTOR MACHINE , 2008 .

[45]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[46]  Changyin Sun,et al.  AL-ELM: One uncertainty-based active learning algorithm using extreme learning machine , 2015, Neurocomputing.

[47]  P. R. Meneses,et al.  Spectral Correlation Mapper ( SCM ) : An Improvement on the Spectral Angle Mapper ( SAM ) , 2000 .

[48]  Jon Atli Benediktsson,et al.  Semisupervised Self-Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Goo Jun,et al.  Active learning of hyperspectral data with spatially dependent label acquisition costs , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[50]  Jiming Li,et al.  Active learning for hyperspectral image classification with a stacked autoencoders based neural network , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[51]  Rui Zhang,et al.  Semi-Supervised Hyperspectral Image Classification Using Spatio-Spectral Laplacian Support Vector Machine , 2014, IEEE Geoscience and Remote Sensing Letters.

[52]  Adil Mehmood Khan,et al.  Segmented and non-segmented stacked denoising autoencoder for hyperspectral band reduction , 2019, Optik.

[53]  Peijun Du,et al.  Hyperspectral Remote Sensing Image Classification Based on Rotation Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[54]  Lorenzo Bruzzone,et al.  A Spectral-Spatial Multicriteria Active Learning Technique for Hyperspectral Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Evaluation of EO-1 Hyperion Data for Crop Studies in Part of Indo-Gangatic Plains: A Case Study of Meerut District , 2015 .

[56]  Hualong Yu,et al.  Imbalanced Extreme Learning Machine Based on Probability Density Estimation , 2015, MIWAI.

[57]  Zhi-Hua Zhou,et al.  Tri-training: exploiting unlabeled data using three classifiers , 2005, IEEE Transactions on Knowledge and Data Engineering.

[58]  William J. Emery,et al.  Improving active learning methods using spatial information , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[59]  Adil Mehmood Khan,et al.  Graph-based spatial-spectral feature learning for hyperspectral image classification , 2017, IET Image Process..

[60]  Edwin Lughofer,et al.  Single-pass active learning with conflict and ignorance , 2012, Evolving Systems.

[61]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[62]  George C. Runger,et al.  Active Batch Learning with Stochastic Query-by-Forest (SQBF) , 2011 .

[63]  Lawrence O. Hall,et al.  Active learning to recognize multiple types of plankton , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[64]  Ali Kashif Bashir,et al.  Metric similarity regularizer to enhance pixel similarity performance for hyperspectral unmixing , 2017 .