Superpixel-Based Active Learning and Online Feature Importance Learning for Hyperspectral Image Analysis

The rapid development of multichannel optical imaging sensors has led to increased utilization of hyperspectral data for remote sensing. For classification of hyperspectral data, an informative training set is necessary for ensuring robust performance. However, in remote sensing and other image analysis applications, labeled samples are often difficult, expensive, and time-consuming to obtain. This makes active learning (AL) an important part of an image analysis framework-AL aims to efficiently build a representative and efficient library of training samples that are most informative for the underlying classification task. This paper proposes an AL framework that leverages from superpixels. A spatial-spectral AL method is proposed that integrates spatial and spectral features extracted from superpixels in an AL framework. The experiments with an urban land cover classification and a wetland vegetation mapping task show that the proposed method has faster convergence and superior performance as compared to state of the art approaches. Additionally, our proposed framework has a key additional benefit in that it is able to identify and quantify feature importance - the resulting insights can be highly valuable to various remote sensing image analysis tasks.

[1]  Edoardo Pasolli,et al.  A Framework for Land Cover Classification Using Discrete Return LiDAR Data: Adopting Pseudo-Waveform and Hierarchical Segmentation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Melba M. Crawford,et al.  Wavelet domain multi-view active learning for hyperspectral image analysis , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[3]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[5]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[8]  Zhou Zhang,et al.  An ensemble active learning approach for spectral-spatial classification of hyperspectral images , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[9]  Claudio Persello,et al.  Interactive Domain Adaptation for the Classification of Remote Sensing Images Using Active Learning , 2013, IEEE Geoscience and Remote Sensing Letters.

[10]  Lianru Gao,et al.  Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[11]  Antonio J. Plaza,et al.  A Subspace-Based Multinomial Logistic Regression for Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[12]  Melba M. Crawford,et al.  Wavelet-Domain Multiview Active Learning for Spatial-Spectral Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[14]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[16]  Rama Chellappa,et al.  Entropy-Rate Clustering: Cluster Analysis via Maximizing a Submodular Function Subject to a Matroid Constraint , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Lawrence O. Hall,et al.  Active learning to recognize multiple types of plankton , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[19]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[20]  Melba M. Crawford,et al.  Active Learning: Any Value for Classification of Remotely Sensed Data? , 2013, Proceedings of the IEEE.

[21]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Saurabh Prasad,et al.  Decision Fusion With Confidence-Based Weight Assignment for Hyperspectral Target Recognition , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  A. Kai Qin,et al.  Collaborative Active and Semisupervised Learning for Hyperspectral Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Bernhard Schölkopf,et al.  Cost-Sensitive Active Learning With Lookahead: Optimizing Field Surveys for Remote Sensing Data Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  André Stumpf,et al.  Active Learning in the Spatial Domain for Remote Sensing Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Melba M. Crawford,et al.  View Generation for Multiview Maximum Disagreement Based Active Learning for Hyperspectral Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[30]  Alexander Y. Liu,et al.  Active Learning with Spatially Sensitive Labeling Costs , 2008 .

[31]  Johannes R. Sveinsson,et al.  Hybrid consensus theoretic classification , 1996, IGARSS '96. 1996 International Geoscience and Remote Sensing Symposium.

[32]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[33]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[34]  Hao Wu,et al.  Superpixels for Spatially Reinforced Bayesian Classification of Hyperspectral Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[35]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Peng Gong,et al.  Dimension Reduction of Hyperspectral Images for Classification Applications , 2002, Ann. GIS.

[37]  Lorenzo Bruzzone,et al.  Definition of Effective Training Sets for Supervised Classification of Remote Sensing Images by a Novel Cost-Sensitive Active Learning Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[40]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[41]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .