Training sample refining method using an adaptive neighbor to improve the classification performance of very high-spatial resolution remote sensing images

Abstract. A training sample refining method is proposed to improve the classification performance of very high-spatial resolution (VHR) remote sensing images. The proposed approach involves three major steps. First, for a given image, an initial sample set with a limited number for each class is prepared manually. Second, neighboring pixels around each available labeled pixel are gradually distinguished by an adaptive extension algorithm. When an iterative extension around the available pixel is terminated, the neighboring pixels that are within the extended region are taken into account as candidate training samples. The candidate training sample is then used to refine the signature of each initial sample. Third, when the whole available labeled pixels are scanned and processed pixel-by-pixel in the above manner, the revised training sample set is trained specially for a supervised classifier for classification. Three VHR remote sensing images with limited initial samples are used for evaluating different classifiers and advanced methods based on spatial–spectral features to investigate the feasibility and performance of the proposed approach. Higher classification performance and accuracies are obtained by our proposed approach with respect to the classification maps based on the initial training sample set and an existing method that improves the initial training set by a regular window.

[1]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[2]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[3]  Tülay Adali,et al.  Classification of hyperspectral data with ensemble of subspace ICA and edge-preserving filtering , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Jianhua Gong,et al.  UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis , 2015, Remote. Sens..

[5]  Mathieu Fauvel,et al.  Large-Scale Feature Selection With Gaussian Mixture Models for the Classification of High Dimensional Remote Sensing Images , 2017, IEEE Transactions on Computational Imaging.

[6]  Hannes Taubenböck,et al.  Unsupervised change detection in VHR remote sensing imagery - an object-based clustering approach in a dynamic urban environment , 2017, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Maryam Imani,et al.  Band Clustering-Based Feature Extraction for Classification of Hyperspectral Images Using Limited Training Samples , 2014, IEEE Geoscience and Remote Sensing Letters.

[8]  Driss Aboutajdine,et al.  Textural feature selection by joint mutual information based on Gaussian mixture model for multispectral image classification , 2010, Pattern Recognit. Lett..

[9]  Pedram Ghamisi,et al.  Spectral–Spatial Classification of Hyperspectral Images Based on Hidden Markov Random Fields , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Shutao Li,et al.  The Effect of Ground Truth on Performance Evaluation of Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Junjie Wu,et al.  An Optimal 2-D Spectrum Matching Method for SAR Ground Moving Target Imaging , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Changzhe Jiao,et al.  Discriminative Multiple Instance Hyperspectral Target Characterization , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  David J. Fleet,et al.  Computer Vision – ECCV 2014 , 2014, Lecture Notes in Computer Science.

[15]  Cheng Shi,et al.  Adaptive multi-scale deep neural networks with perceptual loss for panchromatic and multispectral images classification , 2019, Inf. Sci..

[16]  Shutao Li,et al.  Detection and Correction of Mislabeled Training Samples for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Jon Atli Benediktsson,et al.  Automatic Framework for Spectral–Spatial Classification Based on Supervised Feature Extraction and Morphological Attribute Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Bing Zhang,et al.  A Review of Remote Sensing Image Classification Techniques: the Role of Spatio-contextual Information , 2014 .

[19]  Jon Atli Benediktsson,et al.  A Survey on Spectral–Spatial Classification Techniques Based on Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jon Atli Benediktsson,et al.  A modified mean filter for improving the classification performance of very high-resolution remote-sensing imagery , 2018 .

[21]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jon Atli Benediktsson,et al.  Morphological Profiles Based on Differently Shaped Structuring Elements for Classification of Images With Very High Spatial Resolution , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Xin Huang,et al.  Unsupervised Deep Feature Learning for Urban Village Detection from High-Resolution Remote Sensing Images , 2017 .

[24]  Jie Wang,et al.  Comparison of Classification Algorithms and Training Sample Sizes in Urban Land Classification with Landsat Thematic Mapper Imagery , 2014, Remote. Sens..

[25]  Giles M. Foody,et al.  The use of small training sets containing mixed pixels for accurate hard image classification: Training on mixed spectral responses for classification by a SVM , 2006 .

[26]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[27]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[28]  David A. Landgrebe,et al.  The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon , 1994, IEEE Trans. Geosci. Remote. Sens..

[29]  Tülay Adali,et al.  Spectral–Spatial Classification of Hyperspectral Images Using ICA and Edge-Preserving Filter via an Ensemble Strategy , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jon Atli Benediktsson,et al.  Novel Object-Based Filter for Improving Land-Cover Classification of Aerial Imagery with Very High Spatial Resolution , 2016, Remote. Sens..

[32]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Liangpei Zhang,et al.  Semantic Classification of Urban Trees Using Very High Resolution Satellite Imagery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Jun Guo,et al.  Cascaded classification of high resolution remote sensing images using multiple contexts , 2013, Inf. Sci..

[35]  Jonathan P. Dash,et al.  Assessing very high resolution UAV imagery for monitoring forest health during a simulated disease outbreak , 2017 .

[36]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[37]  Liviu Theodor Ene,et al.  Tree crown delineation and tree species classification in boreal forests using hyperspectral and ALS data , 2014 .

[38]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Hassan Ghassemian,et al.  An Adaptive Pixon Extraction Technique for Multispectral/Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[40]  Jon Atli Benediktsson,et al.  Land-Cover Mapping by Markov Modeling of Spatial–Contextual Information in Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[41]  Jiamin Liu,et al.  Semisupervised Sparse Manifold Discriminative Analysis for Feature Extraction of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Liangpei Zhang,et al.  A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[43]  John A. Richards,et al.  Using Suitable Neighbors to Augment the Training Set in Hyperspectral Maximum Likelihood Classification , 2008, IEEE Geoscience and Remote Sensing Letters.

[44]  Antonio J. Plaza,et al.  New Postprocessing Methods for Remote Sensing Image Classification: A Systematic Study , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Zhiyong Lv,et al.  Object-Based Spatial Feature for Classification of Very High Resolution Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[46]  Li Li,et al.  A dual-kernel spectral-spatial classification approach for hyperspectral images based on Mahalanobis distance metric learning , 2018, Inf. Sci..