Iterative Training Sample Expansion to Increase and Balance the Accuracy of Land Classification From VHR Imagery

Imbalanced training sets are known to produce suboptimal maps for supervised classification. Therefore, one challenge in mapping land cover is acquiring training data that will allow classification with high overall accuracy in which each class is also mapped onto similar user’s accuracy. To solve this problem, we integrated local adaptive region and boxand-whisker plot (BP) techniques into an iterative algorithm to expand the size of the training sample for selected classes in the current study. The major steps of the proposed algorithm are as follows. First, a very small initial training sample for each class set is labeled manually. Second, potential new training samples are found within an adaptive region by conducting local spectral variation analysis. Lastly, three new training samples are acquired to capture information regarding intra-class variation; these samples lie in the lower, median, and upper quartiles of BP. After adding these new training samples to the initial training sample, classification is retrained and the process is continued iteratively until termination. The proposed approach was applied to three very high resolution (VHR) remote sensing images and compared with a set of cognate methods. The comparison demonstrated that the proposed approach produced the best result in terms of overall accuracy and exhibited superiority in balancing user’s accuracy. For example, the proposed approach was typically 2%-10% more accurate than the compared methods in terms of overall accuracy and it generally yielded the most balanced classification.

[1]  G. Foody Explaining the unsuitability of the kappa coefficient in the assessment and comparison of the accuracy of thematic maps obtained by image classification , 2020, Remote Sensing of Environment.

[2]  Chris M. Roelfsema,et al.  Trends in Remote Sensing Accuracy Assessment Approaches in the Context of Natural Resources , 2019, Remote. Sens..

[3]  Giles M. Foody,et al.  Key issues in rigorous accuracy assessment of land cover products , 2019, Remote Sensing of Environment.

[4]  Jon Atli Benediktsson,et al.  Fusion of Multiple Edge-Preserving Operations for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Amir F. Atiya,et al.  A Comprehensive Analysis of Synthetic Minority Oversampling Technique (SMOTE) for handling class imbalance , 2019, Inf. Sci..

[6]  Bo Du,et al.  Feature Learning Using Spatial-Spectral Hypergraph Discriminant Analysis for Hyperspectral Image , 2019, IEEE Transactions on Cybernetics.

[7]  Mingquan Wu,et al.  Dynamic Synthetic Minority Over-Sampling Technique-Based Rotation Forest for the Classification of Imbalanced Hyperspectral Data , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Jon Atli Benediktsson,et al.  Spatial Density Peak Clustering for Hyperspectral Image Classification With Noisy Labels , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Xiaolong Zhang,et al.  Efficiently Predicting Hot Spots in PPIs by Combining Random Forest and Synthetic Minority Over-Sampling Technique , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[10]  Jon Atli Benediktsson,et al.  A Novel Unsupervised Sample Collection Method for Urban Land-Cover Mapping Using Landsat Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Shutao Li,et al.  Hyperspectral Anomaly Detection With Multiscale Attribute and Edge-Preserving Filters , 2018, IEEE Geoscience and Remote Sensing Letters.

[12]  Jon Atli Benediktsson,et al.  Refining Land Cover Classification Maps Based on Dual-Adaptive Majority Voting Strategy for Very High Resolution Remote Sensing Images , 2018, Remote. Sens..

[13]  Shutao Li,et al.  Detection and Correction of Mislabeled Training Samples for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Francisco Herrera,et al.  SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary , 2018, J. Artif. Intell. Res..

[15]  Nathalie Japkowicz,et al.  Manifold-based synthetic oversampling with manifold conformance estimation , 2018, Machine Learning.

[16]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[17]  Hongxun Yao,et al.  Deep Feature Fusion for VHR Remote Sensing Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Xia Xu,et al.  Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jun Li,et al.  Advanced Spectral Classifiers for Hyperspectral Images: A review , 2017, IEEE Geoscience and Remote Sensing Magazine.

[20]  Jon Atli Benediktsson,et al.  Automatic Object-Oriented, Spectral-Spatial Feature Extraction Driven by Tobler's First Law of Geography for Very High Resolution Aerial Imagery Classification , 2017, Remote. Sens..

[21]  James D. Wickham,et al.  Thematic accuracy assessment of the 2011 National Land Cover Database (NLCD). , 2017, Remote sensing of environment.

[22]  Muhammet Said Aydemir,et al.  Semisupervised Hyperspectral Image Classification Using Small Sample Sizes , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Luigi Boschetti,et al.  A stratified random sampling design in space and time for regional to global scale burned area product validation. , 2016, Remote sensing of environment.

[24]  Liangpei Zhang,et al.  High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random Fields , 2016, IEEE Transactions on Image Processing.

[25]  Gang Liu,et al.  A Color-Texture-Structure Descriptor for High-Resolution Satellite Image Classification , 2016, Remote. Sens..

[26]  Lorenzo Bruzzone,et al.  Histogram-Based Attribute Profiles for Classification of Very High Resolution Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Bob Zhang,et al.  Multiple representations and sparse representation for image classification , 2015, Pattern Recognit. Lett..

[28]  Liangpei Zhang,et al.  Automatic Labelling and Selection of Training Samples for High-Resolution Remote Sensing Image Classification over Urban Areas , 2015, Remote. Sens..

[29]  Gabriele Moser,et al.  Multimodal Classification of Remote Sensing Images: A Review and Future Directions , 2015, Proceedings of the IEEE.

[30]  Sunitha Abburu,et al.  Satellite Image Classification Methods and Techniques: A Review , 2015 .

[31]  Jon Atli Benediktsson,et al.  A Survey on Spectral–Spatial Classification Techniques Based on Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Jon Atli Benediktsson,et al.  Intrinsic Image Decomposition for Feature Extraction of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Maryam Imani,et al.  Feature Extraction Using Weighted Training Samples , 2015, IEEE Geoscience and Remote Sensing Letters.

[34]  Julien Michel,et al.  Pointwise Graph-Based Local Texture Characterization for Very High Resolution Multispectral Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Weifeng Li,et al.  Comparing Machine Learning Classifiers for Object-Based Land Cover Classification Using Very High Resolution Imagery , 2014, Remote. Sens..

[36]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[37]  Jon Atli Benediktsson,et al.  Morphological Profiles Based on Differently Shaped Structuring Elements for Classification of Images With Very High Spatial Resolution , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[41]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[42]  Bing Zhang,et al.  A Review of Remote Sensing Image Classification Techniques: the Role of Spatio-contextual Information , 2014 .

[43]  Lorenzo Bruzzone,et al.  A Review of Modern Approaches to Classification of Remote Sensing Data , 2014 .

[44]  Brian Johnson,et al.  Classifying a high resolution image of an urban area using super-object information , 2013 .

[45]  Zhiyong Lv,et al.  Object-Based Spatial Feature for Classification of Very High Resolution Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[46]  S. Stehman Estimating area from an accuracy assessment error matrix , 2013 .

[47]  Francesca Bovolo,et al.  A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[48]  Jon Atli Benediktsson,et al.  Spectral Unmixing for the Classification of Hyperspectral Images at a Finer Spatial Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[49]  T. Warner,et al.  Multi-scale GEOBIA with very high spatial resolution digital aerial imagery: scale, texture and image objects , 2011 .

[50]  Gustavo Camps-Valls,et al.  Spatio-Spectral Remote Sensing Image Classification With Graph Kernels , 2010, IEEE Geoscience and Remote Sensing Letters.

[51]  Fan Xia,et al.  Assessing object-based classification: advantages and limitations , 2009 .

[52]  John A. Richards,et al.  Using Suitable Neighbors to Augment the Training Set in Hyperspectral Maximum Likelihood Classification , 2008, IEEE Geoscience and Remote Sensing Letters.

[53]  M. A. Aguilar,et al.  Using texture analysis to improve per-pixel classification of very high resolution images for mapping plastic greenhouses , 2008 .

[54]  Liangpei Zhang,et al.  A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Giles M. Foody,et al.  The use of small training sets containing mixed pixels for accurate hard image classification: Training on mixed spectral responses for classification by a SVM , 2006 .

[56]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Graeme G. Wilkinson,et al.  Results and implications of a study of fifteen years of satellite image classification experiments , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Giles M. Foody,et al.  Toward intelligent training of supervised image classifications: directing training data acquisition for SVM classification , 2004 .

[59]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[60]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[61]  Robert M. Gray,et al.  Multiresolution image classification by hierarchical modeling with two-dimensional hidden Markov models , 2000, IEEE Trans. Inf. Theory.

[62]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..