An Active Relearning Framework for Remote Sensing Image Classification

Classification is an important technique for remote sensing data interpretation. In order to enhance the performance of a supervised classifier and ensure the lowest possible cost of the training samples used in the process, active learning (AL) can be used to optimize the training sample set. At the same time, integrating spatial information can help to enhance the separability between similar classes, which can in turn reduce the need for training samples in AL. To effectively integrate spatial information into the AL framework, this paper proposes a new active relearning (ARL) model for remote sensing image classification. In particular, our model is used to relearn the spatial features on the classification map, which contributes significantly to enhancing the performance of the classifier. We integrate the relearning model into the AL framework, with the aim to accelerate the convergence of AL and further reduce the labeling cost. Under the newly developed ARL framework, we propose two spatial–spectral uncertainty criteria to optimize the procedure for selecting new training samples. Furthermore, an adaptive multiwindow ARL model is also introduced in this paper. Our experiments with two hyperspectral images and two very high resolution images indicate that the ARL model exhibits faster convergence speed with fewer samples than traditional AL methods. Our results also suggest that the proposed spatial–spectral uncertainty criteria and the multiwindow version can further improve the performance when implementing ARL.

[1]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Jon Atli Benediktsson,et al.  Multiple Morphological Profiles From Multicomponent-Base Images for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[5]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Xiaocong Xu,et al.  A New Global Land-Use and Land-Cover Change Product at a 1-km Resolution for 2010 to 2100 Based on Human–Environment Interactions , 2017 .

[7]  Daniel P. W. Ellis,et al.  Support vector machine active learning for music retrieval , 2006, Multimedia Systems.

[8]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[9]  Nello Cristianini,et al.  Query Learning with Large Margin Classi ersColin , 2000 .

[10]  Liangpei Zhang,et al.  Multiagent Object-Based Classifier for High Spatial Resolution Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Qian Du,et al.  Classification of hyperspectral urban data using adaptive simultaneous orthogonal matching pursuit , 2014 .

[12]  Bo Du,et al.  Compression of hyperspectral remote sensing images by tensor approach , 2015, Neurocomputing.

[13]  Xin Huang,et al.  Classification of high-spatial resolution imagery based on distance-weighted Markov random field with an improved iterated conditional mode method , 2011 .

[14]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[15]  Xiaoping Liu,et al.  A future land use simulation model (FLUS) for simulating multiple land use scenarios by coupling human and natural effects , 2017 .

[16]  Lorenzo Bruzzone,et al.  Active and Semisupervised Learning for the Classification of Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[18]  D. Böhning Multinomial logistic regression algorithm , 1992 .

[19]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[20]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[22]  Melba M. Crawford,et al.  View Generation for Multiview Maximum Disagreement Based Active Learning for Hyperspectral Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  William J. Emery,et al.  Classification of Very High Spatial Resolution Imagery Using Mathematical Morphology and Support Vector Machines , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Mikhail F. Kanevski,et al.  Memory-Based Cluster Sampling for Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[26]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[27]  Sankar K. Pal,et al.  Segmentation of multispectral remote sensing images using active support vector machines , 2004, Pattern Recognit. Lett..

[28]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[29]  Liangpei Zhang,et al.  A Nonlinear Multiple Feature Learning Classifier for Hyperspectral Images With Limited Training Samples , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Bo Du,et al.  Spatial Coherence-Based Batch-Mode Active Learning for Remote Sensing Image Classification , 2015, IEEE Transactions on Image Processing.

[31]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[32]  William J. Emery,et al.  Improving active learning methods using spatial information , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[33]  Liangpei Zhang,et al.  Combining Pixel- and Object-Based Machine Learning for Identification of Water-Body Types From Urban High-Resolution Remote-Sensing Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Melba M. Crawford,et al.  Active Learning: Any Value for Classification of Remotely Sensed Data? , 2013, Proceedings of the IEEE.

[35]  Qingshan Liu,et al.  Patch-based active learning (PTAL) for spectral-spatial classification on hyperspectral data , 2014 .

[36]  Ping Zhong,et al.  An MRF Model-Based Active Learning Framework for the Spectral-Spatial Classification of Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Signal Processing.

[37]  Gustavo Camps-Valls,et al.  Semisupervised Classification of Remote Sensing Images With Active Queries , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Antonio J. Plaza,et al.  New Postprocessing Methods for Remote Sensing Image Classification: A Systematic Study , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Liangpei Zhang,et al.  Supervised Segmentation of Very High Resolution Images by the Use of Extended Morphological Attribute Profiles and a Sparse Transform , 2014, IEEE Geoscience and Remote Sensing Letters.

[40]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[41]  Liangpei Zhang,et al.  A Multichannel Gray Level Co-Occurrence Matrix for Multi/Hyperspectral Image Texture Representation , 2014, Remote. Sens..

[42]  Lawrence O. Hall,et al.  Active learning to recognize multiple types of plankton , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[43]  Bin Li,et al.  A survey on instance selection for active learning , 2012, Knowledge and Information Systems.