Incorporating Diversity into Self-Learning for Synergetic Classification of Hyperspectral and Panchromatic Images

Derived from semi-supervised learning and active learning approaches, self-learning (SL) was recently developed for the synergetic classification of hyperspectral (HS) and panchromatic (PAN) images. Combining the image segmentation and active learning techniques, SL aims at selecting and labeling the informative unlabeled samples automatically, thereby improving the classification accuracy under the condition of small samples. This paper presents an improved synergetic classification scheme based on the concept of self-learning for HS and PAN images. The investigated scheme considers three basic rules, namely the identity rule, the uncertainty rule, and the diversity rule. By integrating the diversity of samples into the SL scheme, a more stable classifier is trained by using fewer samples. Experiments on three synthetic and real HS and PAN images reveal that the diversity criterion can avoid the problem of bias sampling, and has a certain advantage over the primary self-learning approach.

[1]  Lorenzo Bruzzone,et al.  A Composite Semisupervised SVM for Classification of Hyperspectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[2]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[3]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Giles M. Foody,et al.  Multiclass and Binary SVM Classification: Implications for Training and Classification Users , 2008, IEEE Geoscience and Remote Sensing Letters.

[5]  Bo Du,et al.  A batch-mode active learning framework by querying discriminative and representative samples for hyperspectral image classification , 2016, Neurocomputing.

[6]  R. Brereton,et al.  Active learning support vector machines for optimal sample selection in classification , 2004 .

[7]  Jon Atli Benediktsson,et al.  Spectral-Spatial Hyperspectral Image Classification Using Subspace-Based Support Vector Machines and Adaptive Markov Random Fields , 2016, Remote. Sens..

[8]  Jon Atli Benediktsson,et al.  Integration of Segmentation Techniques for Classification of Hyperspectral Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[9]  Fuchun Sun,et al.  A Fast and Robust Sparse Approach for Hyperspectral Data Classification Using a Few Labeled Samples , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Dimitris G. Stavrakoudis,et al.  Decision Fusion Based on Hyperspectral and Multispectral Satellite Imagery for Accurate Forest Species Mapping , 2014, Remote. Sens..

[12]  Mark A. Girolami,et al.  Mercer kernel-based clustering in feature space , 2002, IEEE Trans. Neural Networks.

[13]  Daniel M. Tartakovsky,et al.  Subsurface characterization with support vector machines , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Arnold W. M. Smeulders,et al.  Active learning using pre-clustering , 2004, ICML.

[15]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[16]  James T. Kwok Moderating the outputs of support vector machine classifiers , 1999, IEEE Trans. Neural Networks.

[17]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[18]  Naonori Ueda,et al.  A Hybrid Generative/Discriminative Approach to Semi-Supervised Classifier Design , 2005, AAAI.

[19]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[20]  Min Wang,et al.  Segmentation of High Spatial Resolution Remote Sensing Imagery Based on Hard-Boundary Constraint and Two-Stage Merging , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Leonhard Blesius,et al.  Tree Species Classification Using Hyperspectral Imagery: A Comparison of Two Classifiers , 2016, Remote. Sens..

[22]  Rong Zhang,et al.  A large scale clustering scheme for kernel K-Means , 2002, Object recognition supported by user interaction for service robots.

[23]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[24]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  André Stumpf,et al.  Active Learning in the Spatial Domain for Remote Sensing Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  Semisupervised Self-Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[27]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[28]  Lorenzo Bruzzone,et al.  A Fast Cluster-Assumption Based Active-Learning Technique for Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Ye Zhang,et al.  A Novel Synergetic Classification Approach for Hyperspectral and Panchromatic Images Based on Self-Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Chun Chen,et al.  Active Learning Based on Locally Linear Reconstruction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Tom Michael Mitchell,et al.  The Role of Unlabeled Data in Supervised Learning , 2004 .

[32]  Lorenzo Bruzzone,et al.  Definition of Effective Training Sets for Supervised Classification of Remote Sensing Images by a Novel Cost-Sensitive Active Learning Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[34]  K. Moffett,et al.  Remote Sens , 2015 .

[35]  Lorenzo Bruzzone,et al.  Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[36]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[38]  Dong-Chen He,et al.  Rule-Based Classification of a Very High Resolution Image in an Urban Environment Using Multispectral Segmentation Guided by Cartographic Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Lorenzo Bruzzone,et al.  Active and Semisupervised Learning for the Classification of Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  David J. Crisp Improved Data Structures for Fast Region Merging Segmentation Using a Mumford-Shah Energy Functional , 2008, 2008 Digital Image Computing: Techniques and Applications.

[41]  Xiaowei Xu,et al.  Representative Sampling for Text Classification Using Support Vector Machines , 2003, ECIR.

[42]  Gui-Song Xia,et al.  Accurate Annotation of Remote Sensing Images via Active Spectral Clustering with Little Expert Knowledge , 2015, Remote. Sens..

[43]  Nello Cristianini,et al.  Query Learning with Large Margin Classi ersColin , 2000 .