A Novel Synergetic Classification Approach for Hyperspectral and Panchromatic Images Based on Self-Learning

In this paper, we propose a self-learning approach for remote sensing image classification. The main work of this paper aims at providing a new framework of semisupervised learning technique for multiple-source synergetic classification, thereby improving the classification accuracy under the condition of small samples. Considering the high spectral resolution of a hyperspectral (HS) image and the high spatial resolution of a panchromatic (PAN) image, the proposed approach combines image segmentation with an active learning algorithm and adopts a standard active learning method for a self-learning strategy, in which the learning algorithm automatically selects informative unlabeled samples by itself according to their collaborative spatial-spectral features and the predicted information of a spectral-based classifier. This way, no extra cost of human expertise is required for labeling the selected pixels when compared with conventional active learning methods. Experiments on three data sets, including HS and PAN images, indicate that our proposed approach has a great enhancement on overall classification accuracy compared with classical supervised algorithms and turns out to be a promising strategy in synergetic classification of HS and PAN images.

[1]  Lorenzo Bruzzone,et al.  Active and Semisupervised Learning for the Classification of Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Nello Cristianini,et al.  Query Learning with Large Margin Classi ersColin , 2000 .

[3]  Zhi-Hua Zhou,et al.  New Semi-Supervised Classification Method Based on Modified Cluster Assumption , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jian Yang,et al.  Feature fusion: parallel strategy vs. serial strategy , 2003, Pattern Recognit..

[6]  R. Brereton,et al.  Active learning support vector machines for optimal sample selection in classification , 2004 .

[7]  Yan Gao,et al.  Optimal region growing segmentation and its effect on classification accuracy , 2011 .

[8]  David J. Crisp Improved Data Structures for Fast Region Merging Segmentation Using a Mumford-Shah Energy Functional , 2008, 2008 Digital Image Computing: Techniques and Applications.

[9]  Aggelos K. Katsaggelos,et al.  Hybrid image segmentation using watersheds and fast region merging , 1998, IEEE Trans. Image Process..

[10]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Liangpei Zhang,et al.  Classification and Extraction of Spatial Features in Urban Areas Using High-Resolution Multispectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[12]  Dong-Chen He,et al.  Rule-Based Classification of a Very High Resolution Image in an Urban Environment Using Multispectral Segmentation Guided by Cartographic Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Kacem Chehdi,et al.  Automatic image segmentation system through iterative edge - region co-operation , 2002, Image Vis. Comput..

[14]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[15]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[17]  Jon Atli Benediktsson,et al.  Integration of Segmentation Techniques for Classification of Hyperspectral Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[18]  Claudio Persello,et al.  Interactive Domain Adaptation for the Classification of Remote Sensing Images Using Active Learning , 2013, IEEE Geoscience and Remote Sensing Letters.

[19]  Chun Chen,et al.  Active Learning Based on Locally Linear Reconstruction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Gustavo Camps-Valls,et al.  Cluster-based active learning for compact image classification , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Lorenzo Bruzzone,et al.  Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Daniel M. Tartakovsky,et al.  Subsurface characterization with support vector machines , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Frank Y. Shih,et al.  An improved incremental training algorithm for support vector machines using active query , 2007, Pattern Recognit..

[25]  Michele Volpi,et al.  Unbiased query-by-bagging active learning for VHR image classification , 2010, Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[27]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[28]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Min Wang,et al.  Segmentation of High Spatial Resolution Remote Sensing Imagery Based on Hard-Boundary Constraint and Two-Stage Merging , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[31]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[32]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jon Atli Benediktsson,et al.  Semisupervised Self-Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Ilya Levner,et al.  Classification-Driven Watershed Segmentation , 2007, IEEE Transactions on Image Processing.

[35]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[37]  David D. Lewis,et al.  Heterogeneous Uncertainty Sampling for Supervised Learning , 1994, ICML.

[38]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[40]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[41]  Fuchun Sun,et al.  A Fast and Robust Sparse Approach for Hyperspectral Data Classification Using a Few Labeled Samples , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[44]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Bernhard Schölkopf,et al.  Cost-Sensitive Active Learning With Lookahead: Optimizing Field Surveys for Remote Sensing Data Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[46]  André Stumpf,et al.  Active Learning in the Spatial Domain for Remote Sensing Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Lorenzo Bruzzone,et al.  A Fast Cluster-Assumption Based Active-Learning Technique for Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Sankar K. Pal,et al.  Segmentation of multispectral remote sensing images using active support vector machines , 2004, Pattern Recognit. Lett..

[49]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Giles M. Foody,et al.  Multiclass and Binary SVM Classification: Implications for Training and Classification Users , 2008, IEEE Geoscience and Remote Sensing Letters.

[51]  Melba M. Crawford,et al.  Multi-view adaptive disagreement based active learning for hyperspectral image classification , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[52]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[53]  T.S. Huang,et al.  Optimal edge detection in two-dimensional images , 1996, IEEE Trans. Image Process..

[54]  Gustavo Camps-Valls,et al.  Learning Relevant Image Features With Multiple-Kernel Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.