Iterative Reweighting Heterogeneous Transfer Learning Framework for Supervised Remote Sensing Image Classification

Supervised classification methods have been widely used in the hyperspectral remote sensing image analysis. However, they require a large number of training samples to guarantee good performance, which costs a large amount of time and human labor, motivating researchers to reuse labeled samples from the mass of pre-existing related images. Transfer learning methods can adapt knowledge in the existing images to solve the classification problem in new yet related images, and have drawn increasing interest in the remote sensing field. However, the existing methods in the RS field require that all the images share the same dimensionality, which prevents their practical application. This paper focuses on the transfer learning problem for heterogeneous spaces where the dimensions are different. We propose a novel iterative reweighting heterogeneous transfer learning (IRHTL) framework that iteratively learns a common space for the source and target data and conducts a novel iterative reweighting strategy to reweight the source samples. In each iteration, the heterogeneous data are first mapped into a common space by two projection functions based on a weighted support vector machine. Second, based on the common subspace, the source data are reweighted by using the iterative reweighting strategy and reused for the transferring, according to their relative importance. Experiments undertaken on three data sets confirmed the effectiveness and reliability of the proposed IRHTL method.

[1]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[3]  P. Bartlett,et al.  ` p-Norm Multiple Kernel Learning , 2008 .

[4]  Mikhail F. Kanevski,et al.  SVM-Based Boosting of Active Learning Strategies for Efficient Domain Adaptation , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[6]  Qiang Yang,et al.  Translated Learning: Transfer Learning across Different Feature Spaces , 2008, NIPS.

[7]  Yue Wang,et al.  Weighted support vector machine for data classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[8]  Xuelong Li,et al.  Semi-Supervised Multitask Learning for Scene Recognition , 2015, IEEE Transactions on Cybernetics.

[9]  Lorenzo Bruzzone,et al.  Active Learning for Domain Adaptation in the Supervised Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Peter Stone,et al.  Boosting for Regression Transfer , 2010, ICML.

[12]  Pei Yang,et al.  Bayesian Task-Level Transfer Learning for Non-linear Regression , 2008, 2008 International Conference on Computer Science and Software Engineering.

[13]  Trevor Darrell,et al.  What you saw is not what you get: Domain adaptation using asymmetric kernel transforms , 2011, CVPR 2011.

[14]  Huan Wang,et al.  A storage allocation algorithm for outbound containers based on the outer-inner cellular automaton , 2014, Inf. Sci..

[15]  Lorenzo Bruzzone,et al.  Semisupervised Transfer Component Analysis for Domain Adaptation in Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Zaïd Harchaoui,et al.  Lifted coordinate descent for learning with trace-norm regularization , 2012, AISTATS.

[18]  Sebastian Nowozin,et al.  Infinite Kernel Learning , 2008, NIPS 2008.

[19]  Ivor W. Tsang,et al.  Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Bo Du,et al.  Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding , 2015, Pattern Recognit..

[21]  Antonio J. Plaza,et al.  Subspace-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[23]  Qiang Yang,et al.  Heterogeneous Transfer Learning for Image Clustering via the SocialWeb , 2009, ACL.

[24]  Shiming Xiang,et al.  Semisupervised Hyperspectral Image Classification via Discriminant Analysis and Robust Regression , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Ivor W. Tsang,et al.  Learning Sparse SVM for Feature Selection on Very High Dimensional Datasets , 2010, ICML.

[26]  Philip S. Yu,et al.  Transfer Learning on Heterogenous Feature Spaces via Spectral Transformation , 2010, 2010 IEEE International Conference on Data Mining.

[27]  Liangpei Zhang,et al.  Sparse Transfer Manifold Embedding for Hyperspectral Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  M. Kloft,et al.  l p -Norm Multiple Kernel Learning , 2011 .

[29]  Yu-Chiang Frank Wang,et al.  Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace , 2014, IEEE Transactions on Image Processing.

[30]  Qiang Yang,et al.  Self-taught clustering , 2008, ICML '08.

[31]  Junwei Han,et al.  Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding , 2014 .

[32]  Gustavo Camps-Valls,et al.  Semisupervised Manifold Alignment of Multimodal Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Raymond J. Mooney,et al.  Mapping and Revising Markov Logic Networks for Transfer Learning , 2007, AAAI.

[34]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[35]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[36]  Jiawei Han,et al.  Knowledge transfer via multiple model local structure mapping , 2008, KDD.

[37]  Luis Gómez-Chova,et al.  Semisupervised Image Classification With Laplacian Support Vector Machines , 2008, IEEE Geoscience and Remote Sensing Letters.

[38]  Bo Du,et al.  Random-Selection-Based Anomaly Detector for Hyperspectral Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Bo Du,et al.  Compression of hyperspectral remote sensing images by tensor approach , 2015, Neurocomputing.

[40]  Edoardo Pasolli,et al.  An Active Learning Framework for Hyperspectral Image Classification Using Hierarchical Segmentation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Horst Bischof,et al.  Semi-supervised image classification with huberized Laplacian Support Vector Machines , 2013, 2013 IEEE 9th International Conference on Emerging Technologies (ICET).

[42]  Hanyun Wang,et al.  Learn Multiple-Kernel SVMs for Domain Adaptation in Hyperspectral Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[43]  Francesca Bovolo,et al.  A Novel Graph-Matching-Based Approach for Domain Adaptation in Classification of Remote Sensing Image Pair , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Lorenzo Bruzzone,et al.  Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances , 2016, IEEE Geoscience and Remote Sensing Magazine.

[46]  Huanxin Zou,et al.  Transfer Sparse Subspace Analysis for Unsupervised Cross-View Scene Model Adaptation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.