Hierarchical Subspace Learning Based Unsupervised Domain Adaptation for Cross-Domain Classification of Remote Sensing Images

We address the problem of automatic updating of land-cover maps by using remote sensing images under the notion of domain adaptation (DA) in this paper. Essentially, unsupervised DA techniques aim at adapting a classifier modeled on the source domain by considering the available ground truth and evaluate the same on a related yet diverse target domain consisting only of test samples. Traditional subspace learning based strategies in this respect inherently assume the existence of a single subspace spanning the data from both the domains. However, such a constraint becomes rigid in many scenarios considering the diversity in the statistical properties of the underlying semantic classes and problem due to data overlapping in the feature space. As a remedy, we propose an automated binary-tree based hierarchical organization of the semantic classes and subsequently introduce the notion of node-specific subspace learning from the learned tree. We validate the method on hyperspectral, medium-resolution, and very high resolution datasets, which exhibits a consistently improved performance in comparison to standard single subspace learning based strategies as well as other representative techniques from the literature.

[1]  Flemming Topsøe,et al.  Jensen-Shannon divergence and Hilbert space embedding , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[2]  Daumé,et al.  Frustratingly Easy Semi-Supervised Domain Adaptation , 2010 .

[3]  Tinne Tuytelaars,et al.  Unsupervised Visual Domain Adaptation Using Subspace Alignment , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[5]  Tinne Tuytelaars,et al.  Mind the Gap: Subspace based Hierarchical Domain Adaptation , 2015, ArXiv.

[6]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Rama Chellappa,et al.  Domain adaptation for object recognition: An unsupervised approach , 2011, 2011 International Conference on Computer Vision.

[8]  Luis Gómez-Chova,et al.  Graph Matching for Adaptation in Remote Sensing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Francesca Bovolo,et al.  Classification of Time Series of Multispectral Images With Limited Training Data , 2013, IEEE Transactions on Image Processing.

[10]  Melba M. Crawford,et al.  Domain Adaptation With Preservation of Manifold Geometry for Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[12]  Paolo Gamba,et al.  Geodesic Flow Kernel Support Vector Machine for Hyperspectral Image Classification by Unsupervised Subspace Feature Transfer , 2016, Remote. Sens..

[13]  Michael Elad,et al.  K-SVD and its non-negative variant for dictionary design , 2005, SPIE Optics + Photonics.

[14]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[15]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[17]  Rong Yan,et al.  Cross-domain video concept detection using adaptive svms , 2007, ACM Multimedia.

[18]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[19]  Lorenzo Bruzzone,et al.  Unsupervised retraining of a maximum-likelihood classifier for the analysis of multitemporal remote sensing images , 1999, Remote Sensing.

[20]  Kristen Grauman,et al.  Learning Kernels for Unsupervised Domain Adaptation with Applications to Visual Object Recognition , 2014, International Journal of Computer Vision.

[21]  Mikhail F. Kanevski,et al.  SVM-Based Boosting of Active Learning Strategies for Efficient Domain Adaptation , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Francesca Bovolo,et al.  A Novel Graph-Matching-Based Approach for Domain Adaptation in Classification of Remote Sensing Image Pair , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Lorenzo Bruzzone,et al.  Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances , 2016, IEEE Geoscience and Remote Sensing Magazine.

[25]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[26]  Lorenzo Bruzzone,et al.  Semisupervised Transfer Component Analysis for Domain Adaptation in Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Bo Geng,et al.  DAML: Domain Adaptation Metric Learning , 2011, IEEE Transactions on Image Processing.

[28]  Francesca Bovolo,et al.  A Novel Domain Adaptation Bayesian Classifier for Updating Land-Cover Maps With Class Differences in Source and Target Domains , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[30]  Yoram Singer,et al.  Pegasos: primal estimated sub-gradient solver for SVM , 2011, Math. Program..

[31]  Rama Chellappa,et al.  Subspace Interpolation via Dictionary Learning for Unsupervised Domain Adaptation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Lorenzo Bruzzone,et al.  A novel active learning strategy for domain adaptation in the classification of remote sensing images , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[33]  Kristen Grauman,et al.  Connecting the Dots with Landmarks: Discriminatively Learning Domain-Invariant Features for Unsupervised Domain Adaptation , 2013, ICML.

[34]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Lorenzo Bruzzone,et al.  A Novel Approach to the Selection of Spatially Invariant Features for the Classification of Hyperspectral Images With Improved Generalization Capability , 2009, IEEE Transactions on Geoscience and Remote Sensing.