Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances

The success of the supervised classification of remotely sensed images acquired over large geographical areas or at short time intervals strongly depends on the representativity of the samples used to train the classification algorithm and to define the model. When training samples are collected from an image or a spatial region that is different from the one used for mapping, spectral shifts between the two distributions are likely to make the model fail. Such shifts are generally due to differences in acquisition and atmospheric conditions or to changes in the nature of the object observed. To design classification methods that are robust to data set shifts, recent remote sensing literature has considered solutions based on domain adaptation (DA) approaches. Inspired by machine-learning literature, several DA methods have been proposed to solve specific problems in remote sensing data classification. This article provides a critical review of the recent advances in DA approaches for remote sensing and presents an overview of DA methods divided into four categories: 1) invariant feature selection, 2) representation matching, 3) adaptation of classifiers, and 4) selective sampling. We provide an overview of recent methodologies, examples of applications of the considered techniques to real remote sensing images characterized by very high spatial and spectral resolution as well as possible guidelines for the selection of the method to use in real application scenarios.

[1]  Lorenzo Bruzzone,et al.  Active and Semisupervised Learning for the Classification of Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Mikhail F. Kanevski,et al.  A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[3]  Lorenzo Bruzzone,et al.  Semisupervised Transfer Component Analysis for Domain Adaptation in Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  R. M. Hoffer,et al.  Computer-Aided Analysis of Landsat-1 MSS Data: A Comparison of Three Approaches, Including a "Modified Clustering" Approach-1 MSS Data: A Comparison of Three Approaches, Including a "Modified Clustering" Approach , 1975 .

[5]  Lawrence O. Hall,et al.  Active learning to recognize multiple types of plankton , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[6]  Goo Jun,et al.  Semisupervised Learning of Hyperspectral Data With Unknown Land-Cover Classes , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Allan Aasbjerg Nielsen,et al.  Kernel principal component and maximum autocorrelation factor analyses for change detection , 2009, Remote Sensing.

[8]  Luis Gómez-Chova,et al.  Graph Matching for Adaptation in Remote Sensing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Naif Alajlan,et al.  Three-Layer Convex Network for Domain Adaptation in Multitemporal VHR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[10]  Lorenzo Bruzzone,et al.  Unsupervised retraining of a maximum likelihood classifier for the analysis of multitemporal remote sensing images , 2001, IEEE Trans. Geosci. Remote. Sens..

[11]  Lorenzo Bruzzone,et al.  Active Learning for Domain Adaptation in the Supervised Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[12]  L. Bruzzone,et al.  Tree species classification in the Southern Alps based on the fusion of very high geometrical resolution multispectral/hyperspectral images and LiDAR data , 2012 .

[13]  Lorenzo Bruzzone,et al.  Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Luis Alonso,et al.  Multitemporal fusion of Landsat/TM and ENVISAT/MERIS for crop monitoring , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[15]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Fabio Pacifici,et al.  Understanding angular effects in VHR imagery and their significance for urban land-cover model portability: A study of two multi-angle in-track image sequences , 2015 .

[17]  Goo Jun,et al.  An Efficient Active Learning Algorithm with Knowledge Transfer for Hyperspectral Data Analysis , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[18]  Luis Gómez-Chova,et al.  Multitask Remote Sensing Data Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Francesca Bovolo,et al.  Updating Land-Cover Maps by Classification of Image Time Series: A Novel Change-Detection-Driven Transfer Learning Approach , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Emma Izquierdo-Verdiguier,et al.  Encoding Invariances in Remote Sensing Image Classification With SVM , 2013, IEEE Geoscience and Remote Sensing Letters.

[21]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[22]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Huanxin Zou,et al.  Unsupervised Cross-View Semantic Transfer for Remote Sensing Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[24]  Gustau Camps-Valls,et al.  WEAKLY SUPERVISED ALIGNMENT OF MULTISENSOR IMAGES , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[25]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[26]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[27]  Liangpei Zhang,et al.  Sparse Transfer Manifold Embedding for Hyperspectral Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Joydeep Ghosh,et al.  Exploiting Class Hierarchies for Knowledge Transfer in Hyperspectral Data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Melba M. Crawford,et al.  Active Learning: Any Value for Classification of Remotely Sensed Data? , 2013, Proceedings of the IEEE.

[30]  Hanyun Wang,et al.  Learn Multiple-Kernel SVMs for Domain Adaptation in Hyperspectral Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[31]  Huanxin Zou,et al.  Transfer Sparse Subspace Analysis for Unsupervised Cross-View Scene Model Adaptation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  William J. Emery,et al.  The Importance of Physical Quantities for the Analysis of Multitemporal and Multiangular Optical Very High Spatial Resolution Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Bernhard Schölkopf,et al.  Cost-Sensitive Active Learning With Lookahead: Optimizing Field Surveys for Remote Sensing Data Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Neil D. Lawrence,et al.  Dataset Shift in Machine Learning , 2009 .

[36]  L. Plümer,et al.  Detection of early plant stress responses in hyperspectral images , 2014 .

[37]  Lorenzo Bruzzone,et al.  A multiple-cascade-classifier system for a robust and partially unsupervised updating of land-cover maps , 2002, IEEE Trans. Geosci. Remote. Sens..

[38]  Bianca Zadrozny,et al.  Learning and evaluating classifiers under sample selection bias , 2004, ICML.

[39]  Naif Alajlan,et al.  Large-Scale Image Classification Using Active Learning , 2014, IEEE Geoscience and Remote Sensing Letters.

[40]  Luis Gómez-Chova,et al.  Semisupervised Image Classification With Laplacian Support Vector Machines , 2008, IEEE Geoscience and Remote Sensing Letters.

[41]  Melba M. Crawford,et al.  Spectral and Spatial Proximity-Based Manifold Alignment for Multitemporal Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Claudio Persello,et al.  Interactive Domain Adaptation for the Classification of Remote Sensing Images Using Active Learning , 2013, IEEE Geoscience and Remote Sensing Letters.

[43]  Qian Du,et al.  2011 GRSS Data Fusion Contest: Exploiting WorldView-2 multi-angular acquisitions , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[44]  Konrad Schindler,et al.  Semantic tie points , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[45]  Francesca Bovolo,et al.  A Novel Domain Adaptation Bayesian Classifier for Updating Land-Cover Maps With Class Differences in Source and Target Domains , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[46]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[47]  Lorenzo Bruzzone,et al.  Combining parametric and non-parametric algorithms for a partially unsupervised classification of multitemporal remote-sensing images , 2002, Inf. Fusion.

[48]  Lorenzo Bruzzone,et al.  A partially unsupervised cascade classifier for the analysis of multitemporal remote-sensing images , 2002, Pattern Recognit. Lett..

[49]  Lorenzo Bruzzone,et al.  A Novel Approach to the Selection of Spatially Invariant Features for the Classification of Hyperspectral Images With Improved Generalization Capability , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Francesca Bovolo,et al.  Multidimensional Probability Density Function Matching for Preprocessing of Multitemporal Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[51]  S. Bruin,et al.  Analysis of monotonic greening and browning trends from global NDVI time-series , 2011 .

[52]  Goo Jun,et al.  Spatially Adaptive Classification of Land Cover With Remote Sensing Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[53]  G. Camps-Valls,et al.  Spectral alignment of multi-temporal cross-sensor images with automated kernel canonical correlation analysis , 2015 .

[54]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  J. Heckman Sample selection bias as a specification error , 1979 .

[56]  Bernhard Schölkopf,et al.  Correcting Sample Selection Bias by Unlabeled Data , 2006, NIPS.

[57]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[58]  André Stumpf,et al.  Active learning in the spatial-domain for landslide mapping in remote sensing images , 2012 .

[59]  Gabriele Moser,et al.  Multimodal Classification of Remote Sensing Images: A Review and Future Directions , 2015, Proceedings of the IEEE.

[60]  Melba M. Crawford,et al.  Domain Adaptation With Preservation of Manifold Geometry for Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[61]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Robert H. Fraser,et al.  Signature extension through space for northern landcover classification: A comparison of radiometric correction methods , 2005 .

[63]  Lorenzo Bruzzone,et al.  Kernel-Based Domain-Invariant Feature Selection in Hyperspectral Images for Transfer Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Francesca Bovolo,et al.  Detection of Land-Cover Transitions in Multitemporal Remote Sensing Images With Active-Learning-Based Compound Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Christian Berger,et al.  From land cover-graphs to urban structure types , 2014, Int. J. Geogr. Inf. Sci..

[66]  Lorenzo Bruzzone,et al.  Active learning methods in classification of remote sensing images , 2012 .

[67]  Lorenzo Bruzzone,et al.  Definition of Effective Training Sets for Supervised Classification of Remote Sensing Images by a Novel Cost-Sensitive Active Learning Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[68]  Gustau Camps-Valls,et al.  Kernel Manifold Alignment for Domain Adaptation , 2015, PloS one.

[69]  Mikhail F. Kanevski,et al.  SVM-Based Boosting of Active Learning Strategies for Efficient Domain Adaptation , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[70]  Motoaki Kawanabe,et al.  Machine Learning in Non-Stationary Environments - Introduction to Covariate Shift Adaptation , 2012, Adaptive computation and machine learning.

[71]  Shiyong Cui,et al.  Pattern Retrieval in Large Image Databases Using Multiscale Coarse-to-Fine Cascaded Active Learning , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[72]  José F. Moreno,et al.  Gaussian Process Retrieval of Chlorophyll Content From Imaging Spectroscopy Data , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[73]  K. Beurs,et al.  Evaluation of Landsat and MODIS data fusion products for analysis of dryland forest phenology , 2012 .

[74]  Trevor Darrell,et al.  Adapting Visual Category Models to New Domains , 2010, ECCV.

[75]  Farid Melgani,et al.  Land-Cover Classification of Remotely Sensed Images Using Compressive Sensing Having Severe Scarcity of Labeled Patterns , 2015, IEEE Geoscience and Remote Sensing Letters.

[76]  Gustavo Camps-Valls,et al.  Semisupervised Manifold Alignment of Multimodal Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[77]  David Cohn,et al.  Active Learning , 2010, Encyclopedia of Machine Learning.

[78]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.