Weakly supervised classification of time-series of very high resolution remote sensing images by transfer learning

ABSTRACT In multi-temporal remotely sensed data analysis, labeling samples from each image is often a required process, this is however very tedious and time-consuming. In many cases the ground objects do not change significantly through time, and one can reuse some of the labels with appropriate consistency verification. In this letter, a novel weakly supervised transfer learning framework is proposed to classify multi-temporal remote-sensing images with only one labeled image. By utilizing the consistency of time-series images and a domain adaptation method, our framework is able to classify all the other multi-temporal images chronologically without any labeling effort for these images. Our framework achieves a similar level of classification accuracy as if it were through supervised learning. Our framework is shown to be effective for processing multi-temporal remote-sensing images when training samples are only available for one temporal dataset.

[1]  T. Carlson,et al.  On the relation between NDVI, fractional vegetation cover, and leaf area index , 1997 .

[2]  Sivaraman Balakrishnan,et al.  Optimal kernel choice for large-scale two-sample tests , 2012, NIPS.

[3]  Ricardo Tanscheit,et al.  A fuzzy inference system for multispectral image classification , 2016, 2016 IEEE ANDESCON.

[4]  Rongjun Qin,et al.  A novel spectrum enhancement technique for multi-temporal, multi-spectral data using spatial-temporal filtering , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[5]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[6]  Lorenzo Bruzzone,et al.  Semisupervised Transfer Component Analysis for Domain Adaptation in Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Melba M. Crawford,et al.  Spectral and Spatial Proximity-Based Manifold Alignment for Multitemporal Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[9]  Ingo Steinwart,et al.  On the Influence of the Kernel on the Consistency of Support Vector Machines , 2002, J. Mach. Learn. Res..

[10]  Peijun Du,et al.  Information fusion techniques for change detection from multi-temporal remote sensing images , 2013, Inf. Fusion.

[11]  Rongjun Qin,et al.  RPC STEREO PROCESSOR (RSP) – A SOFTWARE PACKAGE FOR DIGITAL SURFACE MODEL AND ORTHOPHOTO GENERATION FROM SATELLITE STEREO IMAGERY , 2016 .

[12]  Paolo Gamba,et al.  Supervised and Semi-Supervised Multi-View Canonical Correlation Analysis Ensemble for Heterogeneous Domain Adaptation in Remote Sensing Image Classification , 2017, Remote. Sens..

[13]  Xue Li,et al.  Iterative Reweighting Heterogeneous Transfer Learning Framework for Supervised Remote Sensing Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Huanxin Zou,et al.  Unsupervised Cross-View Semantic Transfer for Remote Sensing Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[16]  Wei Liu,et al.  Semisupervised Multiview Feature Selection for VHR Remote Sensing Images With Label Learning and Automatic View Generation , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Gong Jianyaa,et al.  Of Multi-temporal Remote Sensing Data Change Detection Algorithms , 2008 .