A Novel Deep Framework for Change Detection of Multi-source Heterogeneous Images

Change detection of remote sensing images is to detect changes in multiple images (at least a pair of images) obtained at different time points. However, almost all existing change detection methods based on deep learning need to be trained repeatedly on different datasets (especially on heterogeneous datasets) to obtain satisfactory results. Besides, many of these methods have to be trained on large numbers of samples acquired by classical pre-classification methods. In this paper, a novel change detection framework based on meta-learning, called MLCD, is proposed. We model the change detection problem as a one-shot learning problem, although there are no labels for reference in reality. Inspired by active learning, we present two sample selection strategies to find a few representative samples. Based on the key idea of meta-learning, our framework mainly consists of a modified convolutional neural network and a graph neural network, and it is capable of learning to compare samples in the embedded feature space. Meanwhile, it only needs to be trained once with very few samples and can be directly transferred to test changes on other heterogeneous images. Experimental results on both Synthetic Aperture Radar (SAR) and multispectral images demonstrate the effectiveness and superiority of our framework over state-of-the-art methods.

[1]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Qian Xu,et al.  Survey on active learning algorithms , 2012 .

[3]  Maoguo Gong,et al.  A multiobjective fuzzy clustering method for change detection in SAR images , 2016, Appl. Soft Comput..

[4]  Maoguo Gong,et al.  Difference representation learning using stacked restricted Boltzmann machines for change detection in SAR images , 2014, Soft Computing.

[5]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[6]  Pieter Abbeel,et al.  A Simple Neural Attentive Meta-Learner , 2017, ICLR.

[7]  Junyu Dong,et al.  Change Detection in SAR Images Based on Deep Semi-NMF and SVD Networks , 2017, Remote. Sens..

[8]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[9]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[11]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[12]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[13]  Lichao Mou,et al.  Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection , 2016, Remote. Sens..

[14]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[15]  Asari,et al.  Fuzzy Clustering with a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2015 .

[16]  Sergey Levine,et al.  Probabilistic Model-Agnostic Meta-Learning , 2018, NeurIPS.

[17]  Zhetao Li,et al.  Generative Adversarial Networks for Change Detection in Multispectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[18]  Joan Bruna,et al.  Few-Shot Learning with Graph Neural Networks , 2017, ICLR.

[19]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[20]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[21]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.