A Conditional Adversarial Network for Change Detection in Heterogeneous Images

Due to the distinct statistical properties in cross-sensor images, change detection in heterogeneous images is much more challenging than in homogeneous images. In this letter, we adopt a conditional generative adversarial network (cGAN) to transform the heterogeneous synthetic aperture radar (SAR) and optical images into some space where their information has a more consistent representation, making the direct comparison feasible. Our proposed framework contains a cGAN-based translation network that aims to translate the optical image with the SAR image as a target, and an approximation network that approximates the SAR image to the translated one by reducing their pixelwise difference. The two networks are updated alternately and when they are both trained well, the two translated and approximated images can be considered as homogeneous, from which the final change map can be acquired by direct comparison. Theoretical analysis and experimental results demonstrate the effectiveness and robustness of the proposed framework.

[1]  S. Quegan,et al.  Understanding Synthetic Aperture Radar Images , 1998 .

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[4]  Jean-Yves Tourneret,et al.  A New Multivariate Statistical Model for Change Detection in Images Acquired by Homogeneous and Heterogeneous Sensors , 2015, IEEE Transactions on Image Processing.

[5]  Gabriele Moser,et al.  Conditional Copulas for Change Detection in Heterogeneous Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Gabriele Moser,et al.  Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery , 2006, IEEE Trans. Geosci. Remote. Sens..

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[9]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[11]  José Luis Rojo-Álvarez,et al.  Kernel-Based Framework for Multitemporal and Multisource Remote Sensing Data Classification and Change Detection , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Zhetao Li,et al.  Generative Adversarial Networks for Change Detection in Multispectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.