Building Change Detection in VHR SAR Images via Unsupervised Deep Transcoding

Building change detection (CD), important for its application in urban monitoring, can be performed in near real time by comparing prechange and postchange very-high-spatial-resolution (VHR) synthetic-aperture-radar (SAR) images. However, multitemporal VHR SAR images are complex as they show high spatial correlation, prone to shadows, and show an inhomogeneous signature. Spatial context needs to be taken into account to effectively detect a change in such images. Recently, convolutional-neural-network (CNN)-based transfer learning techniques have shown strong performance for CD in VHR multispectral images. However, its direct use for SAR CD is impeded by the absence of labeled SAR data and, thus, pretrained networks. To overcome this, we exploit the availability of paired unlabeled SAR and optical images to train for the suboptimal task of transcoding SAR images into optical images using a cycle-consistent generative adversarial network (CycleGAN). The CycleGAN consists of two generator networks: one for transcoding SAR images into the optical image domain and the other for projecting optical images into the SAR image domain. After unsupervised training, the generator transcoding SAR images into optical ones is used as a bitemporal deep feature extractor to extract optical-like features from bitemporal SAR images. Thus, deep change vector analysis (DCVA) and fuzzy rules can be applied to identify changed buildings (new/destroyed). We validate our method on two data sets made up of pairs of bitemporal VHR SAR images on the city of L'Aquila (Italy) and Trento (Italy).

[1]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[3]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[4]  Trevor Darrell,et al.  Adversarial Feature Learning , 2016, ICLR.

[5]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Francesca Bovolo,et al.  Building Change Detection in Multitemporal Very High Resolution SAR Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Xiao Xiang Zhu,et al.  The SARptical Dataset for Joint Analysis of SAR and Optical Image in Dense Urban Area , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Junyu Dong,et al.  Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet , 2016, IEEE Geoscience and Remote Sensing Letters.

[9]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Fang Qiu,et al.  Speckle Noise Reduction in SAR Imagery Using a Local Adaptive Median Filter , 2004 .

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Tomas E. Ward,et al.  Generative Adversarial Networks in Computer Vision , 2019, ACM Comput. Surv..

[13]  Jefersson Alex dos Santos,et al.  Do deep features generalize from everyday objects to remote sensing and aerial scenes domains? , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Jean-Yves Tourneret,et al.  Change Detection in Multisensor SAR Images Using Bivariate Gamma Distributions , 2008, IEEE Transactions on Image Processing.

[15]  Xu-Cheng Yin,et al.  Change Detection in SAR Images Based on Deep Learning , 2019, International Journal of Aeronautical and Space Sciences.

[16]  Jieping Ye,et al.  Deep Model Based Transfer and Multi-Task Learning for Biological Image Analysis , 2020, IEEE Transactions on Big Data.

[17]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[18]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[19]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[20]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Yifang Ban,et al.  A novel approach for object-based change image generation using multitemporal high-resolution SAR images , 2017 .

[22]  Fang Chen,et al.  Earthquake-Induced Building Damage Mapping Based on Multi-Task Deep Learning Framework , 2019, IEEE Access.

[23]  Jon Atli Benediktsson,et al.  Big Data for Remote Sensing: Challenges and Opportunities , 2016, Proceedings of the IEEE.

[24]  Francesca Bovolo,et al.  A novel hierarchical approach to change detection with very high resolution SAR images for surveillance applications , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[25]  Andreas R. Brenner,et al.  Radar Imaging of Urban Areas by Means of Very High-Resolution SAR and Interferometric SAR , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Junyu Dong,et al.  Sea Ice Change Detection in SAR Images Based on Convolutional-Wavelet Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[27]  Francesca Bovolo,et al.  A Split-Based Approach to Unsupervised Change Detection in Large-Size Multitemporal Images: Application to Tsunami-Damage Assessment , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Francesca Bovolo,et al.  The Time Variable in Data Fusion: A Change Detection Perspective , 2015, IEEE Geoscience and Remote Sensing Magazine.

[29]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Ronghua Shang,et al.  A Deep Learning Method for Change Detection in Synthetic Aperture Radar Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Byeong-Seok Shin,et al.  Mid-Level Feature Extractor for Transfer Learning to Small-Scale Dataset of Medical Images , 2018 .

[32]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Qian Du,et al.  Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Francesca Bovolo,et al.  A Multilevel Parcel-Based Approach to Change Detection in Very High Resolution Multitemporal Images , 2005, IEEE Geoscience and Remote Sensing Letters.

[35]  Bo Zhang,et al.  Damage analysis of 2008 Wenchuan earthquake using SAR images , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[36]  Maoguo Gong,et al.  Feature learning and change feature classification based on deep learning for ternary change detection in SAR images , 2017 .

[37]  Hong Zhang,et al.  Urban Building Change Detection in SAR Images Using Combined Differential Image and Residual U-Net Network , 2019, Remote. Sens..

[38]  Yu Cao,et al.  A Neighborhood-Based Ratio Approach for Change Detection in SAR Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[39]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Feng Gao,et al.  Transferred Deep Learning for Sea Ice Change Detection From Synthetic-Aperture Radar Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[41]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Nazzareno Pierdicca,et al.  Identification of building double-bounces feature in very high resoultion SAR data for earthquake damage mapping , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[43]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[44]  Raffaella Guida,et al.  Earthquake Damage Detection in Urban Areas Using Curvilinear Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Peng Zhang,et al.  SAR Image Change Detection Using PCANet Guided by Saliency Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[46]  Corentin Henry,et al.  SAR-to-Optical Image Translation Based on Conditional Generative Adversarial Networks - Optimization, Opportunities and Limits , 2019, Remote. Sens..

[47]  Qingjie Liu,et al.  Convolutional neural network features based change detection in satellite images , 2016, International Workshop on Pattern Recognition.

[48]  Uwe Soergel,et al.  High-resolution SAR data: new opportunities and challenges for the analysis of urban areas , 2006 .

[49]  Nicu Sebe,et al.  Semantic-Fusion Gans for Semi-Supervised Satellite Image Classification , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[50]  Zongxu Pan,et al.  Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data , 2017, Remote. Sens..

[51]  Maoguo Gong,et al.  Fuzzy Clustering With a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2014, IEEE Transactions on Fuzzy Systems.

[52]  Olaf Hellwich,et al.  Exploiting GAN-Based SAR to Optical Image Transcoding for Improved Classification via Deep Learning , 2018 .

[53]  Li Yan,et al.  An Unsupervised SAR Change Detection Method Based on Stochastic Subspace Ensemble Learning , 2019, Remote. Sens..

[54]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Jitendra Malik,et al.  Hypercolumns for object segmentation and fine-grained localization , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Luciano Alparone,et al.  Nonparametric Change Detection in Multitemporal SAR Images Based on Mean-Shift Clustering , 2013, IEEE Transactions on Geoscience and Remote Sensing.