Dual Learning-Based Siamese Framework for Change Detection Using Bi-Temporal VHR Optical Remote Sensing Images

Asafundamentalandprofoundtaskinremotesensing, changedetectionfromvery-high-resolution (VHR) images plays a vital role in a wide range of applications and attracts considerable attention. Current methods generally focus on the research of simultaneously modeling and discriminating the changed and unchanged features. In practice, for bi-temporal VHR optical remote sensing images, the temporal spectral variability tends to exist in all bands throughout the entire paired images, making it difficult to distinguish none-changes and changes with a single model. In this paper, motivated by this observation, we propose a novel hybrid end-to-end framework named dual learning-based Siamese framework (DLSF) for change detection. The framework comprises two parallel streams which are dual learning-based domain transfer and Siamese-based change decision. The former stream is aimed at reducing the domain differences of two paired images and retaining the intrinsic information by translating them into each other’s domain. While the latter stream is aimed at learning a decision strategy to decide the changes in two domains, respectively. By training our proposed framework with certain change map references, this method learns a cross-domain translation in order to suppress the differences of unchanged regions and highlight the differences of changed regions in two domains, respectively, then focus on the detection of changed regions. To the best of our knowledge, the idea of incorporating dual learning framework and Siamese network for change detection is novel. The experimental results on two datasets and the comparison with other state-of-the-art methods verify the efficiency and superiority of our proposed DLSF.

[1]  Peijun Du,et al.  Object-Based Change Detection in Urban Areas from High Spatial Resolution Images Based on Multiple Features and Ensemble Learning , 2018, Remote. Sens..

[2]  Xue Wang,et al.  Object-Based Change Detection Using Multiple Classifiers and Multi-Scale Uncertainty Analysis , 2019, Remote. Sens..

[3]  Tamás Szirányi,et al.  A Mixed Markov model for change detection in aerial photos with large time differences , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[5]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[6]  Haigang Sui,et al.  A novel change detection approach based on visual saliency and random forest from multi-temporal high-resolution remote-sensing images , 2018, International Journal of Remote Sensing.

[7]  Francesca Bovolo,et al.  A novel sequential spectral change vector analysis for representing and detecting multiple changes in hyperspectral images , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[8]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[9]  Gui-Song Xia,et al.  Region-Based Change Detection for Polarimetric SAR Images Using Wishart Mixture Models , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Gabriele Moser,et al.  Multiscale Unsupervised Change Detection on Optical Images by Markov Random Fields and Wavelets , 2011, IEEE Geoscience and Remote Sensing Letters.

[11]  Mohamad Awad,et al.  Sea water chlorophyll-a estimation using hyperspectral images and supervised Artificial Neural Network , 2014, Ecol. Informatics.

[12]  Xin Huang,et al.  A novel co-training approach for urban land cover mapping with unclear Landsat time series imagery , 2018, Remote Sensing of Environment.

[13]  Stéphane Derrode,et al.  Change Detection in Synthetic Aperture Radar Images , 2008 .

[14]  Zhetao Li,et al.  Generative Adversarial Networks for Change Detection in Multispectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[15]  Seyed Ali Jozi,et al.  Urban development change detection based on Multi-Temporal Satellite Images as a fast tracking approach—a case study of Ahwaz County, southwestern Iran , 2015, Environmental Monitoring and Assessment.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[17]  Alexandre Boulch,et al.  Fully Convolutional Siamese Networks for Change Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[18]  W. Malila Change Vector Analysis: An Approach for Detecting Forest Changes with Landsat , 1980 .

[19]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[20]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[21]  Fausto W. Acerbi-Junior,et al.  Object-Based Change Detection in the Cerrado Biome Using Landsat Time Series , 2019, Remote. Sens..

[22]  Gabriele Moser,et al.  Multiscale unsupervised change detection by Markov random fields and wavelet transforms , 2007, SPIE Remote Sensing.

[23]  M. Ridd,et al.  A Comparison of Four Algorithms for Change Detection in an Urban Environment , 1998 .

[24]  Suming Jin,et al.  A comprehensive change detection method for updating the National Land Cover Database to circa 2011 , 2013 .

[25]  Lei Zhu,et al.  Generating labeled samples for hyperspectral image classification using correlation of spectral bands , 2015, Frontiers of Computer Science.

[26]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[27]  Ping Tan,et al.  DualGAN: Unsupervised Dual Learning for Image-to-Image Translation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[28]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Hyunsoo Kim,et al.  Learning to Discover Cross-Domain Relations with Generative Adversarial Networks , 2017, ICML.

[30]  W. Wiesbeck,et al.  Monitoring and change detection of natural disaster (like subsidence) using Synthetic Aperture Radar (SAR) data , 2008, 2008 International Conference on Recent Advances in Microwave Theory and Applications.

[31]  Ali Selamat,et al.  Water Feature Extraction and Change Detection Using Multitemporal Landsat Imagery , 2014, Remote. Sens..

[32]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Francesca Bovolo,et al.  A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[35]  Francesca Bovolo,et al.  Updating Land-Cover Maps by Classification of Image Time Series: A Novel Change-Detection-Driven Transfer Learning Approach , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[37]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[38]  D. Lu,et al.  Change detection techniques , 2004 .

[39]  Tamás Szirányi,et al.  Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Bo Du,et al.  Slow Feature Analysis for Change Detection in Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Maoguo Gong,et al.  A Generative Discriminatory Classified Network for Change Detection in Multispectral Imagery , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[45]  Yeqiao Wang,et al.  Remote sensing change detection tools for natural resource managers: Understanding concepts and tradeoffs in the design of landscape monitoring projects , 2009 .

[46]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Knut Conradsen,et al.  Multivariate Alteration Detection (MAD) and MAF Postprocessing in Multispectral, Bitemporal Image Data: New Approaches to Change Detection Studies , 1998 .

[49]  Tie-Yan Liu,et al.  Dual Learning for Machine Translation , 2016, NIPS.

[50]  Lichao Mou,et al.  Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection , 2016, Remote. Sens..

[51]  Xiao Ma,et al.  Fully convolutional network with cluster for semantic segmentation , 2018 .

[52]  Maoguo Gong,et al.  A Conditional Adversarial Network for Change Detection in Heterogeneous Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[53]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Alexandre Boulch,et al.  Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[55]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.