Synthetic Aperture Radar Image Change Detection via Siamese Adaptive Fusion Network

Synthetic aperture radar (SAR) image change detection is a critical yet challenging task in the field of remote sensing image analysis. The task is nontrivial due to the following challenges: First, intrinsic speckle noise of SAR images inevitably degrades the neural network because of error gradient accumulation. Furthermore, the correlation among various levels or scales of feature maps is difficult to be achieved through summation or concatenation. Toward this end, we proposed a siamese adaptive fusion (AF) network for SAR image change detection. To be more specific, two-branch CNN is utilized to extract high-level semantic features of multitemporal SAR images. Besides, an AF module is designed to adaptively combine multiscale responses in convolutional layers. Therefore, the complementary information is exploited, and feature learning in change detection is further improved. Moreover, a correlation layer is designed to further explore the correlation between multitemporal images. Thereafter, robust feature representation is utilized for classification through a fully connected layer with softmax. Experimental results on four real SAR datasets demonstrate that the proposed method exhibits superior performance against several state-of-the-art methods. Our codes are available at https://github.com/summitgao/SAR_CD_SAFNet.

[1]  Kay Chen Tan,et al.  Bipartite Differential Neural Network for Unsupervised Image Change Detection , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Jian Yang,et al.  Selective Kernel Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Junyu Dong,et al.  Synthetic aperture radar image change detection based on frequency-domain analysis and random multigraphs , 2018 .

[4]  Quoc V. Le,et al.  CondConv: Conditionally Parameterized Convolutions for Efficient Inference , 2019, NeurIPS.

[5]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Shuang Wang,et al.  Unsupervised Change Detection in SAR Image Based on Gauss-Log Ratio Image Fusion and Compressed Projection , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Haibo He,et al.  Symmetric All Convolutional Neural-Network-Based Unsupervised Feature Extraction for Hyperspectral Images Classification , 2020, IEEE Transactions on Cybernetics.

[8]  Xuelong Li,et al.  Unsupervised Deep Noise Modeling for Hyperspectral Image Change Detection , 2019, Remote. Sens..

[9]  Fang Liu,et al.  Fast unsupervised deep fusion network for change detection of multitemporal SAR images , 2019, Neurocomputing.

[10]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jean-Marie Nicolas,et al.  MIMOSA: An Automatic Change Detection Method for SAR Time Series , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Licheng Jiao,et al.  Saliency-guided change detection for SAR imagery using a semi-supervised Laplacian SVM , 2016 .

[13]  Maoguo Gong,et al.  A Multiobjective Cooperative Coevolutionary Algorithm for Hyperspectral Sparse Unmixing , 2017, IEEE Transactions on Evolutionary Computation.

[14]  Bo Li,et al.  Change detection from synthetic aperture radar images based on neighborhood-based ratio and extreme learning machine , 2016 .

[15]  Qian Du,et al.  Hyperspectral and Multispectral Classification for Coastal Wetland Using Depthwise Feature Interaction Network , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[16]  William J. Emery,et al.  Gabor Feature Based Unsupervised Change Detection of Multitemporal SAR Images Based on Two-Level Clustering , 2015, IEEE Geoscience and Remote Sensing Letters.

[17]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Hongyan Zhang,et al.  ESCNet: An End-to-End Superpixel-Enhanced Change Detection Network for Very-High-Resolution Remote Sensing Images , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[20]  R. Dekker Speckle filtering in satellite SAR change detection imagery , 1998 .

[21]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[22]  Yilong Yin,et al.  Saliency detection based on directional patches extraction and principal local color contrast , 2018, J. Vis. Commun. Image Represent..

[23]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[24]  Fang Liu,et al.  Local Restricted Convolutional Neural Network for Change Detection in Polarimetric SAR Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Xiangzhi Bai,et al.  Analysis of new top-hat transformation and the application for infrared dim small target detection , 2010, Pattern Recognit..

[26]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[27]  Yoshua Bengio,et al.  Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation , 2013, ArXiv.

[28]  Xuelong Li,et al.  Looking Closer at the Scene: Multiscale Representation Learning for Remote Sensing Image Scene Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Xuelong Li,et al.  A Fast Neighborhood Grouping Method for Hyperspectral Band Selection , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Lorenzo Bruzzone,et al.  An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images , 2002, IEEE Trans. Image Process..

[31]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[32]  Yilong Yin,et al.  Visual saliency detection by integrating spatial position prior of object with background cues , 2020, Expert Syst. Appl..

[33]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Feng Gao,et al.  Change Detection From Synthetic Aperture Radar Images Based on Channel Weighting-Based Deep Cascade Network , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Yu Cao,et al.  A Neighborhood-Based Ratio Approach for Change Detection in SAR Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[37]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Feng Gao,et al.  Transferred Deep Learning for Sea Ice Change Detection From Synthetic-Aperture Radar Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[39]  Junyu Dong,et al.  Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet , 2016, IEEE Geoscience and Remote Sensing Letters.

[40]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Lorenzo Bruzzone,et al.  An iterative technique for the detection of land-cover transitions in multitemporal remote-sensing images , 1997, IEEE Trans. Geosci. Remote. Sens..