A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images

We propose an unsupervised deep convolutional coupling network for change detection based on two heterogeneous images acquired by optical sensors and radars on different dates. Most existing change detection methods are based on homogeneous images. Due to the complementary properties of optical and radar sensors, there is an increasing interest in change detection based on heterogeneous images. The proposed network is symmetric with each side consisting of one convolutional layer and several coupling layers. The two input images connected with the two sides of the network, respectively, are transformed into a feature space where their feature representations become more consistent. In this feature space, the different map is calculated, which then leads to the ultimate detection map by applying a thresholding algorithm. The network parameters are learned by optimizing a coupling function. The learning process is unsupervised, which is different from most existing change detection methods based on heterogeneous images. Experimental results on both homogenous and heterogeneous images demonstrate the promising performance of the proposed network compared with several existing approaches.

[1]  Gabriele Moser,et al.  Conditional Copulas for Change Detection in Heterogeneous Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[3]  J. R. Jensen,et al.  Inland wetland change detection using aircraft MSS data , 1987 .

[4]  Gabriele Moser,et al.  Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jean-Yves Tourneret,et al.  Change Detection in Multisensor SAR Images Using Bivariate Gamma Distributions , 2008, IEEE Transactions on Image Processing.

[6]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[7]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[8]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Matthieu Cord,et al.  Learning Deep Hierarchical Visual Feature Coding , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Yu Cao,et al.  A Neighborhood-Based Ratio Approach for Change Detection in SAR Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[11]  Shiyong Cui,et al.  Building Change Detection Based on Satellite Stereo Imagery and Digital Surface Models , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Chun-Xia Zhang,et al.  A sparse-response deep belief network based on rate distortion theory , 2014, Pattern Recognit..

[13]  Henri Maître,et al.  A new statistical model for Markovian classification of urban areas in high-resolution SAR images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Maoguo Gong,et al.  A multiobjective fuzzy clustering method for change detection in SAR images , 2016, Appl. Soft Comput..

[18]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in VHR Multispectral Images , 2010, IEEE Transactions on Image Processing.

[19]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jean-Marie Nicolas,et al.  MIMOSA: An Automatic Change Detection Method for SAR Time Series , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Maoguo Gong,et al.  A Multiobjective Sparse Feature Learning Model for Deep Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[25]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[27]  Yew-Soon Ong,et al.  Deep transfer learning for classification of time-delayed Gaussian networks , 2015, Signal Process..

[28]  Jean-Marie Nicolas,et al.  Application of log-cumulants to the detection of spatiotemporal discontinuities in multitemporal SAR images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jean-Yves Tourneret,et al.  Change detection for optical and radar images using a Bayesian nonparametric model coupled with a Markov random field , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[31]  Xiaoqiang Lu,et al.  Scene Recognition by Manifold Regularized Deep Learning Architecture , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[33]  Lorenzo Bruzzone,et al.  Integration of Gibbs Markov Random Field and Hopfield-Type Neural Networks for Unsupervised Change Detection in Remotely Sensed Multitemporal Images , 2013, IEEE Transactions on Image Processing.

[34]  Amandine Robin,et al.  An A-Contrario Approach for Subpixel Change Detection in Satellite Imagery , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Zheng Niu,et al.  Object-based land cover change detection for cross-sensor images , 2013 .

[36]  Gonzalo Pajares,et al.  A Hopfield Neural Network for Image Change Detection , 2006, IEEE Transactions on Neural Networks.

[37]  Lorenzo Bruzzone,et al.  An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images , 2002, IEEE Trans. Image Process..

[38]  Gunter Menz,et al.  Monitoring Land-Use Change in Nakuru (Kenya) Using Multi-Sensor Satellite Data , 2012 .

[39]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[41]  José Luis Rojo-Álvarez,et al.  Kernel-Based Framework for Multitemporal and Multisource Remote Sensing Data Classification and Change Detection , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Quan Pan,et al.  Change Detection in Heterogeneous Remote Sensing Images Based on Multidimensional Evidential Reasoning , 2014, IEEE Geoscience and Remote Sensing Letters.

[43]  Jean-Yves Tourneret,et al.  A New Multivariate Statistical Model for Change Detection in Images Acquired by Homogeneous and Heterogeneous Sensors , 2015, IEEE Transactions on Image Processing.

[44]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[45]  Sarath Chandar Multilingual Deep Learning , 2013 .

[46]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[47]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[48]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[49]  Maoguo Gong,et al.  Fuzzy C-Means Clustering With Local Information and Kernel Metric for Image Segmentation , 2013, IEEE Transactions on Image Processing.

[50]  Maoguo Gong,et al.  Fuzzy Clustering With a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2014, IEEE Transactions on Fuzzy Systems.

[51]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[52]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Pascal Vincent,et al.  Contractive Auto-Encoders: Explicit Invariance During Feature Extraction , 2011, ICML.