Heterogeneous image change detection using Deep Canonical Correlation Analysis

Cross-sensor change detection is nowadays of paramount importance for earth observation applications. Most current change detection techniques are based on homogeneous input images. Due to the detailed and complementary spatial and spectral information, heterogeneous images change detection has become an active research topic. Change detection models need effective feature representations to estimate changes of interest. Although great progress has been made, existing approaches mainly focus on shallow models, which only extracting handcrafted low-level features. To this end, this paper proposes a novel heterogeneous change detection method using deep canonical correlation analysis (DCCA). Specifically, the two heterogeneous images are transformed via a deep neural network, and they are projected in the common latent space in the output layer. Experiments on the commonly used homogenous and heterogeneous image datasets demonstrate the superiority of the proposed method compared with the traditional approaches.

[1]  B. Moor,et al.  On the Regularization of Canonical Correlation Analysis , 2003 .

[2]  Hichem Sahbi Misalignment resilient CCA for interactive satellite image change detection , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[3]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[4]  Jeff A. Bilmes,et al.  Unsupervised learning of acoustic features via deep canonical correlation analysis , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Melba M. Crawford,et al.  Classification of multi-source sensor data with limited labeled data , 2015, Defense + Security Symposium.

[6]  Ludmila I. Kuncheva,et al.  PCA feature extraction for change detection in multidimensional unlabelled streaming data , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Francesca Bovolo,et al.  A Novel Theoretical Framework for Unsupervised Change Detection Based on CVA in Polar Domain , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[8]  Jean-Yves Tourneret,et al.  Change Detection in Multisensor SAR Images Using Bivariate Gamma Distributions , 2008, IEEE Transactions on Image Processing.

[9]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[10]  Gustavo Camps-Valls,et al.  Multi-sensor change detection based on nonlinear canonical correlations , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[11]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[12]  Colin Fyfe,et al.  Kernel and Nonlinear Canonical Correlation Analysis , 2000, IJCNN.

[13]  Frank Boochs,et al.  Integration of high-resolution spatial and spectral data acquisition systems to provide complementary datasets for cultural heritage applications , 2010, Electronic Imaging.

[14]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[15]  Qian Du,et al.  Multi-Modal Change Detection, Application to the Detection of Flooded Areas: Outcome of the 2009–2010 Data Fusion Contest , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  G. Camps-Valls,et al.  Spectral alignment of multi-temporal cross-sensor images with automated kernel canonical correlation analysis , 2015 .

[17]  Jeff A. Bilmes,et al.  On Deep Multi-View Representation Learning , 2015, ICML.