Coupled dictionary learning for unsupervised change detection between multimodal remote sensing images

Abstract Archetypal scenarios for change detection generally consider two images acquired through sensors of the same modality. However, in some specific cases such as emergency situations, the only images available may be those acquired through sensors of different modalities. This paper addresses the problem of unsupervisedly detecting changes between two observed images acquired by sensors of different modalities with possibly different resolutions. These sensor dissimilarities introduce additional issues in the context of operational change detection that are not addressed by most of the classical methods. This paper introduces a novel framework to effectively exploit the available information by modeling the two observed images as a sparse linear combination of atoms belonging to a pair of coupled overcomplete dictionaries learnt from each observed image. As they cover the same geographical location, codes are expected to be globally similar, except for possible changes in sparse spatial locations. Thus, the change detection task is envisioned through a dual code estimation which enforces spatial sparsity in the difference between the estimated codes associated with each image. This problem is formulated as an inverse problem which is iteratively solved using an efficient proximal alternating minimization algorithm accounting for nonsmooth and nonconvex functions. The proposed method is applied to real images with simulated yet realistic and real changes. A comparison with state-of-the-art change detection methods evidences the accuracy of the proposed strategy.

[1]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[2]  Nicolas Dobigeon,et al.  Unmixing dynamic PET images with a PALM algorithm , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[3]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[4]  Jean-Yves Tourneret,et al.  Online Unmixing of Multitemporal Hyperspectral Images Accounting for Spectral Variability , 2015, IEEE Transactions on Image Processing.

[5]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[6]  Hyenkyun Woo,et al.  Proximal Linearized Alternating Direction Method for Multiplicative Denoising , 2013, SIAM J. Sci. Comput..

[7]  Jacek Gondzio,et al.  A second-order method for strongly convex ℓ1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\ell _1$$\end{document}-re , 2013, Mathematical Programming.

[8]  Nicolas Dobigeon,et al.  Detecting Changes Between Optical Images of Different Spatial and Spectral Resolutions: A Fusion-Based Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Stephen J. Wright,et al.  Sparse reconstruction by separable approximation , 2009, IEEE Trans. Signal Process..

[10]  Cédric Févotte,et al.  Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Francesca Bovolo,et al.  Rayleigh-Rice Mixture Parameter Estimation via EM Algorithm for Change Detection in Multispectral Images , 2015, IEEE Transactions on Image Processing.

[12]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[13]  Joseph G. Kawamura,et al.  Automatic Recognition of Changes in Urban Development from Aerial Photographs , 1971, IEEE Trans. Syst. Man Cybern..

[14]  Xiangtao Zheng,et al.  Joint Dictionary Learning for Multispectral Change Detection , 2017, IEEE Transactions on Cybernetics.

[15]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[16]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[17]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[18]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Marius Pedersen,et al.  A sensor-data-based denoising framework for hyperspectral images. , 2015, Optics express.

[20]  Vinciane Lacroix,et al.  Comparison of similarity measures of multi-sensor images for change detection applications , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Søren Holdt Jensen,et al.  Implementation of an optimal first-order method for strongly convex total variation regularization , 2011, ArXiv.

[22]  Jian Yu,et al.  A Dictionary Learning Approach for Poisson Image Deblurring , 2013, IEEE Transactions on Medical Imaging.

[23]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[24]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[25]  Jordi Inglada,et al.  Similarity measures for multisensor remote sensing images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[26]  Maoguo Gong,et al.  Coupled Dictionary Learning for Change Detection From Multisource Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Yady Tatiana Solano Correa,et al.  An Approach for Unsupervised Change Detection in Multitemporal VHR Images Acquired by Different Multispectral Sensors , 2018, Remote. Sens..

[28]  Gabriele Moser,et al.  Conditional Copulas for Change Detection in Heterogeneous Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[30]  Pierre-Antoine Thouvenin Modeling spatial and temporal variabilities in hyperspectral image unmixing , 2017 .

[31]  Nicolas Dobigeon,et al.  Robust Fusion of Multiband Images With Different Spatial and Spectral Resolutions for Change Detection , 2016, IEEE Transactions on Computational Imaging.

[32]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[33]  Nicolas Dobigeon,et al.  Nonlinear Hyperspectral Unmixing With Robust Nonnegative Matrix Factorization , 2014, IEEE Transactions on Image Processing.

[34]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[35]  Haigang Sui,et al.  A Novel Change Detection Approach for Multi-Temporal High-Resolution Remote Sensing Images Based on Rotation Forest and Coarse-to-Fine Uncertainty Analyses , 2018, Remote. Sens..

[36]  J. Campbell Introduction to remote sensing , 1987 .

[37]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[38]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[39]  Jean-Yves Tourneret,et al.  A New Multivariate Statistical Model for Change Detection in Images Acquired by Homogeneous and Heterogeneous Sensors , 2015, IEEE Transactions on Image Processing.

[40]  D. Lu,et al.  Change detection techniques , 2004 .

[41]  Jean-Yves Tourneret,et al.  Logistic regression for detecting changes between databases and remote sensing images , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[42]  Pol Coppin,et al.  Review ArticleDigital change detection methods in ecosystem monitoring: a review , 2004 .

[43]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[44]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[45]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[46]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[47]  Nancy Bertin,et al.  Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music Analysis , 2009, Neural Computation.

[48]  Olivier Cappé,et al.  Soft Nonnegative Matrix Co-Factorization , 2014, IEEE Transactions on Signal Processing.

[49]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[50]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[51]  Gabriele Steidl,et al.  Removing Multiplicative Noise by Douglas-Rachford Splitting Methods , 2010, Journal of Mathematical Imaging and Vision.

[52]  Francesca Bovolo,et al.  The Time Variable in Data Fusion: A Change Detection Perspective , 2015, IEEE Geoscience and Remote Sensing Magazine.

[53]  Lorenzo Bruzzone,et al.  A neural-statistical approach to multitemporal and multisource remote-sensing image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[54]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.