Deep nonsmooth nonnegative matrix factorization network with semi-supervised learning for SAR image change detection

Abstract In the paper, we propose a deep nonsmooth nonnegative matrix factorization (nsNMF) network with semi-supervised learning for synthetic aperture radar (SAR) image change detection. In most of the existing deep-NMF-based models, the nonnegative matrix is linearly decomposed layer by layer, which may fail to characterize the nonlinearities in complex data. As such, a nonlinear deep nsNMF model is first built for learning hierarchical, nonlinear, and localized data representations. Meanwhile, in view of its good generalization performance and low computational complexity, extreme learning machine (ELM) is integrated into the nonlinear deep nsNMF model to construct a deep nsNMF network for satisfactory classification. More importantly, since it is difficult to acquire more labeled samples in practice, semi-supervised learning strategy is proposed to make use of partially labeled data for training. The learning process of the proposed network consists of pretraining stage and fine-tuning stage, in which the former pretrains all decomposed matrices layer by layer and the latter aims to reduce the total reconstruction error by using the mini-batch gradient descent algorithm. The experimental results on four pairs of SAR images demonstrate the effectiveness of the proposed method.

[1]  Josiane Zerubia,et al.  Multilayer Markov Random Field Models for Change Detection in Optical Remote Sensing Images , 2015 .

[2]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[3]  Chong Liu,et al.  Urban Change Detection Based on Dempster-Shafer Theory for Multitemporal Very High-Resolution Imagery , 2018, Remote. Sens..

[4]  Seungjin Choi,et al.  Semi-Supervised Nonnegative Matrix Factorization , 2010, IEEE Signal Processing Letters.

[5]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[7]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[8]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Yu Cao,et al.  A Neighborhood-Based Ratio Approach for Change Detection in SAR Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[10]  Christos Boutsidis,et al.  SVD based initialization: A head start for nonnegative matrix factorization , 2008, Pattern Recognit..

[11]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Anastasios Tefas,et al.  Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification , 2006, IEEE Transactions on Neural Networks.

[13]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[15]  Junyu Dong,et al.  Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet , 2016, IEEE Geoscience and Remote Sensing Letters.

[16]  William J. Emery,et al.  Deep Semi-Nonnegative Matrix Factorization Based Unsupervised Change Detection of Remote Sensing Images , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Bo Du,et al.  Kernel Slow Feature Analysis for Scene Change Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Ashish Ghosh,et al.  Histogram thresholding for unsupervised change detection of remote sensing images , 2011 .

[19]  Qian Du,et al.  Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Andrzej Cichocki,et al.  Learning the Hierarchical Parts of Objects by Deep Non-Smooth Nonnegative Matrix Factorization , 2018, IEEE Access.

[21]  Boli Xiong,et al.  A change detection measure based on a likelihood ratio and statistical properties of SAR intensity images , 2012 .

[22]  William J. Emery,et al.  Gabor Feature Based Unsupervised Change Detection of Multitemporal SAR Images Based on Two-Level Clustering , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Alexander J. Smola,et al.  Efficient mini-batch training for stochastic optimization , 2014, KDD.

[24]  Maoguo Gong,et al.  SAR change detection based on intensity and texture changes , 2014 .

[25]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[26]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[27]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[28]  Wenzhong Shi,et al.  Change Detection Based on Gabor Wavelet Features for Very High Resolution Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Dietrich Lehmann,et al.  Nonsmooth nonnegative matrix factorization (nsNMF) , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Bo Du,et al.  Slow Feature Analysis for Change Detection in Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[31]  William J. Emery,et al.  Robust semi-NMF with total variation for unsupervised SAR image change detection , 2018 .

[32]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Peng Zhang,et al.  SAR Image Change Detection Based on Multiple Kernel K-Means Clustering With Local-Neighborhood Information , 2016, IEEE Geoscience and Remote Sensing Letters.

[34]  Jia Liu,et al.  Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images , 2016 .

[35]  Bo Du,et al.  Hyperspectral anomalous change detection based on joint sparse representation , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  Bo Li,et al.  Change detection from synthetic aperture radar images based on neighborhood-based ratio and extreme learning machine , 2016 .

[37]  Turgay Çelik Bayesian change detection based on spatial sampling and Gaussian mixture model , 2011, Pattern Recognit. Lett..

[38]  George Trigeorgis,et al.  A Deep Matrix Factorization Method for Learning Attribute Representations , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[40]  Licheng Jiao,et al.  Sar Image Change Detection Based on Mean Shift Pre-Classification and Fuzzy C-Means , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Gustavo Camps-Valls,et al.  Unsupervised Change Detection With Kernels , 2012, IEEE Geoscience and Remote Sensing Letters.

[42]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Bartlett W. Mel Computational neuroscience: Think positive to find parts , 1999, Nature.

[44]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Yiran Chen,et al.  A deep discriminative and robust nonnegative matrix factorization network method with soft label constraint , 2018, Neural Computing and Applications.

[46]  Hassan Ghassemian,et al.  Spectral Unmixing of Hyperspectral Imagery Using Multilayer NMF , 2014, IEEE Geoscience and Remote Sensing Letters.

[47]  Peng Zhang,et al.  Unsupervised Change Detection on SAR Images Using Triplet Markov Field Model , 2013, IEEE Geoscience and Remote Sensing Letters.

[48]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[49]  Lorenzo Bruzzone,et al.  A genetic expectation-maximization method for unsupervised change detection in multitemporal SAR imagery , 2009 .

[50]  Peng Zhang,et al.  SAR Image Change Detection Using PCANet Guided by Saliency Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[51]  Zhenmin Tang,et al.  Deep Convex NMF for Image Clustering , 2016, CCBR.

[52]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..