Stacked Fisher autoencoder for SAR change detection

Abstract Stacked autoencoder is effective in image denoising and classification when it is used for synthetic aperture radar (SAR) change detection. However, the resulting features may not be discriminative enough for in some sense. To alleviate this problem, in this paper we propose a stacked Fisher autoencoder (SFAE) for SAR change detection. Specifically, in the framework of SFAE, unsupervised layer-wise feature learning and supervised fine-tuning are jointly performed when training the network. The trained network can be used to detect the changes in both of the single and multi-polarization SAR datasets in real-time. The proposed SFAE has two advantages. The first one is to expand the stacked autoencoder to suit the environment with the multiplicative noise in SAR change detection. The second is that the features extracted by SFAE are more discriminative than the original stacked autoencoder due to that Fisher discriminant criterion is incorporated into SFAE. The results on the simulated and real SAR datasets indicate that the proposed SFAE algorithm has a significant advantage on multitemporal single/multi-polarization SAR (SAR/PolSAR) change detection.

[1]  Francesca Bovolo,et al.  Building Change Detection in Multitemporal Very High Resolution SAR Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Vincenzo Carotenuto,et al.  On Multiple Covariance Equality Testing with Application to SAR Change Detection , 2017, IEEE Transactions on Signal Processing.

[3]  S. Hachicha,et al.  On the SAR change detection review and optimal decision , 2014 .

[4]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[5]  Wentao An,et al.  Nonlocal Filtering for Polarimetric SAR Data: A Pretest Approach , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Jeffrey Pennington,et al.  Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions , 2011, EMNLP.

[7]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Knut Conradsen,et al.  A test statistic in the complex Wishart distribution and its application to change detection in polarimetric SAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[10]  Dong Xu,et al.  Trace Ratio vs. Ratio Trace for Dimensionality Reduction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[12]  Fang Liu,et al.  Spectral Clustering Ensemble Applied to SAR Image Segmentation , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Gabriele Moser,et al.  Polarimetric SAR Change Detection With the Complex Hotelling–Lawley Trace Statistic , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[15]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Liangpei Zhang,et al.  Unsupervised Change Detection Based on Hybrid Conditional Random Field Model for High Spatial Resolution Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[18]  R. G. White,et al.  Change detection in SAR imagery , 1990 .

[19]  Irena Hajnsek,et al.  A Change Detector Based on an Optimization With Polarimetric SAR Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[21]  A. Lopes,et al.  A statistical and geometrical edge detector for SAR images , 1988 .

[22]  Shuang Wang,et al.  Unsupervised Change Detection in SAR Image Based on Gauss-Log Ratio Image Fusion and Compressed Projection , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Shuang Wang,et al.  Unsupervised saliency-guided SAR image change detection , 2017, Pattern Recognit..

[24]  Jong-Sen Lee,et al.  Polarimetric SAR speckle filtering and its implication for classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[25]  Zhetao Li,et al.  Generative Adversarial Networks for Change Detection in Multispectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[26]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[27]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[29]  David G. Stork,et al.  Pattern Classification , 1973 .

[30]  Marc'Aurelio Ranzato,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2006, NIPS.

[31]  Maoguo Gong,et al.  Fuzzy Clustering With a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2014, IEEE Transactions on Fuzzy Systems.

[32]  Maoguo Gong,et al.  Deep learning and mapping based ternary change detection for information unbalanced images , 2017, Pattern Recognit..

[33]  Lorenzo Bruzzone,et al.  A Multisquint Framework for Change Detection in High-Resolution Multitemporal SAR Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Fang Liu,et al.  Local Restricted Convolutional Neural Network for Change Detection in Polarimetric SAR Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[36]  Wolfgang Dierking,et al.  Change detection for thematic mapping by means of airborne multitemporal polarimetric SAR imagery , 2002, IEEE Trans. Geosci. Remote. Sens..

[37]  Maoguo Gong,et al.  Change-Detection Map Learning Using Matching Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[39]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[40]  Yifang Ban,et al.  Multitemporal Spaceborne SAR Data for Urban Change Detection in China , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Mats I. Pettersson,et al.  Bivariate Gamma Distribution for Wavelength-Resolution SAR Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Qian Du,et al.  Modified Fisher's Linear Discriminant Analysis for Hyperspectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[43]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Fang Liu,et al.  A new patch based change detector for polarimetric SAR data , 2015, Pattern Recognit..

[46]  Jean-Yves Tourneret,et al.  Bivariate Gamma Distributions for Image Registration and Change Detection , 2007, IEEE Transactions on Image Processing.

[47]  Thu Trang Le,et al.  Change detection matrix for multitemporal filtering and change analysis of SAR and PolSAR image time series , 2015 .

[48]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[49]  Victor Haertel,et al.  Gradual land cover change detection based on multitemporal fraction images , 2012, Pattern Recognit..

[50]  Gui-Song Xia,et al.  Region-Based Change Detection for Polarimetric SAR Images Using Wishart Mixture Models , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[52]  Francesca Bovolo,et al.  A Hierarchical Approach to Change Detection in Very High Resolution SAR Images for Surveillance Applications , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Juan M. Lopez-Sanchez,et al.  A New Polarimetric Change Detector in Radar Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.