Application of Data Driven Optimization for Change Detection in Synthetic Aperture Radar Images

Data-driven optimization is an efficient global optimization algorithm for expensive black-box functions. In this paper, we apply data-driven optimization algorithm to the task of change detection with synthetic aperture radar (SAR) images for the first time. We first propose an easy-to-implement threshold algorithm for change detection in SAR images based on data-driven optimization. Its performance has been compared with commonly used methods like generalized Kittler and Illingworth threshold algorithms (GKIT). Next, we demonstrate how to tune the hyper-parameter of a (previously available) deep belief network (DBN) for change detection using data-driven optimization. Extensive evaluations are carried out using publicly available benchmark datasets. The obtained results suggest comparatively strong performance of our optimized DBN-based change detection algorithm.

[1]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[2]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[3]  Peng Zhang,et al.  SAR Image Change Detection Using PCANet Guided by Saliency Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[4]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[5]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[6]  C. Shoemaker,et al.  Combining radial basis function surrogates and dynamic coordinate search in high-dimensional expensive black-box optimization , 2013 .

[7]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Christine A. Shoemaker,et al.  SO-MI: A surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems , 2013, Comput. Oper. Res..

[9]  Jyh-Cheng Yu,et al.  Evolutionary Reliable Regional Kriging Surrogate and Soft Outer Array for Robust Engineering Optimization , 2017, IEEE Access.

[10]  Driss Haboudane,et al.  Deforestation detection and monitoring in cedar forests of the moroccan Middle-Atlas mountains , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[11]  T. Häme,et al.  An unsupervised change detection and recognition system for forestry , 1998 .

[12]  Taimoor Akhtar,et al.  Efficient Hyperparameter Optimization for Deep Learning Algorithms Using Deterministic RBF Surrogates , 2016, AAAI.

[13]  Jingming Yang,et al.  A differential evolution algorithm with self-adaptive strategy and control parameters based on symmetric Latin hypercube design for unconstrained optimization problems , 2016, Eur. J. Oper. Res..

[14]  Junyu Dong,et al.  Sea Ice Change Detection in SAR Images Based on Convolutional-Wavelet Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[15]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[16]  Yu Cao,et al.  A Neighborhood-Based Ratio Approach for Change Detection in SAR Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[17]  P. S. Chavez,et al.  Automatic detection of vegetation changes in the southwestern United States using remotely sensed images , 1994 .

[18]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Meng Wang,et al.  Fast Multi-Objective Optimization of Multi-Parameter Antenna Structures Based on Improved BPNN Surrogate Model , 2019, IEEE Access.

[20]  Sushma Kokate,et al.  Wavelet Fusion on Ratio Images for Change Detection in SAR Images , 2014 .

[21]  Jie Zhang,et al.  Imbalanced Learning-Based Automatic SAR Images Change Detection by Morphologically Supervised PCA-Net , 2019, IEEE Geoscience and Remote Sensing Letters.

[22]  Chen Chen,et al.  Deep Learning and Superpixel Feature Extraction Based on Contractive Autoencoder for Change Detection in SAR Images , 2018, IEEE Transactions on Industrial Informatics.

[23]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[24]  Qiang Huang,et al.  EM Estimation of Nanostructure Interactions With Incomplete Feature Measurement and Its Tailored Space Filling Designs , 2013, IEEE Transactions on Automation Science and Engineering.

[25]  Bifeng Song,et al.  A New Sequential Surrogate Method for Reliability Analysis and its Applications in Engineering , 2019, IEEE Access.

[26]  Biao Hou,et al.  Using Combined Difference Image and $k$ -Means Clustering for SAR Image Change Detection , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[28]  Gabriele Moser,et al.  Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery , 2006, IEEE Trans. Geosci. Remote. Sens..

[29]  Yifang Ban,et al.  Unsupervised Change Detection in Multitemporal SAR Images Over Large Urban Areas , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Hanqing Lu,et al.  Unsupervised Change Detection in SAR Image using Graph Cuts , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[31]  Fang Liu,et al.  Local Restricted Convolutional Neural Network for Change Detection in Polarimetric SAR Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.