Automatic building change image quality assessment in high resolution remote sensing based on deep learning

Abstract The multi-temporal high-resolution remote sensing (HRRS) images are usually acquired at different imaging angles, with serious noise interferences and obvious building shadows, so that detecting the changes of urban buildings is a problem. In order to address this challenge, a deep learning-based algorithm called ABCDHIDL is proposed to automatically detect the building changes from multi-temporal HRRS images. Firstly, an automatic selection method of labeled samples of building changes based on morphology (ASLSBCM) is proposed. Secondly, a deep learning model (DBN-ELM) for building changes detection based on deep belief network (DBN) and extreme learning machine (ELM) is proposed. A convolution operation is employed to extract the spectral, texture and spatial features and generate a combined low-level features vector for each pixel in the multi-temporal HRRS images. The unlabeled samples are introduced to pre-train the DBN, and the parameters of DBN-ELM are globally optimized by jointly using the ELM classifier and the labeled samples are offered by ASLSBCM to further improve the detection accuracy. In order to evaluate the performance of ABCDHIDL, four groups of double-temporal WorldView2 HRRS images in four different experimental regions are selected respectively as the test datasets, and five other representative methods are used and compared with ABCDHIDL in the experiments of buildings change detection. The results show that ABCDHIDL has higher accuracy and automation level than the other five methods despite its relatively higher time consumption.

[1]  Dengsheng Lu,et al.  Impervious surface mapping with Quickbird imagery , 2011, International journal of remote sensing.

[2]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[3]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[4]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[5]  Carlos Henggeler Antunes,et al.  Learning of a single-hidden layer feedforward neural network using an optimized extreme learning machine , 2014, Neurocomputing.

[6]  韩玲 Han Ling,et al.  High Spatial Resolution Remote Sensing Image Classification Based on Deep Learning , 2016 .

[7]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Ali Ozgun Ok,et al.  Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts , 2013 .

[9]  Maoguo Gong,et al.  Deep learning to classify difference image for image change detection , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[10]  A. Tzotsos,et al.  Change detection of buildings in suburban areas from high resolution satellite data developed through object based image analysis , 2013 .

[11]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[12]  Xu Han-qiu,et al.  A Study on Information Extraction of Water Body with the Modified Normalized Difference Water Index (MNDWI) , 2005, National Remote Sensing Bulletin.

[13]  Xia Fei,et al.  Remote Sensing Image Classification Based on DBN Model , 2014 .

[14]  Argyros Argyridis,et al.  Building change detection through multi-scale GEOBIA approach by integrating deep belief networks with fuzzy ontologies , 2016 .

[15]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[16]  Dong-Chen He,et al.  Automatic change detection of buildings in urban environment from very high spatial resolution images using existing geodatabase and prior knowledge , 2010 .

[17]  Xin Huang,et al.  A Multidirectional and Multiscale Morphological Index for Automatic Building Extraction from Multispectral GeoEye-1 Imagery , 2011 .

[18]  Yuan Xiu-xiao A Method for Shadow Detection and Change Detection of Man-made Objects , 2007 .

[19]  Huang Dexian,et al.  Melt index prediction of polypropylene based on DBN-ELM , 2016 .

[20]  Cem Ünsalan,et al.  Urban Area Detection Using Local Feature Points and Spatial Voting , 2010, IEEE Geoscience and Remote Sensing Letters.