Improved CNN Classification Method for Groups of Buildings Damaged by Earthquake, Based on High Resolution Remote Sensing Images

Effective extraction of disaster information of buildings from remote sensing images is of great importance to supporting disaster relief and casualty reduction. In high-resolution remote sensing images, object-oriented methods present problems such as unsatisfactory image segmentation and difficult feature selection, which makes it difficult to quickly assess the damage sustained by groups of buildings. In this context, this paper proposed an improved Convolution Neural Network (CNN) Inception V3 architecture combining remote sensing images and block vector data to evaluate the damage degree of groups of buildings in post-earthquake remote sensing images. By using CNN, the best features can be automatically selected, solving the problem of difficult feature selection. Moreover, block boundaries can form a meaningful boundary for groups of buildings, which can effectively replace image segmentation and avoid its fragmentary and unsatisfactory results. By adding Separate and Combination layers, our method improves the Inception V3 network for easier processing of large remote sensing images. The method was tested by the classification of damaged groups of buildings in 0.5 m-resolution aerial imagery after the earthquake of Yushu. The test accuracy was 90.07% with a Kappa Coefficient of 0.81, and, compared with the traditional multi-feature machine learning classifier constructed by artificial feature extraction, this represented an improvement of 18% in accuracy. Our results showed that this improved method could effectively extract the damage degree of groups of buildings in each block in post-earthquake remote sensing images.

[1]  Paolo Gamba,et al.  Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives , 2012, Proceedings of the IEEE.

[2]  Ali Mohammadzadeh,et al.  Building Damage Detection Using Object-Based Image Analysis and ANFIS From High-Resolution Image (Case Study: BAM Earthquake, Iran) , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[4]  Qiang Li,et al.  Earthquake building damage detection with object-oriented change detection , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Ali Mohammadzadeh,et al.  A Fuzzy-GA Based Decision Making System for Detecting Damaged Buildings from High-Spatial Resolution Optical Images , 2017, Remote. Sens..

[7]  Cao Dai,et al.  STUDY ON THE STATISTICAL CHARACTERISTICS OF SEISMIC DISASTER INFORMATION OF BUILDING IN REMOTE SENSING IMAGE , 2001 .

[8]  Qi Wen,et al.  Building losses assessment for Lushan earthquake utilization multisource remote sensing data and GIS , 2015, International Symposium on Multispectral Image Processing and Pattern Recognition.

[9]  Guo Zheng-zhang Rapid assessment of earthquake damage to buildings based on object-oriented classification , 2011 .

[10]  F. Samadzadegan,et al.  AUTOMATIC DETECTION AND CLASSIFICATION OF DAMAGED BUILDINGS , USING HIGH RESOLUTION SATELLITE IMAGERY AND VECTOR DATA , 2008 .

[11]  Purvil Bambharolia OVERVIEW OF CONVOLUTIONAL NEURAL NETWORKS , 2017 .

[12]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[13]  Manfred F. Buchroithner,et al.  Identifying Collapsed Buildings Using Post-Earthquake Satellite Imagery and Convolutional Neural Networks: A Case Study of the 2010 Haiti Earthquake , 2018, Remote. Sens..

[14]  Jie Shan,et al.  A comprehensive review of earthquake-induced building damage detection with remote sensing techniques , 2013 .

[15]  Chunlin Huang,et al.  Building Earthquake Damage Information Extraction from a Single Post-Earthquake PolSAR Image , 2016, Remote. Sens..

[16]  George Vosselman,et al.  SATELLITE IMAGE CLASSIFICATION OF BUILDING DAMAGES USING AIRBORNE AND SATELLITE IMAGE SAMPLES IN A DEEP LEARNING APPROACH , 2018 .

[17]  Dou Ai-xia Building damage detection of the 2008 Wenchuan,China earthquake Based on Object-oriented Classification Method , 2009 .

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[23]  Xiaoqing Wang,et al.  THE EXTRACTION OF POST-EARTHQUAKE BUILDING DAMAGE INFORMATIOM BASED ON CONVOLUTIONAL NEURAL NETWORK , 2018 .

[24]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Dou Ai Study on loss assessment of construction earthquake damage based on remote sensing and GIS , 2007 .

[26]  Aydan Menderes,et al.  Automatic Detection of Damaged Buildings after Earthquake Hazard by Using Remote Sensing and Information Technologies , 2015 .