TOWARDS POST-DISASTER DEBRIS IDENTIFICATION FOR PRECISE DAMAGE AND RECOVERY ASSESSMENTS FROM UAV AND SATELLITE IMAGES

Abstract. Often disasters cause structural damages and produce rubble and debris, depending on their magnitude and type. The initial disaster response activity is evaluation of the damages, i.e. creation of a detailed damage estimation for different object types throughout the affected area. First responders and government stakeholders require the damage information to plan rescue operations and later on to guide the recovery process. Remote sensing, due to its agile data acquisition capability, synoptic coverage and low cost, has long been used as a vital tool to collect information after a disaster and conduct damage assessment. To detect damages from remote sensing imagery (both UAV and satellite images) structural rubble/debris has been employed as a proxy to detect damaged buildings/areas. However, disaster debris often includes vegetation, sediments and relocated personal property in addition to structural rubble, i.e. items that are wind- or waterborne and not necessarily associated with the closest building. Traditionally, land cover classification-based damage detection has been categorizing debris as damaged areas. However, in particular in waterborne disaster such as tsunamis or storm surges, vast areas end up being debris covered, effectively hindering actual building damage to be detected, and leading to an overestimation of damaged area. Therefore, to perform a precise damage assessment, and consequently recovery assessment that relies on a clear damage benchmark, it is crucial to separate actual structural rubble from ephemeral debris. In this study two approaches were investigated for two types of data (i.e., UAV images, and multi-temporal satellite images). To do so, three textural analysis, i.e., Gabor filters, Local Binary Pattern (LBP), and Histogram of the Oriented Gradients (HOG), were implemented on mosaic UAV images, and the relation between debris type and their time of removal was investigated using very high-resolution satellite images. The results showed that the HOG features, among other texture features, have the potential to be used for debris identification. In addition, multi-temporal satellite image analysis showed that debris removal time needs to be investigated using daily images, because the removal time of debris may change based on the type of disaster and its location.

[1]  Monika Kuffer,et al.  Extraction of Slum Areas From VHR Imagery Using GLCM Variance , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  S. Radhika,et al.  Use of post-storm images for automated tornado-borne debris path identification using texture-wavelet analysis , 2012 .

[4]  T. Tadono,et al.  Land cover changes induced by the great east Japan earthquake in 2011 , 2017, Scientific Reports.

[5]  Fang Xu,et al.  Ship detection and extraction using visual saliency and histogram of oriented gradient , 2016 .

[6]  George Vosselman,et al.  SATELLITE IMAGE CLASSIFICATION OF BUILDING DAMAGES USING AIRBORNE AND SATELLITE IMAGE SAMPLES IN A DEEP LEARNING APPROACH , 2018 .

[7]  Arivazhagan Selvaraj,et al.  Texture classification using Gabor wavelets based rotation invariant features , 2006, Pattern Recognit. Lett..

[8]  L. Ruiz,et al.  TEXTURE FEATURE EXTRACTION FOR CLASSIFICATION OF REMOTE SENSING DATA USING WAVELET DECOMPOSITION : A COMPARATIVE STUDY , 2004 .

[9]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  F. Giulio Tonolo,et al.  Building damage assessment scale tailored to remote sensing vertical imagery , 2018 .

[11]  George Vosselman,et al.  Identification of Structurally Damaged Areas in Airborne Oblique Images Using a Visual-Bag-of-Words Approach , 2016, Remote. Sens..

[12]  Weisheng Wang,et al.  A Study for Texture Feature Extraction of High-Resolution Satellite Images Based on a Direction Measure and Gray Level Co-Occurrence Matrix Fusion Algorithm , 2017, Sensors.

[13]  Keiko Saito,et al.  Indicators for Measuring , Monitoring and Evaluating Post-Disaster Recovery , 2008 .

[14]  Zhifeng Xiao,et al.  Elliptic Fourier transformation-based histograms of oriented gradients for rotationally invariant object detection in remote-sensing images , 2015 .

[15]  Shashidhar G. Koolagudi,et al.  Damage identification and assessment using image processing on post-disaster satellite imagery , 2017, 2017 IEEE Global Humanitarian Technology Conference (GHTC).

[16]  Monika Kuffer,et al.  Slums from Space - 15 Years of Slum Mapping Using Remote Sensing , 2016, Remote. Sens..

[17]  Norman Kerle,et al.  Collaborative damage mapping for emergency response: the role of Cognitive Systems Engineering , 2013 .

[18]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[19]  A. Vetrivel,et al.  Identification of damage in buildings based on gaps in 3D point clouds from very high resolution oblique airborne images , 2015 .

[20]  Alfred Stein,et al.  Detection of Informal Settlements from VHR Images Using Convolutional Neural Networks , 2017, Remote. Sens..

[21]  George Vosselman,et al.  Classification of informal settlements through the integration of 2D and 3D features extracted from UAV data , 2016 .

[22]  Feng Gao,et al.  Aircraft Detection from VHR Images Based on Circle-Frequency Filter and Multilevel Features , 2013, TheScientificWorldJournal.

[23]  R. Dwivedi,et al.  Textural analysis of IRS-1D panchromatic data for land cover classification , 2002 .

[24]  Xinkai Wu,et al.  A Hybrid Vehicle Detection Method Based on Viola-Jones and HOG + SVM from UAV Images , 2016, Sensors.

[25]  Norman Kerle,et al.  UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning , 2014 .

[26]  J. Shan,et al.  Building Extraction and Rubble Mapping for City Port-au-Prince Post-2010 Earthquake with GeoEye-1 Imagery and Lidar Data , 2011 .

[27]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  George Vosselman,et al.  Multi-Resolution Feature Fusion for Image Classification of Building Damages with Convolutional Neural Networks , 2018, Remote. Sens..

[29]  D. He,et al.  Texture analysis of IKONOS satellite imagery for urban land use and land cover classification , 2010 .

[30]  Norman Kerle,et al.  Remote Sensing-Based Proxies for Urban Disaster Risk Management and Resilience: A Review , 2018, Remote. Sens..

[31]  A. Vetrivel,et al.  Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[32]  T. Gillespie,et al.  Assessment and prediction of natural hazards from satellite imagery , 2007, Progress in physical geography.