Towards a more efficient detection of earthquake induced façade damages using oblique UAV imagery.

Abstract. Urban search and rescue (USaR) teams require a fast and thorough building damage assessment, to focus their rescue efforts accordingly. Unmanned aerial vehicles (UAV) are able to capture relevant data in a short time frame and survey otherwise inaccessible areas after a disaster, and have thus been identified as useful when coupled with RGB cameras for facade damage detection. Existing literature focuses on the extraction of 3D and/or image features as cues for damage. However, little attention has been given to the efficiency of the proposed methods which hinders its use in an urban search and rescue context. The framework proposed in this paper aims at a more efficient facade damage detection using UAV multi-view imagery. This was achieved directing all damage classification computations only to the image regions containing the facades, hence discarding the irrelevant areas of the acquired images and consequently reducing the time needed for such task. To accomplish this, a three-step approach is proposed: i) building extraction from the sparse point cloud computed from the nadir images collected in an initial flight; ii) use of the latter as proxy for facade location in the oblique images captured in subsequent flights, and iii) selection of the facade image regions to be fed to a damage classification routine. The results show that the proposed framework successfully reduces the extracted facade image regions to be assessed for damage 6 fold, hence increasing the efficiency of subsequent damage detection routines. The framework was tested on a set of UAV multi-view images over a neighborhood of the city of L’Aquila, Italy, affected in 2009 by an earthquake.

[1]  Herbert Freeman,et al.  Determining the minimum-area encasing rectangle for an arbitrary closed curve , 1975, CACM.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Edward M. Riseman,et al.  A Fast Line Finder for Vision-Guided Robot Navigation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  P. Axelsson DEM Generation from Laser Scanner Data Using Adaptive TIN Models , 2000 .

[5]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[6]  Franz Leberl,et al.  Window detection in complex facades , 2010, 2010 2nd European Workshop on Visual Information Processing (EUVIP).

[7]  Diego González-Aguilera,et al.  Terrestrial laser scanning intensity data applied to damage detection for historical buildings , 2010 .

[8]  F. Dell’acqua,et al.  Post-event Only VHR Radar Satellite Data for Automated Damage Assessment , 2011 .

[9]  M. Gerke,et al.  Automatic Structural Seismic Damage Assessment with Airborne Oblique Pictometry© Imagery , 2011 .

[10]  Paolo Gamba,et al.  Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives , 2012, Proceedings of the IEEE.

[11]  George Vosselman,et al.  Automated planimetric quality control in high accuracy airborne laser scanning surveys , 2012 .

[12]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jianwen Ma,et al.  Automatic depicting algorithm of earthquake collapsed buildings with airborne high resolution image , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[14]  Jie Shan,et al.  A comprehensive review of earthquake-induced building damage detection with remote sensing techniques , 2013 .

[15]  Sudan Xu,et al.  Segment-Based Classification of Damaged Building Roofs in Aerial Laser Scanning Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[16]  Qingquan Li,et al.  A Novel 3D Building Damage Detection Method Using Multiple Overlapping UAV Images , 2014 .

[17]  Norman Kerle,et al.  UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning , 2014 .

[18]  L. Klingbeil,et al.  A PRECISE DIRECT GEOREFERENCING SYSTEM FOR UAVS , 2014 .

[19]  Masahiko Nagai,et al.  Discovering repetitive patterns in facade images using a RANSAC-style algorithm , 2014 .

[20]  Francesca Bovolo,et al.  Building Change Detection in Multitemporal Very High Resolution SAR Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[22]  Masashi Matsuoka,et al.  A Method for Detecting Buildings Destroyed by the 2011 Tohoku Earthquake and Tsunami Using Multitemporal TerraSAR-X Data , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  A. Vetrivel,et al.  POTENTIAL OF MULTI-TEMPORAL OBLIQUE AIRBORNE IMAGERY FOR STRUCTURAL DAMAGE ASSESSMENT , 2016 .

[24]  George Vosselman,et al.  Identification of Structurally Damaged Areas in Airborne Oblique Images Using a Visual-Bag-of-Words Approach , 2016, Remote. Sens..

[25]  Shao-Yi Chien,et al.  Real-Time Salient Object Detection with a Minimum Spanning Tree , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[27]  A. Vetrivel,et al.  Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.