UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning

Abstract. Structural damage assessment is critical after disasters but remains a challenge. Many studies have explored the potential of remote sensing data, but limitations of vertical data persist. Oblique imagery has been identified as more useful, though the multi-angle imagery also adds a new dimension of complexity. This paper addresses damage assessment based on multi-perspective, overlapping, very high resolution oblique images obtained with unmanned aerial vehicles (UAVs). 3-D point-cloud assessment for the entire building is combined with detailed object-based image analysis (OBIA) of facades and roofs. This research focuses not on automatic damage assessment, but on creating a methodology that supports the often ambiguous classification of intermediate damage levels, aiming at producing comprehensive per-building damage scores. We identify completely damaged structures in the 3-D point cloud, and for all other cases provide the OBIA-based damage indicators to be used as auxiliary information by damage analysts. The results demonstrate the usability of the 3-D point-cloud data to identify major damage features. Also the UAV-derived and OBIA-processed oblique images are shown to be a suitable basis for the identification of detailed damage features on facades and roofs. Finally, we also demonstrate the possibility of aggregating the multi-perspective damage information at building level.

[1]  Hajime Mitomi,et al.  Automated damage detection of buildings from aerial television images of the 2001 Gujarat, India earthquake , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[2]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[3]  Kenzo Nonami,et al.  Autonomous Flying Robots , 2010 .

[4]  Peijun Li,et al.  Urban building damage detection from very high resolution imagery using OCSVM and spatial features , 2010 .

[5]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[6]  G. Grünthal European macroseismic scale 1998 : EMS-98 , 1998 .

[7]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[8]  Norman Kerle,et al.  Collaborative damage mapping for emergency response: the role of Cognitive Systems Engineering , 2013 .

[9]  Stuart P. D. Gill,et al.  A Comprehensive Analysis of Building Damage in the 12 January 2010 Mw7 Haiti Earthquake Using High-Resolution Satellite and Aerial Imagery , 2011 .

[10]  C. A. English Rapid Damage , 1981, Nature.

[11]  Alberto Bernardini,et al.  Field Manual for post-earthquake damage and safety assessment and short term countermeasures ( AeDES ) , 2007 .

[12]  Norman Kerle,et al.  Graph matching in 3D space for structural seismic damage assessment , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[13]  Norman Kerle,et al.  Multi - scale texture and color segmentation of oblique airborne video data for damage classification , 2006 .

[14]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Hans-Peter Bähr,et al.  An Approach for the Detection of Damages in Buildings from Digital Aerial Information , 1999 .

[16]  André Twele,et al.  Rapid Damage Assessment and Situation Mapping: Learning from the 2010 Haiti Earthquake , 2011 .

[17]  Tapas Ranjan Martha,et al.  Segment Optimization and Data-Driven Thresholding for Knowledge-Based Landslide Detection by Object-Based Image Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Marjorie Greene,et al.  Crowdsourcing earthquake damage assessment using remote sensing imagery , 2012 .

[19]  Norbert Pfeifer,et al.  Real - time data collection and information generation using airborne sensors , 2008 .

[20]  Huadong Guo,et al.  Identifying damage caused by the 2008 Wenchuan earthquake from VHR remote sensing data , 2009, Int. J. Digit. Earth.

[21]  S. J. Oude Elberink,et al.  Detection of collapsed buildings by classifying segmented airborne laser scanner data. , 2012 .

[22]  Farhad Samadzadegan,et al.  A fuzzy decision making system for building damage map creation using high resolution satellite imagery , 2013 .

[23]  N. Kerle,et al.  Satellite remote sensing for near - real time data collection , 2008 .

[24]  M. Matsuoka,et al.  REMOTE SENSING TECHNOLOGIES IN POST-DISASTER DAMAGE ASSESSMENT , 2007 .

[25]  M. Gerke,et al.  Automatic Structural Seismic Damage Assessment with Airborne Oblique Pictometry© Imagery , 2011 .

[26]  André Stumpf,et al.  Object-oriented mapping of landslides using Random Forests , 2011 .

[27]  Paolo Gamba,et al.  Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives , 2012, Proceedings of the IEEE.

[28]  Boris Jutzi,et al.  Feature relevance assessment for the semantic interpretation of 3D point cloud data , 2013 .

[29]  Sudan Xu,et al.  Segment-Based Classification of Damaged Building Roofs in Aerial Laser Scanning Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[30]  Ping Lu,et al.  Object-Oriented Change Detection for Landslide Rapid Mapping , 2011, IEEE Geoscience and Remote Sensing Letters.

[31]  Norman Kerle,et al.  Satellite-based damage mapping following the 2006 Indonesia earthquake - How accurate was it? , 2010, Int. J. Appl. Earth Obs. Geoinformation.