Computer-Aided Approach for Rapid Post-Event Visual Evaluation of a Building Façade

After a disaster strikes an urban area, damage to the façades of a building may produce dangerous falling hazards that jeopardize pedestrians and vehicles. Thus, building façades must be rapidly inspected to prevent potential loss of life and property damage. Harnessing the capacity to use new vision sensors and associated sensing platforms, such as unmanned aerial vehicles (UAVs) would expedite this process and alleviate spatial and temporal limitations typically associated with human-based inspection in high-rise buildings. In this paper, we have developed an approach to perform rapid and accurate visual inspection of building façades using images collected from UAVs. An orthophoto corresponding to any reasonably flat region on the building (e.g., a façade or building side) is automatically constructed using a structure-from-motion (SfM) technique, followed by image stitching and blending. Based on the geometric relationship between the collected images and the constructed orthophoto, high-resolution region-of-interest are automatically extracted from the collected images, enabling efficient visual inspection. We successfully demonstrate the capabilities of the technique using an abandoned building of which a façade has damaged building components (e.g., window panes or external drainage pipes).

[1]  P. Axelrad,et al.  Gps Error Analysis , 1996 .

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[4]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[5]  Jonathan Miller,et al.  ROBOTIC SYSTEMS FOR INSPECTION AND SURVEILLANCE OF CIVIL STRUCTURES , 2004 .

[6]  S. S. Kim,et al.  Morphological analysis and classification of types of surface corrosion damage by digital image processing , 2005 .

[7]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[8]  K. Kraus Photogrammetry: Geometry from Images and Laser Scans , 2007 .

[9]  Jean-Philippe Pons,et al.  Seamless image-based texture atlases using multi-band blending , 2008, 2008 19th International Conference on Pattern Recognition.

[10]  Paul S Moller,et al.  CALTRANS Bridge Inspection Aerial Robot Final Report , 2008 .

[11]  Gaurav S. Sukhatme,et al.  A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures , 2009 .

[12]  Ramana M. Pidaparti,et al.  Classification of corrosion defects in NiAl bronze through image analysis , 2010 .

[13]  Fátima N. S. de Medeiros,et al.  On the Evaluation of Texture and Color Features for Nondestructive Corrosion Detection , 2010, EURASIP J. Adv. Signal Process..

[14]  Vikram Pakrashi,et al.  ROC dependent event isolation method for image processing based assessment of corroded harbour structures , 2010 .

[15]  Gaurav S. Sukhatme,et al.  Multi-image stitching and scene reconstruction for evaluating defect evolution in structures , 2011 .

[16]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[17]  Sangwook Lee,et al.  Wavelet domain detection of rust in steel bridge images , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Alessandro Palermo,et al.  Façade damage assessment of concrete buildings in the 2011 Christchurch earthquake , 2012 .

[19]  Sami F. Masri,et al.  Parametric Performance Evaluation of Wavelet-Based Corrosion Detection Algorithms for Condition Assessment of Civil Infrastructure Systems , 2013, J. Comput. Civ. Eng..

[20]  Changchang Wu,et al.  Critical Configurations for Radial Distortion Self-Calibration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Vikram Pakrashi,et al.  Regionally Enhanced Multiphase Segmentation Technique for Damaged Surfaces , 2014, Comput. Aided Civ. Infrastructure Eng..

[22]  S. Robson,et al.  Mitigating systematic error in topographic models derived from UAV and ground‐based image networks , 2014 .

[23]  Chul Min Yeum,et al.  Vision‐Based Automated Crack Detection for Bridge Inspection , 2015, Comput. Aided Civ. Infrastructure Eng..

[24]  Burcu Akinci,et al.  Towards the Integration of Inspection Data with Bridge Information Models to Support Visual Condition Assessment , 2015 .

[25]  Burcu Akinci,et al.  Evaluation and Comparison of Different Virtual Reality Environments towards Supporting Tasks Done on a Virtual Construction Site , 2016 .

[26]  Shirley J. Dyke,et al.  Autonomous image localization for visual inspection of civil infrastructure , 2017 .

[27]  Shirley J. Dyke,et al.  Image-Based Collection and Measurements for Construction Pay Items , 2017 .

[28]  David S. Bayard,et al.  Accurate and Robust Scene Reconstruction in the Presence of Misassociated Features for Aerial Sensing , 2017, J. Comput. Civ. Eng..

[29]  Mohammad R. Jahanshahi,et al.  Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection , 2018 .

[30]  Jian Li,et al.  Vision‐Based Fatigue Crack Detection of Steel Structures Using Video Feature Tracking , 2018, Comput. Aided Civ. Infrastructure Eng..

[31]  Won-Hwa Hong,et al.  Application of Crack Identification Techniques for an Aging Concrete Bridge Inspection Using an Unmanned Aerial Vehicle , 2018, Sensors.

[32]  B. F. Spencer,et al.  Structural Displacement Measurement Using an Unmanned Aerial System , 2018, Comput. Aided Civ. Infrastructure Eng..

[33]  Shirley J. Dyke,et al.  Automated region-of-interest localization and classification for vision-based visual assessment of civil infrastructure , 2019 .