Vision-based Structural Inspection using Multiscale Deep Convolutional Neural Networks

Current methods of practice for inspection of civil infrastructure typically involve visual assessments conducted manually by trained inspectors. For post-earthquake structural inspections, the number of structures to be inspected often far exceeds the capability of the available inspectors. The labor intensive and time consuming natures of manual inspection have engendered research into development of algorithms for automated damage identification using computer vision techniques. In this paper, a novel damage localization and classification technique based on a state of the art computer vision algorithm is presented to address several key limitations of current computer vision techniques. The proposed algorithm carries out a pixel-wise classification of each image at multiple scales using a deep convolutional neural network and can recognize 6 different types of damage. The resulting output is a segmented image where the portion of the image representing damage is outlined and classified as one of the trained damage categories. The proposed method is evaluated in terms of pixel accuracy and the application of the method to real world images is shown.

[1]  Yan Liu,et al.  Deep residual learning for image steganalysis , 2018, Multimedia Tools and Applications.

[2]  Khurram Kamal,et al.  Pavement crack detection using the Gabor filter , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[3]  Shirley J. Dyke,et al.  Autonomous image localization for visual inspection of civil infrastructure , 2017 .

[4]  Yong Hu,et al.  A novel LBP based methods for pavement crack detection , 2009 .

[5]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[6]  Chul Min Yeum,et al.  Computer vision-based structural assessment exploiting large volumes of images , 2016 .

[7]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[9]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[10]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[11]  Francisco Bonnin-Pascual,et al.  Corrosion Detection for Automated Visual Inspection , 2014 .

[12]  Reginald DesRoches,et al.  Automated Damage Index Estimation of Reinforced Concrete Columns for Post-Earthquake Evaluations , 2015 .

[13]  Pedro Rojas,et al.  Performance of Low-rise Reinforced Concrete Buildings in the 2016 Ecuador Earthquake , 2017 .

[14]  Ashutosh Bagchi,et al.  A Study of Image-Based Element Condition Index for Bridge Inspection , 2013 .

[15]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[16]  B. F. Spencer,et al.  Vision-based Automated Bridge Component Recognition Integrated With High-level Scene Understanding , 2018, ArXiv.

[17]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[18]  Mani Golparvar-Fard,et al.  Image-Based Automated 3D Crack Detection for Post-disaster Building Assessment , 2014, J. Comput. Civ. Eng..

[19]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[20]  Gaurav S. Sukhatme,et al.  A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures , 2009 .

[21]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yun Liu,et al.  Automatic Crack Detection and Classification Method for Subway Tunnel Safety Monitoring , 2014, Sensors.

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Shuji Hashimoto,et al.  Fast crack detection method for large-size concrete surface images using percolation-based image processing , 2010, Machine Vision and Applications.

[25]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[26]  Chul Min Yeum,et al.  Vision‐Based Automated Crack Detection for Bridge Inspection , 2015, Comput. Aided Civ. Infrastructure Eng..

[27]  Luh-Maan Chang,et al.  Support-vector-machine-based method for automated steel bridge rust assessment , 2012 .