Zernike‐moment measurement of thin‐crack width in images enabled by dual‐scale deep learning

Although crack inspection is a routine practice in civil infrastructure management (especially for highway bridge structures), it is time‐consuming and safety‐concerning to trained engineers and costly to the stakeholders. To automate this in the near future, the algorithmic challenge at the onset is to detect and localize cracks in imagery data with complex scenes. The rise of deep learning (DL) sheds light on overcoming this challenge through learning from imagery big data. However, how to exploit DL techniques is yet to be fully explored. One primary component of practical crack inspection is that it is not merely detection via visual recognition. To evaluate the potential risk of structural failure, it entails quantitative characterization, which usually includes crack width measurement. To further facilitate the automation of machine‐vision‐based concrete crack inspection, this article proposes a DL‐enabled quantitative crack width measurement method. In the detection and mapping phase, dual‐scale convolutional neural networks are designed to detect cracks in complex scene images with validated high accuracy. Subsequently, a novel crack width estimation method based on the use of Zernike moment operator is further developed for thin cracks. The experimental results based on a laboratory loading test agree well with the direct measurements, which substantiates the effectiveness of the proposed method for quantitative crack detection.

[1]  Hossein Hashemi,et al.  End‐to‐End Deep Learning Methodology for Real‐Time Traffic Network Management , 2018, Comput. Aided Civ. Infrastructure Eng..

[2]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[3]  Yang Liu,et al.  Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces with a Recurrent Neural Network , 2018, Comput. Aided Civ. Infrastructure Eng..

[4]  Yicheng Li,et al.  A Fast Detection Method via Region‐Based Fully Convolutional Neural Networks for Shield Tunnel Lining Defects , 2018, Comput. Aided Civ. Infrastructure Eng..

[5]  Kelvin C. P. Wang,et al.  Pavement Crack Width Measurement Based on Laplace's Equation for Continuity and Unambiguity , 2018, Comput. Aided Civ. Infrastructure Eng..

[6]  Hojjat Adeli,et al.  A novel unsupervised deep learning model for global and local health condition assessment of structures , 2018 .

[7]  Yi-Zhou Lin,et al.  Structural Damage Detection with Automatic Feature‐Extraction through Deep Learning , 2017, Comput. Aided Civ. Infrastructure Eng..

[8]  Yang Liu,et al.  Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep‐Learning Network , 2017, Comput. Aided Civ. Infrastructure Eng..

[9]  ZhiQiang Chen,et al.  Level-of-detail Assessment of Structural Surface Damage using Spatially Sequential Stereo Images and Deep Learning Methods , 2017 .

[10]  Sung-Han Sim,et al.  Comparative analysis of image binarization methods for crack identification in concrete structures , 2017 .

[11]  Hadi Meidani,et al.  Deep Learning for Accelerated Seismic Reliability Analysis of Transportation Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[12]  Hojjat Adeli,et al.  A novel machine learning‐based algorithm to detect damage in high‐rise building structures , 2017 .

[13]  Gang Li,et al.  Recognition and evaluation of bridge cracks with modified active contour model and greedy search-based support vector machine , 2017 .

[14]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[15]  Rih-Teng Wu,et al.  A texture‐Based Video Processing Methodology Using Bayesian Data Fusion for Autonomous Crack Detection on Metallic Surfaces , 2017, Comput. Aided Civ. Infrastructure Eng..

[16]  Hojjat Adeli,et al.  Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete , 2017 .

[17]  Gang Wu,et al.  Vibration and Deformation Monitoring of a Long-Span Rigid-Frame Bridge with Distributed Long-Gauge Sensors , 2017 .

[18]  Jian Zhang,et al.  In-Service Condition Assessment of a Long-Span Suspension Bridge Using Temperature-Induced Strain Data , 2017 .

[19]  C. Leung,et al.  An improved image processing method for assessing multiple cracking development in Strain Hardening Cementitious Composites (SHCC) , 2016 .

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  J. Zhang,et al.  Mobile Impact Testing for Structural Flexibility Identification with only a Single Reference , 2015, Comput. Aided Civ. Infrastructure Eng..

[22]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[25]  Vikram Pakrashi,et al.  Regionally Enhanced Multiphase Segmentation Technique for Damaged Surfaces , 2014, Comput. Aided Civ. Infrastructure Eng..

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[28]  Eduardo Zalama Casanova,et al.  Road Crack Detection Using Visual Features Extracted by Gabor Filters , 2014, Comput. Aided Civ. Infrastructure Eng..

[29]  Xiaoming Sun,et al.  A Pavement Crack Detection Method Combining 2D with 3D Information Based on Dempster‐Shafer Theory , 2014, Comput. Aided Civ. Infrastructure Eng..

[30]  Jian Zhang,et al.  Advanced Markov Chain Monte Carlo Approach for Finite Element Calibration under Uncertainty , 2013, Comput. Aided Civ. Infrastructure Eng..

[31]  M. Rucka,et al.  Experimental Study on Ultrasonic Monitoring of Splitting Failure in Reinforced Concrete , 2013 .

[32]  Jian Zhang,et al.  Experimental Vibration Analysis for Structural Identification of a Long-Span Suspension Bridge , 2013 .

[33]  S. Masri,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2013, Machine Vision and Applications.

[34]  Yozo Fujino,et al.  Concrete Crack Detection by Multiple Sequential Image Filtering , 2012, Comput. Aided Civ. Infrastructure Eng..

[35]  Zhiqiang Chen,et al.  A texture-based method for classifying cracked concrete surfaces from digital images using neural networks , 2011, The 2011 International Joint Conference on Neural Networks.

[36]  Masayasu Ohtsu,et al.  Crack classification in concrete based on acoustic emission , 2010 .

[37]  Ezzatollah Salari,et al.  Beamlet Transform‐Based Technique for Pavement Crack Detection and Classification , 2010, Comput. Aided Civ. Infrastructure Eng..

[38]  Shanq-Jang Ruan,et al.  Adaptive thresholding algorithm: Efficient computation technique based on intelligent block detection for degraded document images , 2010, Pattern Recognit..

[39]  Tara C. Hutchinson,et al.  Image-Based Framework for Concrete Surface Crack Monitoring and Quantification , 2010 .

[40]  Paulo Lobato Correia,et al.  Automatic road crack segmentation using entropy and image dynamic thresholding , 2009, 2009 17th European Signal Processing Conference.

[41]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Chih-Hung Chiang,et al.  Defect detection of concrete structures using both infrared thermography and elastic waves , 2008 .

[43]  Shuji Hashimoto,et al.  Image‐Based Crack Detection for Real Concrete Surfaces , 2008 .

[44]  ZhiQiang Chen,et al.  Application of PDE methods for image-based concrete surface damage detection , 2007, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[45]  Yoshihiko Hamamoto,et al.  A Method for Crack Detection on a Concrete Structure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[46]  Shivprakash Iyer,et al.  Segmentation of Pipe Images for Crack Detection in Buried Sewers , 2006, Comput. Aided Civ. Infrastructure Eng..

[47]  Yun Mook Lim,et al.  Monitoring Crack Changes in Concrete Structures , 2005 .

[48]  Byoung Jik Lee,et al.  Position‐Invariant Neural Network for Digital Pavement Crack Analysis , 2004 .

[49]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[50]  Benjamin A. Graybeal,et al.  Visual Inspection of Highway Bridges , 2002 .

[51]  Sugata Ghosal,et al.  Orthogonal moment operators for subpixel edge detection , 1993, Pattern Recognit..

[52]  Billie F. Spencer,et al.  Concrete Crack Assessment Using Digital Image Processing and 3D Scene Reconstruction , 2016, J. Comput. Civ. Eng..

[53]  Agustín Trujillo-Pino,et al.  Accurate subpixel edge location based on partial area effect , 2013, Image Vis. Comput..

[54]  Pradeep Kumar,et al.  Flaw detection in radiographic weldment images using morphological watershed segmentation technique , 2009 .

[55]  D. Powers Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation , 2008 .

[56]  Qu Ying-Dong,et al.  A fast subpixel edge detection method using Sobel-Zernike moments operator , 2005, Image Vis. Comput..

[57]  N. Otsu A threshold selection method from gray level histograms , 1979 .