Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete

Abstract This paper compares the performance of common edge detectors and deep convolutional neural networks (DCNN) for image-based crack detection in concrete structures. A dataset of 19 high definition images (3420 sub-images, 319 with cracks and 3101 without) of concrete is analyzed using six common edge detection schemes (Roberts, Prewitt, Sobel, Laplacian of Gaussian, Butterworth, and Gaussian) and using the AlexNet DCNN architecture in fully trained, transfer learning, and classifier modes. The relative performance of each crack detection method is compared here for the first time on a single dataset. Edge detection methods accurately detected 53–79% of cracked pixels, but they produced residual noise in the final binary images. The best of these methods was useful in detecting cracks wider than 0.1 mm. DCNNs were used to label images, and accurately labeled them with 99% accuracy. In transfer learning mode, the network accurately detected about 86% of cracked images. DCNNs also detected much finer cracks than edge detection methods. In fully trained and classifier modes, the network detected cracks wider than 0.08 mm; in transfer learning mode, the network was able to detect cracks wider than 0.04 mm. Computational times for DCNN are shorter than the most efficient edge detection algorithms, not considering the training process. These results show significant promise for future adoption of DCNN methods for image-based damage detection in concrete. To reduce the residual noise, a hybrid method was proposed by combining the DCNN and edge detectors which reduced the noise by a factor of 24.

[1]  Arvin Ebrahimkhanlou,et al.  Single-Sensor Acoustic Emission Source Localization in Plate-Like Structures Using Deep Learning , 2018 .

[2]  Dulcy M. Abraham,et al.  Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks , 2018, Automation in Construction.

[3]  Reginald DesRoches,et al.  Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments , 2012, Adv. Eng. Informatics.

[4]  Hui Li,et al.  Computer vision and deep learning–based data anomaly detection method for structural health monitoring , 2019 .

[5]  Devin K. Harris,et al.  Combined Imaging Technologies for Concrete Bridge Deck Condition Assessment , 2015 .

[6]  Yang Liu,et al.  Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep‐Learning Network , 2017, Comput. Aided Civ. Infrastructure Eng..

[7]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[8]  Derek Hoiem,et al.  Learning without Forgetting , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Salvatore Salamone,et al.  Multifractal analysis of crack patterns in reinforced concrete shear walls , 2016 .

[10]  Sumathi Poobal,et al.  Crack detection using image processing: A critical review and analysis , 2017, Alexandria Engineering Journal.

[11]  Sung-Han Sim,et al.  Comparative analysis of image binarization methods for crack identification in concrete structures , 2017 .

[12]  Guomin Zhang,et al.  A method of detecting the cracks of concrete undergo high-temperature , 2018 .

[13]  Mohammad R. Jahanshahi,et al.  Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection , 2018 .

[14]  Robert J. Thomas,et al.  SDNET2018: A concrete crack image dataset for machine learning applications , 2018 .

[15]  Sofiane Amziane,et al.  Flexural cracking behavior of normal strength, high strength and high strength fiber concrete beams, using Digital Image Correlation technique , 2016 .

[16]  Vikram Pakrashi,et al.  Texture Analysis Based Damage Detection of Ageing Infrastructural Elements , 2013, Comput. Aided Civ. Infrastructure Eng..

[17]  Calvin Coopmans,et al.  Fatigue Crack Detection Using Unmanned Aerial Systems in Under-Bridge Inspection , 2017 .

[18]  Askoldas Podviezko,et al.  Processing Digital Images for Crack Localization in Reinforced Concrete Members , 2015 .

[19]  Shuji Hashimoto,et al.  Image‐Based Crack Detection for Real Concrete Surfaces , 2008 .

[20]  Dongho Kang,et al.  Autonomous UAVs for Structural Health Monitoring Using Deep Learning and an Ultrasonic Beacon System with Geo‐Tagging , 2018, Comput. Aided Civ. Infrastructure Eng..

[21]  Ivan Bartoli,et al.  Bridge related damage quantification using unmanned aerial vehicle imagery , 2016 .

[22]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[23]  Xiaojun Qi,et al.  Automatic Surface Crack Detection in Concrete Structures Using OTSU Thresholding and Morphological Operations , 2016 .

[24]  Hoon Sohn,et al.  Automated detection of delamination and disbond from wavefield images obtained using a scanning laser vibrometer , 2011 .

[25]  Jeong Ho Lee,et al.  Bridge inspection robot system with machine vision , 2009 .

[26]  Aboelmagd Noureldin,et al.  Wavelet Transform for Structural Health Monitoring: A Compendium of Uses and Features , 2006 .

[27]  Moncef L. Nehdi,et al.  Remote sensing of concrete bridge decks using unmanned aerial vehicle infrared thermography , 2017 .

[28]  Nenad Gucunski,et al.  Delamination and concrete quality assessment of concrete bridge decks using a fully autonomous RABIT platform , 2015 .

[29]  Fan Xi,et al.  Detection crack in image using Otsu method and multiple filtering in image processing techniques , 2016 .

[30]  Tarek Hamel,et al.  A UAV for bridge inspection: Visual servoing control law with orientation limits , 2007 .

[31]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[32]  Abdenour Nazef,et al.  Improvement of Crack-Detection Accuracy Using a Novel Crack Defragmentation Technique in Image-Based Road Assessment , 2016 .

[33]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[34]  Dongho Kang,et al.  Damage detection with an autonomous UAV using deep learning , 2018, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[35]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[36]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[37]  Weihua Sheng,et al.  A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance , 2014, IEEE Transactions on Automation Science and Engineering.

[38]  Sami F. Masri,et al.  Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures , 2012 .