Performance Evaluation of Deep CNN-Based Crack Detection and Localization Techniques for Concrete Structures

This paper proposes a customized convolutional neural network for crack detection in concrete structures. The proposed method is compared to four existing deep learning methods based on training data size, data heterogeneity, network complexity, and the number of epochs. The performance of the proposed convolutional neural network (CNN) model is evaluated and compared to pretrained networks, i.e., the VGG-16, VGG-19, ResNet-50, and Inception V3 models, on eight datasets of different sizes, created from two public datasets. For each model, the evaluation considered computational time, crack localization results, and classification measures, e.g., accuracy, precision, recall, and F1-score. Experimental results demonstrated that training data size and heterogeneity among data samples significantly affect model performance. All models demonstrated promising performance on a limited number of diverse training data; however, increasing the training data size and reducing diversity reduced generalization performance, and led to overfitting. The proposed customized CNN and VGG-16 models outperformed the other methods in terms of classification, localization, and computational time on a small amount of data, and the results indicate that these two models demonstrate superior crack detection and localization for concrete structures.

[1]  Robert J. Thomas,et al.  Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete , 2018, Construction and Building Materials.

[2]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[3]  Zheng Liu,et al.  Classification of defects with ensemble methods in the automated visual inspection of sewer pipes , 2015, Pattern Analysis and Applications.

[4]  Robert J. Thomas,et al.  SDNET2018: An annotated image dataset for non-contact concrete crack detection using deep convolutional neural networks , 2018, Data in brief.

[5]  Paul Fieguth,et al.  Automated detection of cracks in buried concrete pipe images , 2006 .

[6]  David C. Hogg,et al.  Deeper Networks for Pavement Crack Detection , 2017 .

[7]  Khalid M. Mosalam,et al.  Deep Transfer Learning for Image‐Based Structural Damage Recognition , 2018, Comput. Aided Civ. Infrastructure Eng..

[8]  Qingquan Li,et al.  FoSA: F* Seed-growing Approach for crack-line detection from pavement images , 2011, Image Vis. Comput..

[9]  Jin H. Huang,et al.  Detection of cracks using neural networks and computational mechanics , 2002 .

[10]  Lu Sun,et al.  Sealed-Crack Detection Algorithm Using Heuristic Thresholding Approach , 2016, J. Comput. Civ. Eng..

[11]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[12]  Yi Wang,et al.  Automatic Bridge Crack Detection Using a Convolutional Neural Network , 2019, Applied Sciences.

[13]  S. Hashimoto,et al.  An efficient crack detection method using percolation-based image processing , 2008, 2008 3rd IEEE Conference on Industrial Electronics and Applications.

[14]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[15]  Marek Słoński A comparison of deep convolutional neural networks for image-based detection of concrete surface cracks , 2019 .

[16]  MengChu Zhou,et al.  Generating Highly Accurate Predictions for Missing QoS Data via Aggregating Nonnegative Latent Factor Models , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Dong Yang,et al.  Aurora image search with contextual CNN feature , 2017, Neurocomputing.

[20]  Hyoungkwan Kim,et al.  A Deep Residual Network with Transfer Learning for Pixel-level Road Crack Detection , 2018, Proceedings of the 35th International Symposium on Automation and Robotics in Construction (ISARC).

[21]  Yang Liu,et al.  Deep Learning-Based Fully Automated Pavement Crack Detection on 3D Asphalt Surfaces with an Improved CrackNet , 2018, J. Comput. Civ. Eng..

[22]  Xiaochun Luo,et al.  Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network , 2018, Comput. Aided Civ. Infrastructure Eng..

[23]  Fei-Yue Wang,et al.  Accurate and robust eye center localization via fully convolutional networks , 2019, IEEE/CAA Journal of Automatica Sinica.

[24]  MengChu Zhou,et al.  Temporal Pattern-Aware QoS Prediction via Biased Non-Negative Latent Factorization of Tensors , 2020, IEEE Transactions on Cybernetics.

[25]  Luqman Ali,et al.  Pavement Crack Detection and Localization using Convolutional Neural Networks (CNNs) , 2019, 2019 International Conference on Digitization (ICD).

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Cleber Zanchettin,et al.  The Impact of Dataset Complexity on Transfer Learning over Convolutional Neural Networks , 2017, ICANN.

[28]  Jian Li,et al.  Concrete Crack Detection and Monitoring Using a Capacitive Dense Sensor Array , 2019, Sensors.

[29]  Yoshihiko Hamamoto,et al.  A robust automatic crack detection method from noisy concrete surfaces , 2011, Machine Vision and Applications.

[30]  Shuang Wang,et al.  Structural Damage Detection using Deep Convolutional Neural Network and Transfer Learning , 2019, KSCE Journal of Civil Engineering.

[31]  Vikram Pakrashi,et al.  Regionally Enhanced Multiphase Segmentation Technique for Damaged Surfaces , 2014, Comput. Aided Civ. Infrastructure Eng..

[32]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[33]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[34]  Yoshihide Sekimoto,et al.  Lightweight road manager: smartphone-based automatic determination of road damage status by deep neural network , 2016, MobiGIS.

[35]  Vikram Pakrashi,et al.  Texture Analysis Based Damage Detection of Ageing Infrastructural Elements , 2013, Comput. Aided Civ. Infrastructure Eng..

[36]  Xue Ying,et al.  An Overview of Overfitting and its Solutions , 2019, Journal of Physics: Conference Series.

[37]  Ali Kashif Bashir,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2013, ICIRA 2013.

[38]  Kasthurirangan Gopalakrishnan,et al.  CRACK DAMAGE DETECTION IN UNMANNED AERIAL VEHICLE IMAGES OF CIVIL INFRASTRUCTURE USING PRE-TRAINED DEEP LEARNING MODEL , 2018 .

[39]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[40]  Ying Gu,et al.  A novel hybrid approach for crack detection , 2020, Pattern Recognit..

[41]  Yang Liu,et al.  Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep‐Learning Network , 2017, Comput. Aided Civ. Infrastructure Eng..

[42]  Kelvin C. P. Wang,et al.  Deep Learning for Asphalt Pavement Cracking Recognition Using Convolutional Neural Network , 2017 .

[43]  Kaige Zhang,et al.  Unified Approach to Pavement Crack and Sealed Crack Detection Using Preclassification Based on Transfer Learning , 2018, J. Comput. Civ. Eng..

[44]  Hyeong Gveong Moon,et al.  Inteligent crack detecting algorithm on the concrete crack image using neural network , 2011 .

[45]  Wilson Ricardo Leal da Silva,et al.  Concrete Cracks Detection Based on Deep Learning Image Classification , 2018, Proceedings.

[46]  Ying Chen,et al.  Ensemble of Deep Convolutional Neural Networks for Automatic Pavement Crack Detection and Measurement , 2020, Coatings.

[47]  Peggy Subirats,et al.  Introduction of a wavelet transform based on 2D matched filter in a Markov random field for fine structure extraction: application on road crack detection , 2009, Electronic Imaging.

[48]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[49]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Paul W. Fieguth,et al.  Morphological segmentation and classification of underground pipe images , 2006, Machine Vision and Applications.

[51]  Weiguo Fan,et al.  A new image classification method using CNN transfer learning and web data augmentation , 2018, Expert Syst. Appl..

[52]  Siddhartha Kumar Khaitan,et al.  Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection , 2017 .

[53]  Tan-Hsu Tan,et al.  Novel IoT-Based Privacy-Preserving Yoga Posture Recognition System Using Low-Resolution Infrared Sensors and Deep Learning , 2019, IEEE Internet of Things Journal.

[54]  Guiyuan Jiang,et al.  Automatic Pixel-Level Pavement Crack Detection Using Information of Multi-Scale Neighborhoods , 2018, IEEE Access.

[55]  Ronald Tetzlaff,et al.  NEROvideo: a general-purpose CNN-UM video processing system , 2014, Journal of Real-Time Image Processing.

[56]  Kelvin C. P. Wang,et al.  Pixel-Level Cracking Detection on 3D Asphalt Pavement Images Through Deep-Learning- Based CrackNet-V , 2020, IEEE Transactions on Intelligent Transportation Systems.

[57]  Jie Gao,et al.  Recognition, location, measurement, and 3D reconstruction of concealed cracks using convolutional neural networks , 2017 .

[58]  Zheng Yi Wu,et al.  Crack Detection and Segmentation Using Deep Learning with 3D Reality Mesh Model for Quantitative Assessment and Integrated Visualization , 2020, J. Comput. Civ. Eng..

[59]  Paul Fieguth,et al.  Neuro-fuzzy network for the classification of buried pipe defects , 2006 .