Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm

Abstract Detecting concealed cracks in asphalt pavement has been a challenging task due to the nonvisibility of the location of these cracks. This study proposes an effective method to automatically perform the recognition and location of concealed cracks based on 3-D ground penetrating radar (GPR) and deep learning models. Using a 3-D GPR and a filtering process, a dataset was constructed, including 303 GPR images and 1306 cracks. Next, You Only Look Once (YOLO) models were first introduced as deep learning models for detecting concealed cracks using GPR data. The results reveal that this proposed method is feasible for the detection of concealed cracks. Compared with YOLO version 3, YOLO version 4 (YOLOv4) and YOLO version 5 (YOLOv5) both achieve obvious progress even in a small dataset. The fastest detection speed of YOLOv4 models reaches 10.16 frames per second using only a medium CPU and the best mAP of YOLOv5 models is up to 94.39%. In addition, the YOLOv4 models show better robustness than the YOLOv5 models and could accurately distinguish between concealed cracks and pseudo cracks.

[1]  Hui Liu,et al.  Real-time Concealed Object Detection from Passive Millimeter Wave Images Based on the YOLOv3 Algorithm , 2020, Sensors.

[2]  Hajin Choi,et al.  Laboratory assessment of nine methods for nondestructive evaluation of concrete bridge decks with overlays , 2018, Construction and Building Materials.

[3]  J. Yepes,et al.  Ultrasound data for laboratory calibration of an analytical model to calculate crack depth on asphalt pavements , 2017, Data in brief.

[4]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[5]  Guoxu Liu,et al.  YOLO-Tomato: A Robust Algorithm for Tomato Detection Based on YOLOv3 , 2020, Sensors.

[6]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Tomas Sauer,et al.  Detection and Monitoring of Bottom-Up Cracks in Road Pavement Using a Machine-Learning Approach , 2020, Algorithms.

[8]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Li Xiu,et al.  Practical methods for detection of concealed cracks in highway pavement using ground penetration radar data , 2007 .

[11]  Quoc V. Le,et al.  DropBlock: A regularization method for convolutional networks , 2018, NeurIPS.

[12]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[13]  Imad L. Al-Qadi,et al.  Super-Resolution of 3-D GPR Signals to Estimate Thin Asphalt Overlay Thickness Using the XCMP Method , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Shan Zhao,et al.  Development of regularization methods on simulated ground-penetrating radar signals to predict thin asphalt overlay thickness , 2017, Signal Process..

[15]  Juan Chen,et al.  Deep convolution neural network-based transfer learning method for civil infrastructure crack detection , 2020 .

[16]  Liang Song,et al.  Faster region convolutional neural network for automated pavement distress detection , 2019, Road Materials and Pavement Design.

[17]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Rongxin Jiang,et al.  An Improved Algorithm for Detecting Pneumonia Based on YOLOv3 , 2020, Applied Sciences.

[19]  Dar-Hao Chen,et al.  Estimating the hotmix asphalt air voids from ground penetrating radar , 2014 .

[20]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[21]  Qi Tian,et al.  CenterNet: Keypoint Triplets for Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[22]  Higinio González-Jorge,et al.  Approach to identify cracking in asphalt pavement using GPR and infrared thermographic methods: Preliminary findings , 2014 .

[23]  F. Mackenzie,et al.  Dissolution of Carbonate Sediments Under Rising pCO2 and Ocean Acidification: Observations from Devil’s Hole, Bermuda , 2007 .

[24]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Yuchuan Du,et al.  Pavement distress detection and classification based on YOLO network , 2020, International Journal of Pavement Engineering.

[26]  Eko Mulyanto Yuniarno,et al.  Asphalt Pavement Pothole Detection using Deep learning method based on YOLO Neural Network , 2019, 2019 International Seminar on Intelligent Technology and Its Applications (ISITIA).

[27]  Meiping Wen,et al.  Improved UAV Opium Poppy Detection Using an Updated YOLOv3 Model , 2019, Sensors.

[28]  Imad L. Al-Qadi,et al.  Development of an analytic approach utilizing the extended common midpoint method to estimate asphalt pavement thickness with 3-D ground-penetrating radar , 2016 .

[29]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Zheng Tong,et al.  Pavement-distress detection using ground-penetrating radar and network in networks , 2020 .

[31]  Diganta Misra,et al.  Mish: A Self Regularized Non-Monotonic Neural Activation Function , 2019, ArXiv.

[32]  Sha Qinglin.  How to Achieve Scientific Development Concept,Implement Resource-saving and Environment-friendly Idea in Highway Construction , 2010 .

[33]  Stephen Lin,et al.  RepPoints: Point Set Representation for Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[34]  Xiaoping Ji,et al.  Detecting concealed damage in asphalt pavement based on a composite lead zirconate titanate/polyvinylidene fluoride aggregate , 2019, Structural Control and Health Monitoring.

[35]  Tao Zhang,et al.  Rapid Detection Methods for Asphalt Pavement Thicknesses and Defects by a Vehicle-Mounted Ground Penetrating Radar (GPR) System , 2016, Sensors.

[36]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[37]  Zhiqiang Shen,et al.  DSOD: Learning Deeply Supervised Object Detectors from Scratch , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[38]  Zhaohui Zheng,et al.  Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression , 2019, AAAI.

[39]  Jin Wu,et al.  GPR detection of several common subsurface voids inside dikes and dams , 2010 .

[40]  Kelvin C. P. Wang,et al.  Pixel-Level Cracking Detection on 3D Asphalt Pavement Images Through Deep-Learning- Based CrackNet-V , 2020, IEEE Transactions on Intelligent Transportation Systems.

[41]  Jie Gao,et al.  Recognition, location, measurement, and 3D reconstruction of concealed cracks using convolutional neural networks , 2017 .

[43]  Jun-Wei Hsieh,et al.  CSPNet: A New Backbone that can Enhance Learning Capability of CNN , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[44]  Yuhuan Ren,et al.  Detection of Collapsed Buildings in Post-Earthquake Remote Sensing Images Based on the Improved YOLOv3 , 2019, Remote. Sens..

[45]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[46]  Mezgeen A. Rasol,et al.  GPR laboratory tests and numerical models to characterize cracks in cement concrete specimens, exemplifying damage in rigid pavement , 2020 .

[47]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Jorge C. Pais,et al.  Laboratory observation of cracks in road pavements with GPR , 2017 .

[49]  Jing Liu,et al.  Optimized YOLOv3 Algorithm and Its Application in Traffic Flow Detections , 2020, Applied Sciences.

[50]  Huibing Zhang,et al.  Real-Time Detection Method for Small Traffic Signs Based on Yolov3 , 2020, IEEE Access.

[51]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Jie Gao,et al.  Innovative method for recognizing subgrade defects based on a convolutional neural network , 2018 .

[53]  Aleksandra V. Varnavina,et al.  Utilization of Air-Launched Ground Penetrating Radar (GPR) for Pavement Condition Assessment , 2017 .

[54]  Yunyi Jia,et al.  Automatic detection of moisture damages in asphalt pavements from GPR data with deep CNN and IRS method , 2020 .

[55]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Peter Annan,et al.  A review of Ground Penetrating Radar application in civil engineering: A 30-year journey from Locating and Testing to Imaging and Diagnosis , 2017, NDT & E International.

[57]  V. Pérez-Gracia,et al.  GPR evaluation of the damage found in the reinforced concrete base of a block of flats: A case study , 2008 .

[58]  Imad L. Al-Qadi,et al.  An innovative method for measuring pavement dielectric constant using the extended CMP method with two air-coupled GPR systems , 2014 .