Intelligent crack damage detection system in shield tunnel using combination of retinanet and optimal adaptive selection

With the large-scale construction of urban subways, the detection of tunnel cracks becomes particularly important. Due to the complexity of the tunnel environment, it is difficult for traditional tunnel crack detection algorithms to detect and segment such cracks quickly and accurately. The article presents an optimal adaptive selection model (RetinaNet-AOS) based on deep learning RetinaNet for semantic segmentation on tunnel crack images quickly and accurately. The algorithm uses the ROI merge mask to obtain a minimum detection area of the crack in the field of view. A scorer is designed to measure the effect of ROI region segmentation to achieve optimal results, and further optimized with a multi-dimensional classifier. The algorithm is compared with the standard detection based on RetinaNet algorithm with an optimal adaptive selection based on RetinaNet algorithm for different crack types. The results show that our crack detection algorithm not only addresses interference due to mash cracks, slender cracks, and water stains but also the false detection rate decreases from 25.5–35.5% to about 3.6%. Meanwhile, the experimental results focus on the execution time to be calculated on the algorithm, FCN, PSPNet, UNet. The algorithm gives better performance in terms of time complexity.

[1]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[2]  Qingquan Li,et al.  FoSA: F* Seed-growing Approach for crack-line detection from pavement images , 2011, Image Vis. Comput..

[3]  Robert J. Thomas,et al.  Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete , 2018, Construction and Building Materials.

[4]  Dongming Zhang,et al.  Deep learning based image recognition for crack and leakage defects of metro shield tunnel , 2018, Tunnelling and Underground Space Technology.

[5]  Debra F. Laefer,et al.  Crack detection limits in unit based masonry with terrestrial laser scanning , 2014 .

[6]  Sumathi Poobal,et al.  Crack detection using image processing: A critical review and analysis , 2017, Alexandria Engineering Journal.

[7]  Akash Kumar,et al.  ParaLarPD: Parallel FPGA Router Using Primal-Dual Sub-Gradient Method , 2019, Electronics.

[8]  Wei Zhang,et al.  Unified Vision‐Based Methodology for Simultaneous Concrete Defect Detection and Geolocalization , 2018, Comput. Aided Civ. Infrastructure Eng..

[9]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jian Zhang,et al.  Pixel‐level crack delineation in images with convolutional feature fusion , 2018, Structural Control and Health Monitoring.

[12]  Jaime Gómez García-Bermejo,et al.  Crack Detection in Concrete Tunnels Using a Gabor Filter Invariant to Rotation , 2017, Sensors.

[13]  Li Li,et al.  DeepCrack: A deep hierarchical feature learning architecture for crack segmentation , 2019, Neurocomputing.

[14]  Natarajan Meghanathan,et al.  Seed-Based Approach for Automated Crack Detection from Pavement Images , 2016 .

[15]  Martin Molina,et al.  A Collaborative Approach for Surface Inspection Using Aerial Robots and Computer Vision , 2018, Sensors.

[16]  Hoang-Nam Nguyen,et al.  An Automatic Approach for Accurate Edge Detection of Concrete Crack Utilizing 2D Geometric Features of Crack , 2014, J. Signal Process. Syst..

[17]  Quoc-Lam Nguyen,et al.  Automatic recognition of asphalt pavement cracks using metaheuristic optimized edge detection algorithms and convolution neural network , 2018, Automation in Construction.

[18]  Qingquan Li,et al.  CrackTree: Automatic crack detection from pavement images , 2012, Pattern Recognit. Lett..

[19]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[20]  Xie Hong.  Edge Detection Based on 2D Rosin Threshold Method in Road Crack Images , 2013 .

[21]  Paul C. Paris,et al.  Fatigue crack initiation detection by an infrared thermography method , 2009 .

[22]  Siddhartha Kumar Khaitan,et al.  Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection , 2017 .

[23]  Min Hu,et al.  Faster multi-defect detection system in shield tunnel using combination of FCN and faster RCNN , 2019, Advances in Structural Engineering.

[24]  Xiaochun Luo,et al.  Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network , 2018, Comput. Aided Civ. Infrastructure Eng..