Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

Pavement crack detection is essential for safe driving. The traditional manual crack detection method is highly subjective and time-consuming. Hence, an automatic pavement crack detection system is needed to facilitate this progress. However, this is still a challenging task due to the complex topology and large noise interference of crack images. Recently, although deep learning-based technologies have achieved breakthrough progress in crack detection, there are still some challenges, such as large parameters and low detection efficiency. Besides, most deep learning-based crack detection algorithms find it difficult to establish good balance between detection accuracy and detection speed. Inspired by the latest deep learning technology in the field of image processing, this paper proposes a novel crack detection algorithm based on the deep feature aggregation network with the spatial-channel squeeze & excitation (scSE) attention mechanism module, which calls CrackDFANet. Firstly, we cut the collected crack images into 512 × 512 pixel image blocks to establish a crack dataset. Then through iterative optimization on the training and validation sets, we obtained a crack detection model with good robustness. Finally, the CrackDFANet model verified on a total of 3516 images in five datasets with different sizes and containing different noise interferences. Experimental results show that the trained CrackDFANet has strong anti-interference ability, and has better robustness and generalization ability under the interference of light interference, parking line, water stains, plant disturbance, oil stains, and shadow conditions. Furthermore, the CrackDFANet is found to be better than other state-of-the-art algorithms with more accurate detection effect and faster detection speed. Meanwhile, our algorithm model parameters and error rates are significantly reduced.

[1]  Hyoungkwan Kim,et al.  Encoder–decoder network for pixel‐level road crack detection in black‐box images , 2019, Comput. Aided Civ. Infrastructure Eng..

[2]  Zhang Yiyang,et al.  The design of glass crack detection system based on image preprocessing technology , 2014, 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference.

[3]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[4]  Tien-Thinh Le,et al.  Development of Deep Learning Model for the Recognition of Cracks on Concrete Surfaces , 2021, Appl. Comput. Intell. Soft Comput..

[5]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[6]  Fan Yang,et al.  Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection , 2019, IEEE Transactions on Intelligent Transportation Systems.

[7]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yichang James Tsai,et al.  Machine Learning for Crack Detection: Review and Model Performance Comparison , 2020, J. Comput. Civ. Eng..

[9]  Dongming Zhang,et al.  Deep learning based image recognition for crack and leakage defects of metro shield tunnel , 2018, Tunnelling and Underground Space Technology.

[10]  Zhaozheng Hu,et al.  Grid-based pavement crack analysis using deep learning , 2017, 2017 4th International Conference on Transportation Information and Safety (ICTIS).

[11]  Horst-Michael Groß,et al.  How to get pavement distress detection ready for deep learning? A systematic approach , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[12]  Cao Vu Dung,et al.  Autonomous concrete crack detection using deep fully convolutional neural network , 2019, Automation in Construction.

[13]  Yong Hu,et al.  A novel LBP based methods for pavement crack detection , 2009 .

[14]  Lijun Wu,et al.  Pixel-Level Crack Detection in Images Using SegNet , 2019, MIWAI.

[15]  Umapada Pal,et al.  Automatic Bridge Crack Detection - A Texture Analysis-Based Approach , 2014, ANNPR.

[16]  Wei Li,et al.  CrackU‐net: A novel deep convolutional neural network for pixelwise pavement crack detection , 2020, Structural Control and Health Monitoring.

[17]  N. Yuvaraj,et al.  Surface crack detection using deep learning with shallow CNN architecture for enhanced computation , 2021, Neural Computing and Applications.

[18]  Wei Wang,et al.  Computer vision-based concrete crack detection using U-net fully convolutional networks , 2019, Automation in Construction.

[19]  Mohamed Adel Serhani,et al.  Performance Evaluation of Deep CNN-Based Crack Detection and Localization Techniques for Concrete Structures , 2021, Sensors.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jingjing Yang,et al.  CNN Training with Twenty Samples for Crack Detection via Data Augmentation , 2020, Sensors.

[23]  Seong-Won Lee,et al.  Artificial Neural Network-Based Automated Crack Detection and Analysis for the Inspection of Concrete Structures , 2020, Applied Sciences.

[24]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[25]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Xiaojuan Qi,et al.  ICNet for Real-Time Semantic Segmentation on High-Resolution Images , 2017, ECCV.

[27]  Nassir Navab,et al.  Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks , 2018, MICCAI.

[28]  Sung Hyuk Park,et al.  Image Processing Algorithm for Real-Time Crack Inspection in Hole Expansion Test , 2019 .

[29]  Yun-Kyu An,et al.  Deep learning-based concrete crack detection using hybrid images , 2018, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[30]  Jérôme Idier,et al.  Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection , 2016, IEEE transactions on intelligent transportation systems (Print).

[31]  Qian Wang,et al.  DeepCrack: Learning Hierarchical Convolutional Features for Crack Detection , 2019, IEEE Transactions on Image Processing.

[32]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[34]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[35]  Fan Meng,et al.  Automatic Road Crack Detection Using Random Structured Forests , 2016, IEEE Transactions on Intelligent Transportation Systems.

[36]  Andrzej Rybarczyk,et al.  Asphalt surfaced pavement cracks detection based on histograms of oriented gradients , 2015, 2015 22nd International Conference Mixed Design of Integrated Circuits & Systems (MIXDES).

[37]  Jian Wan,et al.  Semi-Supervised Semantic Segmentation Using Adversarial Learning for Pavement Crack Detection , 2020, IEEE Access.

[38]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[39]  Hoang-Nam Nguyen,et al.  An Automatic Approach for Accurate Edge Detection of Concrete Crack Utilizing 2D Geometric Features of Crack , 2014, J. Signal Process. Syst..

[40]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Yucheng Zhou,et al.  Intelligent Recognition of Medical Motion Image Combining Convolutional Neural Network With Internet of Things , 2019, IEEE Access.

[42]  Tongyuan Ni,et al.  Measurement of concrete crack feature with android smartphone APP based on digital image processing techniques , 2020 .

[43]  In So Kweon,et al.  Convolutional Block Attention Module , 2018, ECCV 2018.

[44]  Jian Sun,et al.  DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.