Convolutional Neural Network-Based Pavement Crack Segmentation Using Pyramid Attention Network

Cracks are the most common road pavement damage. Due to the propagation of cracks, the detection of early cracks has great practical significance. Traditional manual crack detection is extremely time-consuming and labor-intensive. Researchers have turned their attention to automated crack detection. Although automated crack detection has been extensively researched over the past decades, it is still a challenging task due to the intensity inhomogeneity of cracks and complexity of the pavement environment, e.g. To solve these problems, we propose an efficient pavement crack segmentation model based on deep learning. The model uses pre-trained DenseNet121 as an encoder to extract pavement features. Feature Pyramid Attention module fuses features under different pyramid scales and provides precise pixel-attention. The Global Attention Upsample module which is a combination of convolutional neural network and pyramid module acts as a decoder. The sum of Cross-entropy loss and Dice loss is selected as loss function. We use poly policy to tune learning rate. In order to verify the effectiveness of the proposed method, we conduct training and testing on the Crack500 dataset and MCD dataset. Our method achieves a Dice coefficient of 0.7681, an IoU of 0.6235 on the Crack500 dataset and 0.6909, 0.5278 on the MCD dataset. We perform ablation study to verify the effectiveness of the loss function on improving the performance of our model.

[1]  Yong Hu,et al.  Automatic Pavement Crack Detection Using Texture and Shape Descriptors , 2010 .

[2]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Emir Buza,et al.  Pavement crack detection using Otsu thresholding for image segmentation , 2018, 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[4]  Eduardo Júlio,et al.  Automatic mapping of cracking patterns on concrete surfaces with biological stains using hyper‐spectral images processing , 2019, Structural Control and Health Monitoring.

[5]  Quoc V. Le,et al.  Do Better ImageNet Models Transfer Better? , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Nhat-Duc Hoang,et al.  A novel method for asphalt pavement crack classification based on image processing and machine learning , 2019, Engineering with Computers.

[7]  Hyoungkwan Kim,et al.  Encoder–decoder network for pixel‐level road crack detection in black‐box images , 2019, Comput. Aided Civ. Infrastructure Eng..

[8]  Sung Ho Hwang,et al.  Estimation of crack width based on shape‐sensitive kernels and semantic segmentation , 2019, Structural Control and Health Monitoring.

[9]  Jian Wan,et al.  Semi-Supervised Semantic Segmentation Using Adversarial Learning for Pavement Crack Detection , 2020, IEEE Access.

[10]  Xing Wu,et al.  A neural network ensemble method for effective crack segmentation using fully convolutional networks and multi-scale structured forests , 2020, Mach. Vis. Appl..

[11]  Weiwei Cai,et al.  Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution , 2020, IEEE Geoscience and Remote Sensing Letters.

[12]  Cao Vu Dung,et al.  Autonomous concrete crack detection using deep fully convolutional neural network , 2019, Automation in Construction.

[13]  Xiaoling Wang,et al.  Patch-based weakly supervised semantic segmentation network for crack detection , 2020 .

[14]  Mohamed S Kaseko,et al.  A neural network-based methodology for pavement crack detection and classification , 1993 .

[15]  Flavio Piccoli,et al.  A Novel Approach to Data Augmentation for Pavement Distress Segmentation , 2020, Comput. Ind..

[16]  김동현,et al.  Crack Detection of Concrete Structure Using Deep Learning and Image Processing Method in Geotechnical Engineering , 2018 .

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Edwin K. P. Chong,et al.  Automated Pavement Crack Segmentation Using U-Net-Based Convolutional Neural Network , 2020, IEEE Access.

[20]  Horst-Michael Groß,et al.  How to get pavement distress detection ready for deep learning? A systematic approach , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[21]  Hui Li,et al.  Recovering compressed images for automatic crack segmentation using generative models , 2020, 2003.03028.

[22]  Nii O. Attoh-Okine,et al.  Evaluating Pavement Cracks with Bidimensional Empirical Mode Decomposition , 2008, EURASIP J. Adv. Signal Process..

[23]  Guillermo Sapiro,et al.  Continuous Dice Coefficient: a Method for Evaluating Probabilistic Segmentations , 2018, bioRxiv.

[24]  Cui Zou,et al.  Small Sample Classification of Hyperspectral Remote Sensing Images Based on Sequential Joint Deeping Learning Model , 2020, IEEE Access.

[25]  Pengfei Xiong,et al.  Pyramid Attention Network for Semantic Segmentation , 2018, BMVC.

[26]  Li Li,et al.  DeepCrack: A deep hierarchical feature learning architecture for crack segmentation , 2019, Neurocomputing.

[27]  Ning Wang,et al.  Multistage attention network for image inpainting , 2020, Pattern Recognit..

[28]  Wei Xiong,et al.  Pixel-level Crack Detection using U-Net , 2018, TENCON 2018 - 2018 IEEE Region 10 Conference.

[29]  Takeshi Nagata,et al.  Development of a classification method for a crack on a pavement surface images using machine learning , 2017, International Conference on Quality Control by Artificial Vision.

[30]  Young-Jin Cha,et al.  SDDNet: Real-Time Crack Segmentation , 2020, IEEE Transactions on Industrial Electronics.

[31]  Thanh Ha Le,et al.  Pavement Crack Detection using Convolutional Neural Network , 2018, SoICT.

[32]  Sergio Escalera,et al.  Multi-class structural damage segmentation using fully convolutional networks , 2019, Comput. Ind..

[33]  Fan Yang,et al.  Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection , 2019, IEEE Transactions on Intelligent Transportation Systems.

[34]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Peggy Subirats,et al.  Automation of Pavement Surface Crack Detection using the Continuous Wavelet Transform , 2006, 2006 International Conference on Image Processing.

[36]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Soojin Cho,et al.  Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique , 2018, Sensors.

[39]  Hongfeng You,et al.  Pixel-Level Remote Sensing Image Recognition Based on Bidirectional Word Vectors , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Gordon Morison,et al.  A Deep Convolutional Neural Network for Semantic Pixel-Wise Segmentation of Road and Pavement Surface Cracks , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[41]  Chongruo Wu,et al.  ResNeSt: Split-Attention Networks , 2020, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[42]  Vedhus Hoskere,et al.  MaDnet: multi-task semantic segmentation of multiple types of structural materials and damage in images of civil infrastructure , 2020, Journal of Civil Structural Health Monitoring.