Method for detecting road pavement damage based on deep learning

A safe and healthy road condition plays a supporting role in the public travel and the national economy. Therefore, effective management and maintenance methods have become the key problems that the researchers and engineers are urgently solving, early damage detection and warning are also important for disaster emergency treatment, but some traditional road damage identification methods are often costly and need to be equipped with professional persons. Due to the complexity of pavement conditions, some existing defects datasets are not perfect, although the accuracy is high, they cannot be put into practical use. Based on the object detection technology of deep learning, the author introduced a novel method which is more effective and relatively cheap. In this paper, 5966 images with road damage of different angles and distances were collected, and the damage categories included Lateral Crack, Longitudinal Crack, Pothole and separation, Alligator Crack, and Damage around the well cover which had never been considered in the datasets in any researches. After training with GPU using convolutional neural network, the average precision can reach 96.3%.

[1]  Kelvin C. P. Wang,et al.  Automatic classification of pavement crack using deep convolutional neural network , 2018, International Journal of Pavement Engineering.

[2]  Xiaoyan Liu,et al.  An object-oriented method for road damage detection from high resolution remote sensing images , 2011, 2011 19th International Conference on Geoinformatics.

[3]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[4]  M. Taleai,et al.  Post-earthquake road damage assessment using region-based algorithms from high-resolution satellite images , 2010, Remote Sensing.

[5]  G. Giunta,et al.  Reliability of Radar Inspection for Detection of Pavement Damage , 2004 .

[6]  Ezzatollah Salari,et al.  Automated pavement distress detection using advanced image processing techniques , 2009, 2009 IEEE International Conference on Electro/Information Technology.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Horst-Michael Groß,et al.  How to get pavement distress detection ready for deep learning? A systematic approach , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[9]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Ling Tong,et al.  The study of road damage detection based on high-resolution SAR image , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[12]  Yoshihide Sekimoto,et al.  Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images , 2018, Comput. Aided Civ. Infrastructure Eng..

[13]  Chu Yanli Algorithm Study on Thinning and Keeping Connectivity of Bituminous Pavement Crack Images , 2010, 2010 International Conference of Information Science and Management Engineering.

[14]  Yang Liu,et al.  Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep‐Learning Network , 2017, Comput. Aided Civ. Infrastructure Eng..

[15]  Siddhartha Kumar Khaitan,et al.  Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection , 2017 .

[16]  Ning Zhang,et al.  A novel road crack detection and identification method using digital image processing techniques , 2012, 2012 7th International Conference on Computing and Convergence Technology (ICCCT).

[17]  Kaige Zhang,et al.  Unified Approach to Pavement Crack and Sealed Crack Detection Using Preclassification Based on Transfer Learning , 2018, J. Comput. Civ. Eng..

[18]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jianhua Wang,et al.  A knowledge-based method for road damage detection using high-resolution remote sensing image , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[20]  Dimitris Samaras,et al.  Large-scale Continual Road Inspection: Visual Infrastructure Assessment in the Wild , 2017, BMVC.

[21]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Akihisa Ohya,et al.  Detection of road surface damage using mobile robot equipped with 2D laser scanner , 2013, Proceedings of the 2013 IEEE/SICE International Symposium on System Integration.