Road Damage Detection Acquisition System based on Deep Neural Networks for Physical Asset Management

Research on damage detection of road surfaces has been an active area of re-search, but most studies have focused so far on the detection of the presence of damages. However, in real-world scenarios, road managers need to clearly understand the type of damage and its extent in order to take effective action in advance or to allocate the necessary resources. Moreover, currently there are few uniform and openly available road damage datasets, leading to a lack of a common benchmark for road damage detection. Such dataset could be used in a great variety of applications; herein, it is intended to serve as the acquisition component of a physical asset management tool which can aid governments agencies for planning purposes, or by infrastructure mainte-nance companies. In this paper, we make two contributions to address these issues. First, we present a large-scale road damage dataset, which includes a more balanced and representative set of damages. This dataset is composed of 18,034 road damage images captured with a smartphone, with 45,435 in-stances road surface damages. Second, we trained different types of object detection methods, both traditional (an LBP-cascaded classifier) and deep learning-based, specifically, MobileNet and RetinaNet, which are amenable for embedded and mobile and implementations with an acceptable perfor-mance for many applications. We compare the accuracy and inference time of all these models with others in the state of the art.

[1]  Ioannis Brilakis,et al.  Patch detection for pavement assessment , 2015 .

[2]  Thitirat Siriborvornratanakul,et al.  An Automatic Road Distress Visual Inspection System Using an Onboard In-Car Camera , 2018, Adv. Multim..

[3]  Nhat-Duc Hoang,et al.  A novel method for asphalt pavement crack classification based on image processing and machine learning , 2019, Engineering with Computers.

[4]  Marcelo C. M. Teixeira,et al.  Discrete-Time Sliding Mode Control for Uncertain Networked System Subject to Time Delay , 2015 .

[5]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[6]  Satoshi Tamura,et al.  A Deep Learning-Based Approach for Road Pothole Detection in Timor Leste , 2018, 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI).

[7]  Mei-Ling Shyu,et al.  A Survey on Deep Learning , 2018, ACM Comput. Surv..

[8]  Eduardo Zalama Casanova,et al.  Enhanced automatic detection of road surface cracks by combining 2D/3D image processing techniques , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yoshihide Sekimoto,et al.  Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images , 2018, Comput. Aided Civ. Infrastructure Eng..

[11]  Ning Zhang,et al.  Road Damage Detection Using RetinaNet , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[12]  Khurram Kamal,et al.  A Review of Three-Dimensional Imaging Technologies for Pavement Distress Detection and Measurements , 2015, IEEE Transactions on Intelligent Transportation Systems.

[13]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[14]  Paulo Lobato Correia,et al.  Automatic Road Crack Detection and Characterization , 2013, IEEE Transactions on Intelligent Transportation Systems.

[15]  Sumathi Poobal,et al.  Crack detection using image processing: A critical review and analysis , 2017, Alexandria Engineering Journal.

[16]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[17]  Christian Koch,et al.  Automated Pothole Distress Assessment Using Asphalt Pavement Video Data , 2013 .

[18]  Francesco Benedetto,et al.  A real-time automatic pavement crack and pothole recognition system for mobile Android-based devices , 2017, Adv. Eng. Informatics.

[19]  Nhat-Duc Hoang,et al.  An Artificial Intelligence Method for Asphalt Pavement Pothole Detection Using Least Squares Support Vector Machine and Neural Network with Steerable Filter-Based Feature Extraction , 2018, Advances in Civil Engineering.

[20]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[21]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[22]  Taehyeong Kim,et al.  Image-Based Pothole Detection System for ITS Service and Road Management System , 2015 .

[23]  Nigel Waters,et al.  Review of remote sensing methodologies for pavement management and assessment , 2015 .