Road crack detection using a single stage detector based deep neural network

Condition and deterioration of public and private infrastructure is an issue that directly affects the majority of the world population. In this paper we propose the application of a Residual Neural Network to automatically detect road and pavement surface cracks. The high amount of variance in the texture of the surface and variation in illumination levels makes the task of automatically detecting defects within public and private infrastructure a difficult task. The system developed utilises a feature pyramid core with an underlying feed-forward ResNet architecture. The output from the feature pyramid then feeds into two sub-networks. One sub-network associates a class with the output from the feature pyramid. The other sub-network regresses the offset from each of the output bounding boxes of the feature pyramid to the corresponding ground truth boxes during training. The network was trained on real world data from an already established dataset. The data used to train and test on is very limited, due to the lack of available road crack datasets in the public domain. Despite the limited amount of data, the proposed method achieves a very positive results with minimal error.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Patrice Y. Simard,et al.  High Performance Convolutional Neural Networks for Document Processing , 2006 .

[3]  Patrice Y. Simard,et al.  Using GPUs for machine learning algorithms , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[4]  Fan Meng,et al.  Pavement Distress Detection Using Random Decision Forests , 2015, ICDS.

[5]  Gordon Morison,et al.  An imaging system for visual inspection and structural condition monitoring of railway tunnels , 2017, 2017 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS).

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Maarten van Someren,et al.  Short-term anomaly detection in gas consumption through ARIMA and Artificial Neural Network forecast , 2015, EESMS 2015.

[8]  David C. Hogg,et al.  Deeper Networks for Pavement Crack Detection , 2017 .

[9]  Ioannis Brilakis,et al.  Improving Road Asset Condition Monitoring , 2016 .

[10]  Rajat Raina,et al.  Large-scale deep unsupervised learning using graphics processors , 2009, ICML '09.

[11]  Fulvio Simonelli,et al.  An artificial neural network approach for spatially extending road traffic monitoring measures , 2016, 2016 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS).

[12]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[13]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jérôme Idier,et al.  Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection , 2016, IEEE transactions on intelligent transportation systems (Print).

[15]  Takashi Matsumoto,et al.  Development of an Automatic Detector of Cracks in Concrete Using Machine Learning , 2017 .

[16]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[17]  Paulo Lobato Correia,et al.  CrackIT — An image processing toolbox for crack detection and characterization , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[18]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[19]  Fan Meng,et al.  Automatic Road Crack Detection Using Random Structured Forests , 2016, IEEE Transactions on Intelligent Transportation Systems.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  R. J. Meijer,et al.  Artificial intelligence and finite element modelling for monitoring flood defence structures , 2011, 2011 IEEE Workshop on Environmental Energy and Structural Monitoring Systems.