A Simplified Computer Vision System for Road Surface Inspection and Maintenance

This paper presents a computer vision system whose aim is to detect and classify cracks on road surfaces. Most of the previous works consisted of complex and expensive acquisition systems, whereas we have developed a simpler one composed by a single camera mounted on a light truck and no additional illumination. The system also includes tracking devices in order to geolocalize the captured images. The computer vision algorithm has three steps: hard shoulder detection, cell candidate proposal, and crack classification. First the region of interest (ROI) is delimited using the Hough transform (HT) to detect the hard shoulders. The cell candidate step is divided into two substeps: Hough transform features (HTF) and local binary pattern (LBP). Both of them split up the image into nonoverlapping small grid cells and also extract edge orientation and texture features, respectively. At the fusion stage, the detection is completed by mixing those techniques and obtaining the crack seeds. Afterward, their shape is improved using a new developed morphology operator. Finally, one classification based on the orientation of the detected lines has been applied following the Chain code. Massive experiments were performed on several stretches on a Spanish road showing very good performance.

[1]  Quanquan Gu,et al.  HTF: a novel feature for general crack detection , 2010, 2010 IEEE International Conference on Image Processing.

[2]  Xinyue Zhao,et al.  MSRC-based defective nanocrystalline soft magnetic ribbon detection , 2015 .

[3]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[4]  Yong Zhou,et al.  A Lane Departure Warning System Based on Virtual Lane Boundary , 2008, J. Inf. Sci. Eng..

[5]  Steve Oudot,et al.  Delaunay Triangulation , 2017, Encyclopedia of GIS.

[6]  Wensheng Tang,et al.  Pavement Crack Segmentation Algorithm Based on Local Optimal Threshold of Cracks Density Distribution , 2011, ICIC.

[7]  Edward R. Dougherty,et al.  Binary Opening and Closing , 2003 .

[8]  H. M. Markowitz Approximating Expected Utility by a Function of Mean and Variance , 2016 .

[9]  Hubert Konik,et al.  Road surface classification by thresholding using morphological pyramid , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  Graham J. Williams Support Vector Machines , 2011 .

[11]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[12]  Stéphane Begot,et al.  PAVEMENT CRACKING DETECTION USING AN ANISOTROPY MEASUREMENT , 2010 .

[13]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[14]  Aimin Sha,et al.  Pavement crack classification based on chain code , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[15]  Chandan Srivastava,et al.  Support Vector Data Description , 2011 .

[16]  William H. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[17]  E. Salari,et al.  Pavement distress detection and classification using feature mapping , 2010, 2010 IEEE International Conference on Electro/Information Technology.

[18]  Mohamed S Kaseko,et al.  COMPARISON OF TRADITIONAL AND NEURAL CLASSIFIERS FOR PAVEMENT-CRACK DETECTION. , 1994 .

[19]  Ignacio Parra,et al.  Adaptive Road Crack Detection System by Pavement Classification , 2011, Sensors.

[20]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[21]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Peggy Subirats,et al.  Automation of Pavement Surface Crack Detection using the Continuous Wavelet Transform , 2006, 2006 International Conference on Image Processing.

[23]  Yong Hu,et al.  A novel LBP based methods for pavement crack detection , 2009 .

[24]  Jacques de Villiers,et al.  Backpropagation neural nets with one and two hidden layers , 1993, IEEE Trans. Neural Networks.

[25]  Stephen A. Ross,et al.  Equilibrium and Agency--Inadmissible Agents in the Public Agency Problem , 1979 .

[26]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[27]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[28]  M. Avila,et al.  Detection of defects in road surface by a vision system , 2008, MELECON 2008 - The 14th IEEE Mediterranean Electrotechnical Conference.