Implementing textural features on GPUs for improved real-time pavement distress detection

The condition of municipal roads has deteriorated considerably in recent years, leading to large scale pavement distress such as cracks or potholes. In order to enable road maintenance, pavement distress should be timely detected. However, manual investigation, which is still the most widely applied approach toward pavement assessment, puts maintenance personnel at risk and is time-consuming. During the last decade, several efforts have been made to automatically assess the condition of the municipal roads without any human intervention. Vehicles are equipped with sensors and cameras in order to collect data related to pavement distress and record videos of the pavement surface. Yet, this data are usually not processed while driving, but instead it is recorded and later analyzed off-line. As a result, a vast amount of memory is required to store the data and the available memory may not be sufficient. To reduce the amount of saved data, the authors have previously proposed a graphics processing units (GPU)-enabled pavement distress detection approach based on the wavelet transform of pavement images. The GPU implementation enables pavement distress detection in real time. Although the method used in the approach provides very good results, the method can still be improved by incorporating pavement surface texture characteristics. This paper presents an implementation of textural features on GPUs for pavement distress detection. Textural features are based on gray-tone spatial dependencies in an image and characterize the image texture. To evaluate the computational efficiency of the GPU implementation, performance tests are carried out. The results show that the speedup achieved by implementing the textural features on the GPU is sufficient to enable real-time detection of pavement distress. In addition, classification results obtained by applying the approach on 16,601 pavement images are compared to the results without integrating textural features. There results demonstrate that an improvement of 27% is achieved by incorporating pavement surface texture characteristics.

[1]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[2]  Ravishekhar Banger,et al.  OpenCL Programming by Example , 2013 .

[3]  Jian Zhou,et al.  Wavelet-based pavement distress detection and evaluation , 2003 .

[4]  Khurram Kamal,et al.  Pavement crack detection using the Gabor filter , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[5]  Sebastiano Battiato,et al.  Evaluation Of Pavement Surface Distress Using Digital Image Collection And Analysis , 2006 .

[6]  Markus König,et al.  Wavelet Transform on Multi-GPU for Real-Time Pavement Distress Detection , 2015 .

[7]  David R. Kaeli,et al.  Heterogeneous Computing with OpenCL - Revised OpenCL 1.2 Edition , 2012 .

[8]  Bugao Xu,et al.  Automatic inspection of pavement cracking distress , 2005, SPIE Optics + Photonics.

[9]  D Navaneetha,et al.  Hough Transforms to Detect and Classify Road Cracks , 2014 .

[10]  Li Yao,et al.  Images Crack Detection Technology based on Improved K-means Algorithm , 2014, J. Multim..

[11]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[12]  Li Li,et al.  AUTOMATIC PAVEMENT CRACK RECOGNITION BASED ON BP NEURAL NETWORK , 2014 .

[13]  Christoph Mertz,et al.  Vision for road inspection , 2014, IEEE Winter Conference on Applications of Computer Vision.

[14]  Peggy Subirats,et al.  Automation of Pavement Surface Crack Detection using the Continuous Wavelet Transform , 2006, 2006 International Conference on Image Processing.

[15]  Yuliya Tarabalka,et al.  Real-time anomaly detection in hyperspectral images using multivariate normal mixture models and GPU processing , 2009, Journal of Real-Time Image Processing.

[16]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Nabil Aouf,et al.  GPU-based real-time RGBD data filtering , 2018, Journal of Real-Time Image Processing.

[18]  K. Pearson Contributions to the Mathematical Theory of Evolution. II. Skew Variation in Homogeneous Material , 1895 .

[19]  Raphaël Couturier,et al.  Fast GPU-based denoising filter using isoline levels , 2016, Journal of Real-Time Image Processing.

[20]  Paulo Lobato Correia,et al.  Automatic Road Crack Detection and Characterization , 2013, IEEE Transactions on Intelligent Transportation Systems.

[21]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[22]  K. Pearson Contributions to the Mathematical Theory of Evolution , 1894 .

[23]  Raymond Tay OpenCL Parallel Programming Development Cookbook , 2013 .

[24]  João Pedro Barreto,et al.  Real-time HD image distortion correction in heterogeneous parallel computing systems using efficient memory access patterns , 2012, Journal of Real-Time Image Processing.

[25]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[26]  Jens H. Krüger,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007, Eurographics.

[27]  Qingquan Li,et al.  CrackTree: Automatic crack detection from pavement images , 2012, Pattern Recognit. Lett..

[28]  Ankush Mittal,et al.  Real-time moving object detection algorithm on high-resolution videos using GPUs , 2012, Journal of Real-Time Image Processing.

[29]  Ghada S. Moussa,et al.  A New Technique for Automatic Detection and Parameters Estimation of Pavement Crack , 2011 .

[30]  Naoki Tanaka,et al.  A Crack Detection Method in Road Surface Images Using Morphology , 1998, MVA.

[31]  Victor Podlozhnyuk,et al.  Histogram calculation in CUDA, NVIDIA GPU Computing SDK CUDA Advanced Topics Whitepaper , 2007 .

[32]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[33]  Frank Lindseth,et al.  Multigrid gradient vector flow computation on the GPU , 2014, Journal of Real-Time Image Processing.

[34]  Chiuh-Cheng Chyu,et al.  Evaluation of New Product Development Alternatives Considering Interrelationships among Decision Criteria , 2014, J. Multim..

[35]  E. Salari,et al.  Pavement pothole detection and severity measurement using laser imaging , 2011, 2011 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY.