An Artificial Intelligence Method for Asphalt Pavement Pothole Detection Using Least Squares Support Vector Machine and Neural Network with Steerable Filter-Based Feature Extraction

This study establishes an artificial intelligence (AI) model for detecting pothole on asphalt pavement surface. Image processing methods including Gaussian filter, steerable filter, and integral projection are utilized for extracting features from digital images. A data set consisting of 200 image samples has been collected to train and validate the predictive performance of two machine learning algorithms including the least squares support vector machine (LS-SVM) and the artificial neural network (ANN). Experimental results obtained from a repeated subsampling process with 20 runs show that both LS-SVM and ANN are capable methods for pothole detection with classification accuracy rate larger than 85%. In addition, the LS-SVM has achieved the highest classification accuracy rate (roughly 89%) and the area under the curve (0.96). Accordingly, the proposed AI approach used with LS-SVM can be very potential to assist transportation agencies and road inspectors in the task of pavement pothole detection.

[1]  D E Donnelly.  DISTRESS IDENTIFICATION MANUAL FOR THE LONG-TERM PAVEMENT PERFORMANCE STUDIES. STRATEGIC HIGHWAY RESEARCH PROGRAM PRODUCTS. PROCEEDINGS OF A SPECIALTY CONFERENCE SPONSORED BY THE HIGHWAY DIVISION OF THE AMERICAN SOCIETY OF CIVIL ENGINEERS AND THE FEDERAL HIGHWAY ADMINISTRATION. DENVER MARRIOTT CITY , 1991 .

[2]  Wei Sun,et al.  Short-Term Load Forecasting Based on Wavelet Transform and Least Squares Support Vector Machine Optimized by Fruit Fly Optimization Algorithm , 2015, J. Electr. Comput. Eng..

[3]  Amir Golroo,et al.  A review on automated pavement distress detection methods , 2017 .

[4]  Dieu Tien Bui,et al.  Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS , 2017 .

[5]  Mathews Jacob,et al.  Design of steerable filters for feature detection using canny-like criteria , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  J. M. Palomares,et al.  Efficient pavement crack detection and classification , 2017, EURASIP Journal on Image and Video Processing.

[7]  Nikolaos Mitianoudis,et al.  Multidimensional directional steerable filters - Theory and application to 3D flow estimation , 2018, Image Vis. Comput..

[8]  Taehyeong Kim,et al.  Image-Based Pothole Detection System for ITS Service and Road Management System , 2015 .

[9]  Nhat-Duc Hoang,et al.  Predicting Colonization Growth of Algae on Mortar Surface with Artificial Neural Network , 2016, J. Comput. Civ. Eng..

[10]  Paulo Lobato Correia,et al.  Supervised Crack Detection and Classification in Images of Road Pavement Flexible Surfaces , 2009 .

[11]  Christian Koch,et al.  Automated Pothole Distress Assessment Using Asphalt Pavement Video Data , 2013 .

[12]  Ernest L. Hall,et al.  Detection and avoidance of simulated potholes in autonomous vehicle navigation in an unstructured environment , 2000, SPIE Optics East.

[13]  Francesco Benedetto,et al.  A real-time automatic pavement crack and pothole recognition system for mobile Android-based devices , 2017, Adv. Eng. Informatics.

[14]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[15]  Fereidoon Moghadas Nejad,et al.  Image Based Techniques for Crack Detection, Classification and Quantification in Asphalt Pavement: A Review , 2017 .

[16]  Shuai Li,et al.  Automatic Pavement-Crack Detection and Segmentation Based on Steerable Matched Filtering and an Active Contour Model , 2017, J. Comput. Civ. Eng..

[17]  Salah Bourennane,et al.  3D and 2D face recognition using integral projection curves based depth and intensity images , 2015, Int. J. Intell. Syst. Technol. Appl..

[18]  Zhan-bo Chen,et al.  Research on application of regression least squares support vector machine on performance prediction of hydraulic excavator , 2014 .

[19]  Nhat-Duc Hoang,et al.  Predicting earthquake-induced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multi-dataset study , 2018, Bulletin of Engineering Geology and the Environment.

[20]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Nhat-Duc Hoang,et al.  Modeling Punching Shear Capacity of Fiber-Reinforced Polymer Concrete Slabs: A Comparative Study of Instance-Based and Neural Network Learning , 2017, Appl. Comput. Intell. Soft Comput..

[22]  Francisco Herrera,et al.  An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics , 2013, Inf. Sci..

[23]  Nguyen Quoc Thanh,et al.  Spatial prediction of rainfall-induced landslides for the Lao Cai area (Vietnam) using a hybrid intelligent approach of least squares support vector machines inference model and artificial bee colony optimization , 2017, Landslides.

[24]  Yashon O. Ouma,et al.  Pothole detection on asphalt pavements from 2D-colour pothole images using fuzzy c-means clustering and morphological reconstruction , 2017 .

[25]  Xinhua Xue,et al.  Prediction of Slope Stability Based on Hybrid PSO and LSSVM , 2017, J. Comput. Civ. Eng..

[26]  Johan A. K. Suykens,et al.  Benchmarking Least Squares Support Vector Machine Classifiers , 2004, Machine Learning.

[27]  Yashon O. Ouma,et al.  Wavelet-morphology based detection of incipient linear cracks in asphalt pavements from RGB camera imagery and classification using circular Radon transform , 2016, Adv. Eng. Informatics.

[28]  Christian Koch,et al.  Pothole detection in asphalt pavement images , 2011, Adv. Eng. Informatics.

[29]  Huidrom Lokeshwor,et al.  Robust Method for Automated Segmentation of Frames with/without Distress from Road Surface Video Clips , 2014 .

[30]  Nhat-Duc Hoang,et al.  A Novel Relevance Vector Machine Classifier with Cuckoo Search Optimization for Spatial Prediction of Landslides , 2016, J. Comput. Civ. Eng..

[31]  Edward H. Adelson,et al.  Steerable filters for early vision, image analysis, and wavelet decomposition , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[32]  Jeff Heaton,et al.  Introduction to neural networks for C , 2008 .

[33]  Kelvin C. P. Wang,et al.  Experimentation of 3D Pavement Imaging through Stereovision , 2007 .

[34]  Lalit Kumar Das,et al.  Method for Automated Assessment of Potholes, Cracks and Patches from Road Surface Video Clips , 2013 .