Application of image technology on pavement distress detection: A review

Abstract Digital image processing technology has been widely applied in various fields, and it is also increasingly used in pavement distress detection in recent years. The objective of this review article is to help researchers to select the most appropriate digital image processing technology (image acquisition equipment, processing, recognition technology and etc.) to study the pavement distress detection. Firstly, a proper application of the current image acquisition equipment is presented, and the advantages and disadvantages are compared. Secondly, the problems encountered in the practical application of image processing technology in pavement detection are presented. Further, the problems need to be solved in the future research are suggested, including cracks detection, pavement texture detection, temperature segregation detection, rutting detection, pothole detection, and joint faulting detection. In conclusion, the state of the art in pavement detection by digital image processing technology is summarized and proves that the digital image processing technology has become a promising method for pavement detection and materials analysis.

[1]  William N. Collins,et al.  Application of a digital image correlation bridge inspection methodology on geometrically complex bifurcated distortion‐induced fatigue cracking , 2021 .

[3]  Wei Li,et al.  Detection of sealed and unsealed cracks with complex backgrounds using deep convolutional neural network , 2019, Automation in Construction.

[4]  Hanyun Wang,et al.  Iterative Tensor Voting for Pavement Crack Extraction Using Mobile Laser Scanning Data , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jose M Pardillo Mayora,et al.  An assessment of the skid resistance effect on traffic safety under wet-pavement conditions. , 2009 .

[6]  Zheng Tong,et al.  Pavement-distress detection using ground-penetrating radar and network in networks , 2020 .

[7]  Yiannis Kompatsiaris,et al.  Deep Learning Advances in Computer Vision with 3D Data , 2017, ACM Comput. Surv..

[8]  Kelvin C. P. Wang.  Designs and Implementations of Automated Systems for Pavement Surface Distress Survey , 2000 .

[9]  Xin Xu,et al.  A Component Decomposition Model for 3D Laser Scanning Pavement Data Based on High-Pass Filtering and Sparse Analysis , 2018, Sensors.

[10]  Wang Tao,et al.  Proximal Support Vector Machine Based Pavement Image Classification , 2011 .

[11]  Zhuowen Tu,et al.  Holistically-Nested Edge Detection , 2015, ICCV.

[12]  Vivek Kaul,et al.  Enhanced adaptive filter-bank-based automated pavement crack detection and segmentation system , 2012, J. Electronic Imaging.

[13]  Lu Zi-we.  Pavement Crack Detection Algorithm Based on Sub-region and Multi-scale Analysis , 2014 .

[14]  Terhi K Pellinen,et al.  Macro- and micro-texture evolution of road pavements and correlation with friction , 2015 .

[15]  Zhaohua Wang,et al.  Assessment of Rut Depth Measurement Using Emerging 3D Continuous Laser Profiling Technology , 2011 .

[16]  Linda M Pierce,et al.  Construction-Related Asphalt Concrete Pavement Temperature and Density Differentials , 2002 .

[17]  Yun-Kyu An,et al.  Underground Object Classification for Urban Roads Using Instantaneous Phase Analysis of Ground-Penetrating Radar (GPR) Data , 2018, Remote. Sens..

[18]  Douglas D. Gransberg,et al.  Quantifying Seal Coat Surface Condition Using Digital Image Processing Based on Information Theory , 2002 .

[19]  Imad L. Al-Qadi,et al.  OPTIMIZATION OF GROUND-PENETRATING RADAR DATA TO PREDICT LAYER THICKNESSES IN FLEXIBLE PAVEMENTS , 2003 .

[20]  Hangbin Wu,et al.  Road pothole extraction and safety evaluation by integration of point cloud and images derived from mobile mapping sensors , 2019, Adv. Eng. Informatics.

[21]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[22]  Jun Wu,et al.  A deformation detection method for aircraft skin on uniform pressure by using speckle image correlation technology , 2020 .

[23]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[24]  T. Saar,et al.  Automatic Asphalt pavement crack detection and classification using Neural Networks , 2010, 2010 12th Biennial Baltic Electronics Conference.

[25]  Tom Scullion,et al.  Use of ground penetrating radar data in pavement rehabilitation strategy selection and pavement condition assessment , 1998, Smart Structures.

[26]  M H Mohajeri,et al.  ARIA: an operating system of pavement distress diagnosis by image processing , 1991 .

[27]  Manuel Avila,et al.  Automatic detection and classification of defect on road pavement using anisotropy measure , 2009, 2009 17th European Signal Processing Conference.

[28]  Gang Li,et al.  Improved Pavement Distress Detection Based on Contourlet Transform and Multi-Direction Morphological Structuring Elements , 2012 .

[29]  Don W. Lake.  CMOS Image Capture for Digital Stills Cameras , 1998, PICS.

[30]  Paulo Lobato Correia,et al.  Improved road crack detection based on one-class Parzen density estimation and entropy reduction , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Amir Golroo,et al.  A review on automated pavement distress detection methods , 2017 .

[32]  M. Elseifi,et al.  Use of infrared thermography to detect thermal segregation in asphalt overlay and reflective cracking potential. , 2016 .

[33]  E. Salari,et al.  Pavement distress detection and classification using feature mapping , 2010, 2010 IEEE International Conference on Electro/Information Technology.

[34]  I. Al-Qadi,et al.  Investigation of viscoelastic fracture fields in asphalt mixtures using digital image correlation , 2017, International Journal of Fracture.

[35]  Li Chun Jiang,et al.  Research on Safety Evacuation of Large-Scale Railway Passenger Transport Hub , 2014 .

[36]  Mohamed Saleh,et al.  Stereo-vision applications to reconstruct the 3D texture of pavement surface , 2011 .

[37]  Liqun Hu,et al.  Effect of three-dimensional macrotexture characteristics on dynamic frictional coefficient of asphalt pavement surface , 2016 .

[38]  Markus Disse,et al.  Fully automated snow depth measurements from time-lapse images applying a convolutional neural network. , 2019, The Science of the total environment.

[39]  M. Abdelrahman,et al.  Use of a Thermal Camera during Asphalt Pavement Construction , 2009 .

[40]  Achim Hekler,et al.  A convolutional neural network trained with dermoscopic images performed on par with 145 dermatologists in a clinical melanoma image classification task. , 2019, European journal of cancer.

[41]  Zhihua Wang,et al.  Pavement Crack Detection from Mobile Laser Scanning Point Clouds Using a Time Grid , 2020, Sensors.

[42]  Bugao Xu,et al.  Automatic inspection of pavement cracking distress , 2006, J. Electronic Imaging.

[43]  Byoung Jik Lee,et al.  Position‐Invariant Neural Network for Digital Pavement Crack Analysis , 2004 .

[44]  Zhanping You,et al.  Temperature segregation of warm mix asphalt pavement: Laboratory and field evaluations , 2017 .

[45]  Yichang James Tsai,et al.  Characterizing Point-Based Transverse Pavement Rut Measurement Errors Using Emerging 3D Continuous Profile-Based Laser Technology , 2010 .

[46]  Nii O. Attoh-Okine,et al.  Evaluating Pavement Cracks with Bidimensional Empirical Mode Decomposition , 2008, EURASIP J. Adv. Signal Process..

[47]  Yichang Tsai,et al.  Multiscale Crack Fundamental Element Model for Real-World Pavement Crack Classification , 2014, J. Comput. Civ. Eng..

[48]  D. Margolis,et al.  Prostate Imaging Reporting and Data System Version 2.1: 2019 Update of Prostate Imaging Reporting and Data System Version 2. , 2019, European urology.

[49]  Ching-Yao Chan,et al.  Evaluation of Traffic and Environment Effects on Skid Resistance in California , 2010 .

[50]  Won-Hwa Hong,et al.  Application of Crack Identification Techniques for an Aging Concrete Bridge Inspection Using an Unmanned Aerial Vehicle , 2018, Sensors.

[51]  Ezzatollah Salari,et al.  Pavement distress detection and severity analysis , 2011, Electronic Imaging.

[52]  Huang We.  Preliminary Study of Pavement Surface Distress Automation Recognition Based on Wavelet Neural Network , 2004 .

[53]  S A Velinsky,et al.  Histogram‐Based Approach for Automated Pavement‐Crack Sensing , 1992 .

[54]  Peggy Subirats,et al.  A combined wavelet-based image processing method for emergent crack detection on pavement surface images , 2004, 2004 12th European Signal Processing Conference.

[55]  Bugao Xu,et al.  A real-time 3D scanning system for pavement distortion inspection , 2009 .

[56]  Guoqiang Wang,et al.  The Segmentation Algorithm for Pavement Cracking Images Based on the Improved Fuzzy Clustering , 2013 .

[57]  Colm P. O'Donnell,et al.  Applications of thermal imaging in food quality and safety assessment , 2010 .

[58]  Wei Jiang,et al.  Convolutional neural network for pothole detection in asphalt pavement , 2019, Road Materials and Pavement Design.

[59]  Zheng Tong,et al.  Pavement defect detection with fully convolutional network and an uncertainty framework , 2020, Comput. Aided Civ. Infrastructure Eng..

[60]  Hanshen Chen,et al.  Pothole detection using location-aware convolutional neural networks , 2020, International Journal of Machine Learning and Cybernetics.

[61]  Junxuan Zhao,et al.  Detection and tracking of pedestrians and vehicles using roadside LiDAR sensors , 2019, Transportation Research Part C: Emerging Technologies.

[62]  Gang Xiong,et al.  The application of the depth camera in the social manufacturing: A review , 2016, 2016 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI).

[63]  Penghui Wang,et al.  Asphalt Pavement Pothole Detection and Segmentation Based on Wavelet Energy Field , 2017 .

[64]  André Sales Mendes,et al.  An Architectural Multi-Agent System for a Pavement Monitoring System with Pothole Recognition in UAV Images , 2020, Sensors.

[65]  Aleksandra V. Varnavina,et al.  Utilization of Air-Launched Ground Penetrating Radar (GPR) for Pavement Condition Assessment , 2017 .

[67]  Tran Hiep Dinh,et al.  Crack Detection Using Enhanced Thresholding on UAV based Collected Images , 2018, ArXiv.

[68]  Giuseppe Loprencipe,et al.  Three-dimensional survey method of pavement texture using photographic equipment , 2017 .

[69]  Jin Lin,et al.  Potholes Detection Based on SVM in the Pavement Distress Image , 2010, 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science.

[70]  J Rahkonen,et al.  Infrared Radiometry for Measuring Plant Leaf Temperature during Thermal Weed Control Treatment , 2003 .

[71]  Tan Zhiming.  Cement Concrete Pavement Faulting Detection and Recognization Based on Binocular Vision , 2011 .

[72]  Juan Li,et al.  Three-dimensional texture measurement using deep learning and multi-view pavement images , 2020 .

[73]  Di Wang,et al.  A Miniature Binocular Endoscope with Local Feature Matching and Stereo Matching for 3D Measurement and 3D Reconstruction , 2018, Sensors.

[74]  Jie Gao,et al.  Autonomous pavement distress detection using ground penetrating radar and region-based deep learning , 2020 .

[75]  Feng Li,et al.  Critical Assessment of Detecting Asphalt Pavement Cracks under Different Lighting and Low Intensity Contrast Conditions Using Emerging 3D Laser Technology , 2012 .

[76]  Makoto Nagao,et al.  Automatic Pavement-Distress-Survey System , 1990 .

[77]  Huidrom Lokeshwor,et al.  Robust Method for Automated Segmentation of Frames with/without Distress from Road Surface Video Clips , 2014 .

[78]  Ibrahim M. Asi,et al.  Evaluating skid resistance of different asphalt concrete mixes , 2007 .

[79]  Mohamed Abdel-Aty,et al.  Design and verification of a laser based device for pavement macrotexture measurement , 2011 .

[80]  Jian Zhu,et al.  Illumination Invariant Enhancement and Threshold Segmentation Algorithm for Asphalt Pavement Crack Image , 2010, 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM).

[81]  Imad L. Al-Qadi,et al.  Pattern recognition algorithms for density estimation of asphalt pavement during compaction: a simulation study , 2014 .

[82]  Mary Stroup-Gardiner,et al.  Using Infrared Thermography to Detect and Measure Segregation in Hot Mix Asphalt Pavements , 2000 .

[83]  Yichang James Tsai,et al.  Enhanced Crack Segmentation Algorithm Using 3D Pavement Data , 2016, J. Comput. Civ. Eng..

[84]  Xu Wang,et al.  Detection and Segmentation of Cement Concrete Pavement Pothole Based on Image Processing Technology , 2020 .

[85]  Luciano Pivoto Specht,et al.  Measurement of pavement macrotexture through digital image processing - doi: 10.4025/actascitechnol.v35i1.12808 , 2013 .

[86]  Lu Sun,et al.  Multi-scale wavelet transform filtering of non-uniform pavement surface image background for automated pavement distress identification , 2016 .

[87]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[88]  Xavier Lladó,et al.  Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review , 2017, Artif. Intell. Medicine.

[89]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[90]  Ahmed Shalaby,et al.  Mean Profile Depth of Pavement Surface Macrotexture Using Photometric Stereo Techniques , 2007 .

[91]  Wei Xu,et al.  Pavement crack detection based on saliency and statistical features , 2013, 2013 IEEE International Conference on Image Processing.

[92]  Ensheng Liu,et al.  Application of Structural Deformation Monitoring Based on Close-Range Photogrammetry Technology , 2021 .

[93]  Ahsan Ali,et al.  Performance assessment of Kinect as a sensor for pothole imaging and metrology* , 2018 .

[94]  Qi Wang,et al.  Design parameters for adjusting the visual field of binocular stereo cameras , 2010 .

[95]  A. Ahmad,et al.  Oil palm dry season analysis based on moderate-resolution imaging spectroradiometer (MODIS) satellite indices , 2019, International Journal of Remote Sensing.

[96]  Jie Gao,et al.  Recognition of asphalt pavement crack length using deep convolutional neural networks , 2018 .

[97]  Andrzej Czyzewski,et al.  Economical methods for measuring road surface roughness , 2018 .

[98]  Kevin Heaslip,et al.  Inferring transportation modes from GPS trajectories using a convolutional neural network , 2018, ArXiv.

[99]  X. Xue,et al.  Image‐based road crack risk‐informed assessment using a convolutional neural network and an unmanned aerial vehicle , 2021, Structural Control and Health Monitoring.

[100]  Jiong Zhang,et al.  Measurement method of asphalt pavement mean texture depth based on multi-line laser and binocular vision , 2017 .

[101]  Fan Yang,et al.  Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection , 2019, IEEE Transactions on Intelligent Transportation Systems.

[102]  Gang Li,et al.  Fuzzy contrast enhancement algorithm for road surface image based on adaptively changing index via grey entropy , 2013 .

[103]  Rytis Augustauskas,et al.  Improved Pixel-Level Pavement-Defect Segmentation Using a Deep Autoencoder , 2020, Sensors.

[104]  Ahmet Bahaddin Ersoz,et al.  Crack identification for rigid pavements using unmanned aerial vehicles , 2017 .

[105]  Majdi Khoudeir,et al.  Characterization of road microtexture by meansof image analysis , 2005 .

[106]  Elisabete F. Freitas,et al.  3D surface profile equipment for the characterization of the pavement texture - TexScan , 2010 .

[107]  Imad L. Al-Qadi,et al.  Automatic detection of multiple pavement layers from GPR data , 2008 .

[108]  Shuai Li,et al.  Automatic Pavement-Crack Detection and Segmentation Based on Steerable Matched Filtering and an Active Contour Model , 2017, J. Comput. Civ. Eng..

[110]  Khurram Kamal,et al.  Pavement crack detection using the Gabor filter , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[111]  Xin Xu,et al.  Automatic road-marking detection and measurement from laser-scanning 3D profile data , 2019 .

[112]  Kelvin C. P. Wang,et al.  Wavelet-Based Pavement Distress Image Edge Detection with À Trous Algorithm , 2007 .

[113]  Christian Koch,et al.  Pothole detection in asphalt pavement images , 2011, Adv. Eng. Informatics.

[114]  Chen Zhang.  An Edge Detection Method Designed for Pavement Distress Images , 2011 .

[115]  Yaping Wang,et al.  The Classification of Pavement Crack Image Based on Beamlet Algorithm , 2013, CCTA.

[116]  Jiao Licheng,et al.  Automation of recogniting pavement surface distress based on support vector machine , 2007 .

[117]  Song Hong-xun.  Error analysis in road rut measurement with multi-sensors , 2007 .

[118]  Kelvin C. P. Wang,et al.  Automated Joint Faulting Measurement Using 3D Pavement Texture Data at 1 mm Resolution , 2014 .

[119]  Paulo Lobato Correia,et al.  Automatic Road Crack Detection and Characterization , 2013, IEEE Transactions on Intelligent Transportation Systems.

[120]  Robert L. Schmitt,et al.  Infrared Thermography Technologies for Thermal Measurement and Control of HMA Pavement Construction , 2015 .

[121]  Song Yongcha.  Skid-resistant performance of texture structure of exposed-aggregate cement concrete pavement based on digital image technology , 2015 .

[122]  Vinod Chandran,et al.  Asphalt Concrete Surfaces Macrotexture Determination From Still Images , 2011, IEEE Transactions on Intelligent Transportation Systems.

[123]  Jérôme Idier,et al.  Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection , 2016, IEEE transactions on intelligent transportation systems (Print).

[124]  Yichang Tsai,et al.  Feasibility Study of Measuring Concrete Joint Faulting Using 3D Continuous Pavement Profile Data , 2011 .

[125]  Peihe Tang,et al.  A new method to pavement cracking detection based on the Biological Inspired Model , 2012, 2012 International Conference on Computer Science and Information Processing (CSIP).

[127]  A. Loizos,et al.  Integration of non-destructive testing methods to assess asphalt pavement thickness , 2020 .

[128]  Qingquan Li,et al.  CrackTree: Automatic crack detection from pavement images , 2012, Pattern Recognit. Lett..

[129]  Hyun-Seok Yoo,et al.  Development of a crack recognition algorithm from non-routed pavement images using artificial neural network and binary logistic regression , 2016 .

[130]  Tao Liu,et al.  Research on skid resistance of asphalt pavement based on three-dimensional laser-scanning technology and pressure-sensitive film , 2014 .

[131]  Fereidoon Moghadas Nejad,et al.  Automatic image acquisition with knowledge-based approach for multi-directional determination of skid resistance of pavements , 2016 .

[132]  Pang-jo Chun,et al.  Automatic Detection of Cracks in Asphalt Pavement Using Deep Learning to Overcome Weaknesses in Images and GIS Visualization , 2021, Applied Sciences.

[133]  Robert X. Gao,et al.  Pavement Distress Analysis based on Dual-Tree Complex Wavelet Transform , 2012 .

[134]  Guo-Cheng Yuan,et al.  Transcriptome-scale super-resolved imaging in tissues by RNA seqFISH+ , 2019, Nature.

[135]  Yanliang Gu,et al.  Automatic Crack Detection and Segmentation Using a Hybrid Algorithm for Road Distress Analysis , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[136]  Imad L. Al-Qadi,et al.  Calibration of FDTD Simulation of GPR Signal for Asphalt Pavement Compaction Monitoring , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[137]  Zhang Lei,et al.  Investigation of the deformation properties of asphalt mixtures with DIC technique , 2012 .

[138]  Imad L. Al-Qadi,et al.  MEASURING LAYER THICKNESSES WITH GPR - THEORY TO PRACTICE , 2005 .

[139]  Zheng Tong,et al.  Advances of deep learning applications in ground-penetrating radar: A survey , 2020 .

[140]  Fereidoon Moghadas Nejad,et al.  An expert system based on wavelet transform and radon neural network for pavement distress classification , 2011, Expert Syst. Appl..

[141]  Burcin Becerik-Gerber,et al.  Unsupervised Approach for Autonomous Pavement-Defect Detection and Quantification Using an Inexpensive Depth Sensor , 2013, J. Comput. Civ. Eng..

[142]  Bo Shaobo,et al.  Pavement Crack Detection and Analysis for High-grade Highway , 2007, 2007 8th International Conference on Electronic Measurement and Instruments.

[143]  Ezzatollah Salari,et al.  Beamlet Transform‐Based Technique for Pavement Crack Detection and Classification , 2010, Comput. Aided Civ. Infrastructure Eng..

[144]  Qingquan Li,et al.  Pavement Crack Classification via Spatial Distribution Features , 2011, EURASIP J. Adv. Signal Process..

[145]  Shuai Li,et al.  Integrated Processing of Image and GPR Data for Automated Pothole Detection , 2016, J. Comput. Civ. Eng..

[146]  Gerardo W. Flintsch,et al.  Pavement Surface Macrotexture Measurement and Applications , 2003 .