Automatic Pavement Crack Detection by Multi-Scale Image Fusion

Pavement crack detection from images is a challenging problem due to intensity inhomogeneity, topology complexity, low contrast, and noisy texture background. Traditional learning-based approaches have difficulties in obtaining representative training samples. We propose a new unsupervised multi-scale fusion crack detection (MFCD) algorithm that does not require training data. First, we develop a windowed minimal intensity path-based method to extract the candidate cracks in the image at each scale. Second, we find the crack correspondences across different scales. Finally, we develop a crack evaluation model based on a multivariate statistical hypothesis test. Our approach successfully combines strengths from both the large-scale detection (robust but poor in localization) and the small-scale detection (detail-preserving but sensitive to clutter). We analyze and experimentally test the computational complexity of our MFCD algorithm. We have implemented the algorithm and have it extensively tested on three public data sets, including two public pavement data sets and an airport runway data set. Compared with six existing methods, experimental results show that our method outperforms all counterparts. Specifically, it increases the precision, recall, and F1-measure over the state-of-the-art by 22%, 12%, and 19%, respectively, on one public data set.

[1]  Ezzatollah Salari,et al.  Beamlet Transform‐Based Technique for Pavement Crack Detection and Classification , 2010, Comput. Aided Civ. Infrastructure Eng..

[2]  Jingang Yi,et al.  Autonomous robotic system for high-efficiency non-destructive bridge deck inspection and evaluation , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[3]  Bugao Xu,et al.  Automatic inspection of pavement cracking distress , 2005, SPIE Optics + Photonics.

[4]  Kristin J. Dana,et al.  Automated Crack Detection on Concrete Bridges , 2016, IEEE Transactions on Automation Science and Engineering.

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Paulo Lobato Correia,et al.  Automatic Road Crack Detection and Characterization , 2013, IEEE Transactions on Intelligent Transportation Systems.

[7]  Sidney Nascimento Givigi,et al.  Automatic Crack Detection and Measurement Based on Image Analysis , 2016, IEEE Transactions on Instrumentation and Measurement.

[8]  Yun Yong Kim,et al.  Automated image processing technique for detecting and analysing concrete surface cracks , 2013 .

[9]  Anthony J. Yezzi,et al.  Detecting Curves with Unknown Endpoints and Arbitrary Topology Using Minimal Paths , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Kristin J. Dana,et al.  Development of an autonomous bridge deck inspection robotic system , 2017, J. Field Robotics.

[11]  Fan Meng,et al.  Automatic Road Crack Detection Using Random Structured Forests , 2016, IEEE Transactions on Intelligent Transportation Systems.

[12]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[13]  Hung Manh La,et al.  Data analysis and visualization for the bridge deck inspection and evaluation robotic system , 2015 .

[14]  Jingang Yi,et al.  Mechatronic Systems Design for an Autonomous Robotic System for High-Efficiency Bridge Deck Inspection and Evaluation , 2013, IEEE/ASME Transactions on Mechatronics.

[15]  Weihua Sheng,et al.  Developing a crack inspection robot for bridge maintenance , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Yanliang Gu,et al.  Automatic Crack Detection and Segmentation Using a Hybrid Algorithm for Road Distress Analysis , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[17]  Kelwin Fernandes,et al.  Pavement pathologies classification using graph-based features , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[18]  Paulo Lobato Correia,et al.  CrackIT — An image processing toolbox for crack detection and characterization , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[19]  Jérôme Idier,et al.  A new minimal path selection algorithm for automatic crack detection on pavement images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[20]  Jong Pil Yun,et al.  Defect detection algorithm for corner cracks in steel billet using discrete wavelet transform , 2009, 2009 ICCAS-SICE.

[21]  William K. Pratt,et al.  Digital Image Processing, 4th Edition , 2007, J. Electronic Imaging.

[22]  Manuel Avila,et al.  2D image based road pavement crack detection by calculating minimal paths and dynamic programming , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[23]  Sylvie Chambon,et al.  Automatic Road Defect Detection by Textural Pattern Recognition Based on AdaBoost , 2012, Comput. Aided Civ. Infrastructure Eng..

[24]  Qingquan Li,et al.  CrackTree: Automatic crack detection from pavement images , 2012, Pattern Recognit. Lett..

[25]  Qingquan Li,et al.  An efficient and reliable coarse-to-fine approach for asphalt pavement crack detection , 2017, Image Vis. Comput..

[26]  Sylvie Chambon,et al.  Detection of Points of Interest for Geodesic Contours - Application on Road Images for Crack Detection , 2011, VISAPP.

[27]  Manuel Avila,et al.  Free-form anisotropy: A new method for crack detection on pavement surface images , 2011, 2011 18th IEEE International Conference on Image Processing.

[28]  Ignacio Parra,et al.  Adaptive Road Crack Detection System by Pavement Classification , 2011, Sensors.

[29]  Jérôme Idier,et al.  Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection , 2016, IEEE transactions on intelligent transportation systems (Print).

[30]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[31]  Eduardo Zalama Casanova,et al.  Enhanced automatic detection of road surface cracks by combining 2D/3D image processing techniques , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[32]  Weihua Sheng,et al.  A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance , 2014, IEEE Transactions on Automation Science and Engineering.

[33]  S. Chambon,et al.  Automatic Road Pavement Assessment with Image Processing: Review and Comparison , 2011 .

[34]  Yong Hu,et al.  Automatic Pavement Crack Detection Using Texture and Shape Descriptors , 2010 .

[35]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.