Benchmarking Image Processing Algorithms for Unmanned Aerial System-Assisted Crack Detection in Concrete Structures

This paper summarizes the results of traditional image processing algorithms for detection of defects in concrete using images taken by Unmanned Aerial Systems (UASs). Such algorithms are useful for improving the accuracy of crack detection during autonomous inspection of bridges and other structures, and they have yet to be compared and evaluated on a dataset of concrete images taken by UAS. The authors created a generic image processing algorithm for crack detection, which included the major steps of filter design, edge detection, image enhancement, and segmentation, designed to uniformly compare different edge detectors. Edge detection was carried out by six filters in the spatial (Roberts, Prewitt, Sobel, and Laplacian of Gaussian) and frequency (Butterworth and Gaussian) domains. These algorithms were applied to fifty images each of defected and sound concrete. Performances of the six filters were compared in terms of accuracy, precision, minimum detectable crack width, computational time, and noise-to-signal ratio. In general, frequency domain techniques were slower than spatial domain methods because of the computational intensity of the Fourier and inverse Fourier transformations used to move between spatial and frequency domains. Frequency domain methods also produced noisier images than spatial domain methods. Crack detection in the spatial domain using the Laplacian of Gaussian filter proved to be the fastest, most accurate, and most precise method, and it resulted in the finest detectable crack width. The Laplacian of Gaussian filter in spatial domain is recommended for future applications of real-time crack detection using UAS.

[1]  Robert J. Thomas,et al.  Fatigue Crack Detection Using Unmanned Aerial Systems in Fracture Critical Inspection of Steel Bridges , 2018, Journal of Bridge Engineering.

[2]  Salvatore Salamone,et al.  Multifractal analysis of crack patterns in reinforced concrete shear walls , 2016 .

[3]  Young-Jin Cha,et al.  Vision-based concrete crack detection technique using cascade features , 2018, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[4]  Devin K. Harris,et al.  Combined Imaging Technologies for Concrete Bridge Deck Condition Assessment , 2015 .

[5]  Calvin Coopmans,et al.  Challenges in bridge inspection using small unmanned aerial systems: Results and lessons learned , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[6]  Benjamin A. Graybeal,et al.  Visual Inspection of Highway Bridges , 2002 .

[7]  Jeong Ho Lee,et al.  Bridge inspection robot system with machine vision , 2009 .

[8]  Sumathi Poobal,et al.  Crack detection using image processing: A critical review and analysis , 2017, Alexandria Engineering Journal.

[9]  Robert J. Thomas,et al.  Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete , 2018, Construction and Building Materials.

[10]  Askoldas Podviezko,et al.  Processing Digital Images for Crack Localization in Reinforced Concrete Members , 2015 .

[11]  Robert J. Thomas,et al.  Unmanned Aerial Vehicle Augmented Bridge Inspection Feasibility Study , 2017 .

[12]  Ye Li,et al.  High-accuracy crack detection for concrete bridge based on sub-pixel , 2017, 2017 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[13]  Moncef L. Nehdi,et al.  Infrared thermography model for automated detection of delamination in RC bridge decks , 2018 .

[14]  Wei Li,et al.  A robotic system towards concrete structure spalling and crack database , 2017, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[15]  Sung-Han Sim,et al.  Comparative analysis of image binarization methods for crack identification in concrete structures , 2017 .

[16]  H.K. Kim Filtering in the time and frequency domains , 1978, Proceedings of the IEEE.

[17]  Kasthurirangan Gopalakrishnan,et al.  CRACK DAMAGE DETECTION IN UNMANNED AERIAL VEHICLE IMAGES OF CIVIL INFRASTRUCTURE USING PRE-TRAINED DEEP LEARNING MODEL , 2018 .

[18]  Fan Xi,et al.  Detection crack in image using Otsu method and multiple filtering in image processing techniques , 2016 .

[19]  Shuji Hashimoto,et al.  Image‐Based Crack Detection for Real Concrete Surfaces , 2008 .

[20]  Paul Wintz,et al.  Instructor's manual for digital image processing , 1987 .

[21]  David Lattanzi,et al.  Review of Robotic Infrastructure Inspection Systems , 2017 .

[22]  Robert J. Connor,et al.  Guidelines to Improve the Quality of Element-Level Bridge Inspection Data , 2019 .

[23]  Benjamin A. Graybeal,et al.  Routine Highway Bridge Inspection Condition Documentation Accuracy and Reliability , 2004 .

[24]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[25]  Marc Maguire,et al.  Autonomous Detection of Concrete Cracks on Bridge Decks and Fatigue Cracks on Steel Members , 2017 .

[26]  Qingguo Tian,et al.  A fast adaptive crack detection algorithm based on a double-edge extraction operator of FSM , 2019, Construction and Building Materials.

[27]  Dan M. Frangopol,et al.  Maintenance and management of civil infrastructure based on condition, safety, optimization, and life-cycle cost* , 2007 .

[28]  Robert J. Thomas,et al.  SDNET2018: An annotated image dataset for non-contact concrete crack detection using deep convolutional neural networks , 2018, Data in brief.

[29]  Moncef L. Nehdi,et al.  Remote sensing of concrete bridge decks using unmanned aerial vehicle infrared thermography , 2017 .

[30]  Nhat-Duc Hoang,et al.  Detection of Surface Crack in Building Structures Using Image Processing Technique with an Improved Otsu Method for Image Thresholding , 2018 .

[31]  Nhat-Duc Hoang,et al.  Metaheuristic Optimized Edge Detection for Recognition of Concrete Wall Cracks: A Comparative Study on the Performances of Roberts, Prewitt, Canny, and Sobel Algorithms , 2018, Advances in Civil Engineering.

[32]  Hung Manh La,et al.  A Mobile Robot for Automated Civil Infrastructure Inspection and Evaluation , 2018, 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[33]  Ayan Sadhu,et al.  A literature review of next‐generation smart sensing technology in structural health monitoring , 2019, Structural Control and Health Monitoring.

[34]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[35]  Salvatore Salamone,et al.  A vision-based technique for damage assessment of reinforced concrete structures , 2014, Smart Structures.

[36]  Nenad Gucunski,et al.  Nondestructive evaluation inspection of the Arlington Memorial Bridge using a robotic assisted bridge inspection tool (RABIT) , 2014, Smart Structures.

[37]  Marc Maguire,et al.  Bridge inspection: human performance, unmanned aerial systems and automation , 2018, Journal of Civil Structural Health Monitoring.

[38]  Duzgun Agdas,et al.  Comparison of visual inspection and structural-health monitoring as bridge condition assessment methods , 2016 .

[39]  Ivan Bartoli,et al.  Bridge related damage quantification using unmanned aerial vehicle imagery , 2016 .

[40]  Shuhei Hiasa,et al.  Infrared and High-definition Image-based Bridge Scanning Using UAVs without Traffic Control , 2018 .

[41]  Yunfeng Ai,et al.  Robust image-based crack detection in concrete structure using multi-scale enhancement and visual features , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[42]  Hung Manh La,et al.  Autonomous robotic system using non-destructive evaluation methods for bridge deck inspection , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Robert J. Thomas,et al.  Deep Learning Neural Networks for sUAS-Assisted Structural Inspections: Feasibility and Application , 2018, 2018 International Conference on Unmanned Aircraft Systems (ICUAS).

[44]  Chunde Yang,et al.  The crack detection algorithm of pavement image based on edge information , 2018 .

[45]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[46]  Ali Khaloo,et al.  Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling , 2018 .