Fast Detection of Missing Thin Propagating Cracks during Deep-Learning-Based Concrete Crack/Non-Crack Classification

Existing deep learning (DL) models can detect wider or thicker segments of cracks that occupy multiple pixels in the width direction, but fail to distinguish the thin tail shallow segment or propagating crack occupying fewer pixels. Therefore, in this study, we proposed a scheme for tracking missing thin/propagating crack segments during DL-based crack identification on concrete surfaces in a computationally efficient manner. The proposed scheme employs image processing as a preprocessor and a postprocessor for a 1D DL model. Image-processing-assisted DL as a precursor to DL eliminates labor-intensive labeling and the plane structural background without any distinguishable features during DL training and testing; the model identifies potential crack candidate regions. Iterative differential sliding-window-based local image processing as a postprocessor to DL tracks missing thin cracks on segments classified as cracks. The capability of the proposed method is demonstrated on low-resolution images with cracks of single-pixel width, captured using unmanned aerial vehicles on concrete structures with different surface textures, different scenes with complicated disturbances, and optical variability. Due to the multi-threshold-based image processing, the overall approach is invariant to the choice of initial sensitivity parameters, hyperparameters, and the sequence of neuron arrangement. Further, this technique is a computationally efficient alternative to semantic segmentation that results in pixelated mapping/classification of thin crack regimes, which requires labor-intensive and skilled labeling.

[1]  Jiyang Fu,et al.  Autonomous surface crack identification of concrete structures based on an improved one-stage object detection algorithm , 2022, Engineering Structures.

[2]  S. Sim,et al.  Fast identification of concrete cracks using 1D deep learning and explainable artificial intelligence-based analysis , 2022, Automation in Construction.

[3]  Subhamoy Sen,et al.  Comparative study on sensitivity of acceleration and strain responses for bridge health monitoring , 2022, Journal of Structural Integrity and Maintenance.

[4]  H. Furuta,et al.  Evaluation of crack propagation in concrete bridges from vehicle-mounted camera images using deep learning and image processing , 2022, Frontiers in Built Environment.

[5]  Jizhong Xiao,et al.  Automated wall‐climbing robot for concrete construction inspection , 2022, J. Field Robotics.

[6]  Dong Fu,et al.  Automatic detection of defects in concrete structures based on deep learning , 2022, Structures.

[7]  X. Kong,et al.  Crack detection algorithm for concrete structures based on super-resolution reconstruction and segmentation network , 2022, Automation in Construction.

[8]  Hafiz Suliman Munawar,et al.  Crack Detection in Concrete Structures Using Deep Learning , 2022, Sustainability.

[9]  Y. An,et al.  Automated bridge crack evaluation through deep super resolution network-based hybrid image matching , 2022, Automation in Construction.

[10]  Shijie Deng,et al.  Deep learning-based fast detection of apparent concrete crack in slab tracks with dilated convolution , 2022, Construction and Building Materials.

[11]  K. Nakao,et al.  Machine learning-based evaluation of the damage caused by cracks on concrete structures , 2022, Precision Engineering.

[12]  S. Xiang,et al.  Intelligent Crack Detection and Quantification in the Concrete Bridge: A Deep Learning-Assisted Image Processing Approach , 2022, Advances in Civil Engineering.

[13]  Y. Hamishebahar,et al.  A Comprehensive Review of Deep Learning-Based Crack Detection Approaches , 2022, Applied Sciences.

[14]  D. Mahapatra,et al.  Ultrasonic horn contact-induced transient anharmonic resonance effect on vibro-thermography , 2022, Journal of Sound and Vibration.

[15]  Joon Huang Chuah,et al.  Structural crack detection using deep convolutional neural networks , 2022, Automation in Construction.

[16]  Seyed Mohammad Mirjalili,et al.  A novel approach for deterioration and damage identification in building structures based on Stockwell-Transform and deep convolutional neural network , 2021, Journal of Structural Integrity and Maintenance.

[17]  Hao Li,et al.  Concrete crack segmentation based on UAV-enabled edge computing , 2021, Neurocomputing.

[18]  Zhanping You,et al.  Research and applications of artificial neural network in pavement engineering: a state-of-the-art review , 2021 .

[19]  S. Travis Waller,et al.  Image-Based Crack Detection Methods: A Review , 2021, Infrastructures.

[20]  Md. Rahat Shahriar Zawad,et al.  A Comparative Review of Image Processing Based Crack Detection Techniques on Civil Engineering Structures , 2021 .

[21]  Alireza Ahmadian Fard Fini,et al.  Computer vision-based interior construction progress monitoring: A literature review and future research directions , 2021, Automation in Construction.

[22]  Shanglian Zhou,et al.  Crack segmentation through deep convolutional neural networks and heterogeneous image fusion , 2021 .

[23]  D. Mahapatra,et al.  Transient Vibro-Thermography and Nonlinear Resonant Modes , 2020 .

[24]  Amir H. Alavi,et al.  Real-Time Detection of Cracks on Concrete Bridge Decks Using Deep Learning in the Frequency Domain , 2020, Engineering.

[25]  Glenn Washer,et al.  Human factors affecting visual inspection of fatigue cracking in steel bridges , 2020, Structure and Infrastructure Engineering.

[26]  Yichang James Tsai,et al.  Machine Learning for Crack Detection: Review and Model Performance Comparison , 2020, J. Comput. Civ. Eng..

[27]  Walter Kaufmann,et al.  Automated crack detection and measurement based on digital image correlation , 2020, Construction and Building Materials.

[28]  Chuan-Zhi Dong,et al.  A review of computer vision–based structural health monitoring at local and global levels , 2020 .

[29]  Tatsuro Yamane,et al.  Automatic detection method of cracks from concrete surface imagery using two‐step light gradient boosting machine , 2020, Comput. Aided Civ. Infrastructure Eng..

[30]  Xudong Chen,et al.  Experimental Study on Crack Propagation of Concrete Under Various Loading Rates with Digital Image Correlation Method , 2020, International Journal of Concrete Structures and Materials.

[31]  Yun-Kyu An,et al.  Automated crack evaluation of a high‐rise bridge pier using a ring‐type climbing robot , 2020, Comput. Aided Civ. Infrastructure Eng..

[32]  Jian Zhang,et al.  Real‐time crack assessment using deep neural networks with wall‐climbing unmanned aerial system , 2019, Comput. Aided Civ. Infrastructure Eng..

[33]  Chunlu Liu,et al.  Applications of multirotor drone technologies in construction management , 2019 .

[34]  Billie F. Spencer,et al.  Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring , 2019, Engineering.

[35]  Sung-Han Sim,et al.  Crack and Noncrack Classification from Concrete Surface Images Using Machine Learning , 2019 .

[36]  M. Climent,et al.  Use of Non-Linear Ultrasonic Techniques to Detect Cracks Due to Steel Corrosion in Reinforced Concrete Structures , 2019, Materials.

[37]  Yang Liu,et al.  Automated Pixel‐Level Pavement Crack Detection on 3D Asphalt Surfaces with a Recurrent Neural Network , 2018, Comput. Aided Civ. Infrastructure Eng..

[38]  X. Nie,et al.  Detection and segmentation of mechanical damage in concrete with X-Ray microtomography , 2018, Materials Characterization.

[39]  Sanghoon Kim,et al.  Automatic image thresholding using Otsu’s method and entropy weighting scheme for surface defect detection , 2017, Soft Computing.

[40]  Jian Yao,et al.  Automatic multi-image stitching for concrete bridge inspection by combining point and line features , 2018, Automation in Construction.

[41]  Sung-Han Sim,et al.  Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing , 2017, Sensors.

[42]  Arnaud Deraemaeker,et al.  Real-time fast ultrasonic monitoring of concrete cracking using embedded piezoelectric transducers , 2017 .

[43]  J. M. Palomares,et al.  Efficient pavement crack detection and classification , 2017, EURASIP J. Image Video Process..

[44]  Sumathi Poobal,et al.  Crack detection using image processing: A critical review and analysis , 2017, Alexandria Engineering Journal.

[45]  Fan Meng,et al.  Automatic Road Crack Detection Using Random Structured Forests , 2016, IEEE Transactions on Intelligent Transportation Systems.

[46]  Myriam Vimond,et al.  Illumination problems in digital images. A statistical point of view , 2016, J. Multivar. Anal..

[47]  D. Roy Mahapatra,et al.  Laser Doppler imaging of delamination in a composite T-joint with remotely located ultrasonic actuators , 2016 .

[48]  Debasis Deb,et al.  Automatic detection and classification of damage zone(s) for incorporating in digital image correlation technique , 2016 .

[49]  Fan Xi,et al.  Detection crack in image using Otsu method and multiple filtering in image processing techniques , 2016 .

[50]  Hugues Talbot,et al.  Image Noise and Digital Image Forensics , 2015, IWDW.

[51]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[52]  Paulo Lobato Correia,et al.  CrackIT — An image processing toolbox for crack detection and characterization , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[53]  Markus König,et al.  Achievements and Challenges in Machine Vision-Based Inspection of Large Concrete Structures , 2014 .

[54]  Weihua Sheng,et al.  A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance , 2014, IEEE Transactions on Automation Science and Engineering.

[55]  Chih-Yang Lin,et al.  An improved method for image thresholding based on the valley-emphasis method , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[56]  Achintya Haldar,et al.  Health assessment of engineered structures: Bridges, buildings, and other infrastructures , 2013 .

[57]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[58]  Bo Lei,et al.  A modified valley-emphasis method for automatic thresholding , 2012, Pattern Recognit. Lett..

[59]  Jeong Ho Lee,et al.  Bridge inspection robot system with machine vision , 2009 .

[60]  J M W Brownjohn,et al.  Structural health monitoring of civil infrastructure , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[61]  Derek Bradley,et al.  Adaptive Thresholding using the Integral Image , 2007, J. Graph. Tools.

[62]  S. Hashimoto,et al.  Automated Crack Detection for Concrete Surface Image Using Percolation Model and Edge Information , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[63]  Chung Bang Yun,et al.  Multiple Crack Detection of Concrete Structures Using Impedance-based Structural Health Monitoring Techniques , 2006 .

[64]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[65]  D. Roy Mahapatra,et al.  Modeling and simulation of vibro-thermography including nonlinear contact dynamics of ultrasonic actuator. , 2019, Ultrasonics.

[66]  M. Anthony Xavior,et al.  Investigation of Surface Texture Using Image Processing Techniques , 2014 .

[67]  N. Otsu A threshold selection method from gray level histograms , 1979 .