Concrete Crack Pixel Classification Using an Encoder Decoder Based Deep Learning Architecture

Civil infrastructure inspection in hazardous areas such as underwater beams, bridge decks, etc., is a perilous task. In addition, other factors like labor intensity, time, etc. influence the inspection of infrastructures. Recent studies [11] represent that, an autonomous inspection of civil infrastructure can eradicate most of the problems stemming from manual inspection. In this paper, we address the problem of detecting cracks in the concrete surface. Most of the recent crack detection techniques use deep architecture. However, finding the exact location of crack efficiently has been a difficult problem recently. Therefore, a deep architecture is proposed in this paper, to identify the exact location of cracks. Our architecture labels each pixel as crack or non-crack, which eliminates the need for using any existing post-processing techniques in the current literature [5, 11]. Moreover, acquiring enough data for learning is another challenge in concrete defect detection. According to previous studies, only 10% of an image contains edge pixels (in our case defected areas) [31]. We proposed a robust data augmentation technique to alleviate the need for collecting more crack image samples. The experimental results show that, with our method, significant accuracy can be obtained with very less sample of data. Our proposed method also outperforms the existing methods of concrete crack classification.

[1]  Xiangzhi Bai,et al.  Multiple linear feature detection based on multiple-structuring-element center-surround top-hat transform. , 2012, Applied optics.

[2]  Bo Shaobo,et al.  Pavement Crack Detection and Analysis for High-grade Highway , 2007, 2007 8th International Conference on Electronic Measurement and Instruments.

[3]  Hung Manh La,et al.  A Genetic Algorithm for Convolutional Network Structure Optimization for Concrete Crack Detection , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[4]  Anders Landström,et al.  Morphology-Based Crack Detection for Steel Slabs , 2012, IEEE Journal of Selected Topics in Signal Processing.

[5]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Ignacio Parra,et al.  Adaptive Road Crack Detection System by Pavement Classification , 2011, Sensors.

[7]  Qingquan Li,et al.  Novel Approach to Pavement Image Segmentation Based on Neighboring Difference Histogram Method , 2008, 2008 Congress on Image and Signal Processing.

[8]  Weihua Sheng,et al.  Developing a crack inspection robot for bridge maintenance , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Alireza Tavakkoli,et al.  Classification of Concrete Crack using Deep Residual Network , 2019 .

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Naoki Tanaka,et al.  A Crack Detection Method in Road Surface Images Using Morphology , 1998, MVA.

[12]  Huy Pham,et al.  Nondestructive evaluation sensor fusion with autonomous robotic system for civil infrastructure inspection , 2018, J. Field Robotics.

[13]  Weihua Sheng,et al.  A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance , 2014, IEEE Transactions on Automation Science and Engineering.

[14]  Ezzatollah Salari,et al.  Automated pavement distress detection using advanced image processing techniques , 2009, 2009 IEEE International Conference on Electro/Information Technology.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Kristin J. Dana,et al.  Development of an autonomous bridge deck inspection robotic system , 2017, J. Field Robotics.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[20]  Kristin J. Dana,et al.  Computer-vision based crack detection and analysis , 2012, Smart Structures.

[21]  Jingang Yi,et al.  Mechatronic Systems Design for an Autonomous Robotic System for High-Efficiency Bridge Deck Inspection and Evaluation , 2013, IEEE/ASME Transactions on Mechatronics.

[22]  Paulo Lobato Correia,et al.  Automatic road crack segmentation using entropy and image dynamic thresholding , 2009, 2009 17th European Signal Processing Conference.

[23]  Hui-li Zhao,et al.  Improvement of canny algorithm based on pavement edge detection , 2010, 2010 3rd International Congress on Image and Signal Processing.

[24]  H. Elbehiery,et al.  Surface Defects Detection for Ceramic Tiles Using Image Processing and Morphological Techniques , 2007, WEC.

[25]  Xue Li,et al.  A Neural Network based Technique for Automatic Classification of Road Cracks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[26]  Hung Manh La,et al.  Data analysis and visualization for the bridge deck inspection and evaluation robotic system , 2015 .

[27]  Hung Manh La,et al.  A multi-functional inspection robot for civil infrastructure evaluation and maintenance , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Jingang Yi,et al.  Autonomous robotic system for bridge deck data collection and analysis , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  M. Avila,et al.  Detection of defects in road surface by a vision system , 2008, MELECON 2008 - The 14th IEEE Mediterranean Electrotechnical Conference.

[30]  Tran Hiep Dinh,et al.  Computer vision-based method for concrete crack detection , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[31]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..