Structural Damage Detection using Deep Convolutional Neural Network and Transfer Learning

During the long-term operation of hydro-junction infrastructure, water flow erosion causes concrete surfaces to crack, resulting in seepage, spalling, and rebar exposure. To ensure infrastructure safety, detecting such damage is critical. We propose a highly accurate damage detection method using a deep convolutional neural network with transfer learning. First, we collected images from hydro-junction infrastructure using a high-definition camera. Second, we preprocessed the images using an image expansion method. Finally, we modified the structure of Inception-v3 and trained the network using transfer learning to detect damage. The experiments show that the accuracy of the proposed damage detection method is 96.8%, considerably higher than the accuracy of a support vector machine. The results demonstrate that our damage detection method achieves better damage detection performance.

[1]  Qiang Yang,et al.  IET Renewable Power Generation Special Issue: Performance Assessment and Condition Monitoring of Photovoltaic Systems for Improved Energy Yield Visible defects detection based on UAV-based inspection in large-scale photovoltaic systems , 2020 .

[2]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[3]  Yicheng Li,et al.  A Fast Detection Method via Region‐Based Fully Convolutional Neural Networks for Shield Tunnel Lining Defects , 2018, Comput. Aided Civ. Infrastructure Eng..

[4]  Siddhartha Kumar Khaitan,et al.  Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection , 2017 .

[5]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[6]  Quoc-Lam Nguyen,et al.  Automatic recognition of asphalt pavement cracks using metaheuristic optimized edge detection algorithms and convolution neural network , 2018, Automation in Construction.

[7]  Kristin J. Dana,et al.  Automated Crack Detection on Concrete Bridges , 2016, IEEE Transactions on Automation Science and Engineering.

[8]  Sung-Han Sim,et al.  Crack and Noncrack Classification from Concrete Surface Images Using Machine Learning , 2019 .

[9]  Fan Meng,et al.  Automatic Road Crack Detection Using Random Structured Forests , 2016, IEEE Transactions on Intelligent Transportation Systems.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Tae-Yeon Kim,et al.  Weak bond detection in composites using highly nonlinear solitary waves , 2017 .

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  Dongho Kang,et al.  Autonomous UAVs for Structural Health Monitoring Using Deep Learning and an Ultrasonic Beacon System with Geo‐Tagging , 2018, Comput. Aided Civ. Infrastructure Eng..

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Dimos Polyzois,et al.  Deep learning-based automatic volumetric damage quantification using depth camera , 2019, Automation in Construction.

[16]  Kaige Zhang,et al.  Unified Approach to Pavement Crack and Sealed Crack Detection Using Preclassification Based on Transfer Learning , 2018, J. Comput. Civ. Eng..

[17]  Nikolaos Doulamis,et al.  Deep Convolutional Neural Networks for efficient vision based tunnel inspection , 2015, 2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP).

[18]  Zhibin Lin,et al.  Data-driven support vector machine with optimization techniques for structural health monitoring and damage detection , 2017, KSCE Journal of Civil Engineering.

[19]  Ming-Yu Liu,et al.  Deep Active Learning for Civil Infrastructure Defect Detection and Classification , 2017 .

[20]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[21]  Zijun Zhang,et al.  Automatic Detection of Wind Turbine Blade Surface Cracks Based on UAV-Taken Images , 2017, IEEE Transactions on Industrial Electronics.

[22]  Yozo Fujino,et al.  Concrete Crack Detection by Multiple Sequential Image Filtering , 2012, Comput. Aided Civ. Infrastructure Eng..

[23]  Sung-Han Sim,et al.  Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing , 2017, Sensors.

[24]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Piervincenzo Rizzo,et al.  Nondestructive testing of concrete using highly nonlinear solitary waves , 2017 .

[26]  Ching-Tai Ng,et al.  On the selection of advanced signal processing techniques for guided wave damage identification using a statistical approach , 2014 .

[27]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[28]  Tran Hiep Dinh,et al.  Enhanced discrete particle swarm optimization path planning for UAV vision-based surface inspection , 2017, ArXiv.

[29]  Jun Li,et al.  Structural damage identification based on autoencoder neural networks and deep learning , 2018, Engineering Structures.