Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection

Corrosion is a major defect in structural systems that has a significant economic impact and can pose safety risks if left untended. Currently, an inspector visually assesses the condition of a structure to identify corrosion. This approach is time-consuming, tedious, and subjective. Robotic systems, such as unmanned aerial vehicles, paired with computer vision algorithms have the potential to perform autonomous damage detection that can significantly decrease inspection time and lead to more frequent and objective inspections. This study evaluates the use of convolutional neural networks for corrosion detection. A convolutional neural network learns the appropriate classification features that in traditional algorithms were hand-engineered. Eliminating the need for dependence on prior knowledge and human effort in designing features is a major advantage of convolutional neural networks. This article presents different convolutional neural network–based approaches for corrosion assessment on metallic surfaces. The effect of different color spaces, sliding window sizes, and convolutional neural network architectures are discussed. To this end, the performance of two pretrained state-of-the-art convolutional neural network architectures as well as two proposed convolutional neural network architectures are evaluated, and it is shown that convolutional neural networks outperform state-of-the-art vision-based corrosion detection approaches that are developed based on texture and color analysis using a simple multilayered perceptron network. Furthermore, it is shown that one of the proposed convolutional neural networks significantly improves the computational time in contrast with state-of-the-art pretrained convolutional neural networks while maintaining comparable performance for corrosion detection.

[1]  Giovanni Montana,et al.  Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks , 2015, ICPRAM 2015.

[2]  Sami F. Masri,et al.  Parametric Performance Evaluation of Wavelet-Based Corrosion Detection Algorithms for Condition Assessment of Civil Infrastructure Systems , 2013, J. Comput. Civ. Eng..

[3]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Ramana M. Pidaparti,et al.  Classification of corrosion defects in NiAl bronze through image analysis , 2010 .

[8]  R. Siegwart,et al.  A UAV system for inspection of industrial facilities , 2013, 2013 IEEE Aerospace Conference.

[9]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[10]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[11]  Ramana M. Pidaparti,et al.  Structural Corrosion Health Assessment using Computational Intelligence Methods , 2007 .

[12]  Alberto Ortiz,et al.  Combination of weak classifiers for metallic corrosion detection and guided crack location , 2010, 2010 IEEE 15th Conference on Emerging Technologies & Factory Automation (ETFA 2010).

[13]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Vikram Pakrashi,et al.  ROC dependent event isolation method for image processing based assessment of corroded harbour structures , 2010 .

[15]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[16]  S. S. Kim,et al.  Morphological analysis and classification of types of surface corrosion damage by digital image processing , 2005 .

[17]  Mel Siegel,et al.  Remote Enhanced Visual Inspection of Aircraft by a Mobile Robot , 1998 .

[18]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[19]  Sangwook Lee,et al.  Automated recognition of surface defects using digital color image processing , 2006 .

[20]  Sangwook Lee,et al.  Wavelet domain detection of rust in steel bridge images , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[22]  Gaurav S. Sukhatme,et al.  A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures , 2009 .

[23]  M. J. Palakal,et al.  Intelligent Computational Methods for Corrosion Damage Assessment , 2001 .

[24]  Fátima N. S. de Medeiros,et al.  On the Evaluation of Texture and Color Features for Nondestructive Corrosion Detection , 2010, EURASIP J. Adv. Signal Process..

[25]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[28]  Paul Scheunders,et al.  Classification of Corrosion Images by Wavelet Signatures and LVQ Networks , 1995, CAIP.

[29]  Jinhai Cai,et al.  Knowledge-based power line detection for UAV surveillance and inspection systems , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[30]  Xianghua Xie,et al.  A Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques , 2008 .

[31]  Kotaro Hirasawa,et al.  Genetic algorithm optimization of a convolutional neural network for autonomous crack detection , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[32]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[33]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[34]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[35]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[36]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Tarek Hamel,et al.  A UAV for bridge inspection: Visual servoing control law with orientation limits , 2007 .

[38]  H. Furuta,et al.  Neural network analysis of structural damage due to corrosion , 1995, Proceedings of 3rd International Symposium on Uncertainty Modeling and Analysis and Annual Conference of the North American Fuzzy Information Processing Society.

[39]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Truong Q. Nguyen,et al.  Wavelets and filter banks , 1996 .

[41]  Bok-Min Goi,et al.  Comparing Image Representations for Training a Convolutional Neural Network to Classify Gender , 2013, 2013 1st International Conference on Artificial Intelligence, Modelling and Simulation.

[42]  Gregg Podnar,et al.  Image understanding algorithms for remote visual inspection of aircraft surfaces , 1997, Electronic Imaging.