Automatic detection of welding defects using the convolutional neural network

Quality control of welded joints is an important step before commissioning of various types of metal structures. The main obstacles to the commissioning of such facilities are the areas where the welded joint deviates from acceptable defective standards. The defects of welded joints include non-welded, foreign inclusions, cracks, pores, etc. The article describes an approach to the detection of the main types of defects of welded joints using a combination of convolutional neural networks and support vector machine methods. Convolutional neural networks are used for primary classification. The support vector machine is used to accurately define defect boundaries. As a preprocessing in our work, we use the methods of morphological filtration. A series of experiments confirms the high efficiency of the proposed method in comparison with pure CNN method for detecting defects.

[1]  Leen-Kiat Soh,et al.  Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices , 1999, IEEE Trans. Geosci. Remote. Sens..

[2]  Gamal I. Selim,et al.  Higher-Order Statistics for Automatic Weld Defect Detection , 2013 .

[3]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Domingo Mery,et al.  GDXray: The Database of X-ray Images for Nondestructive Testing , 2015, Journal of Nondestructive Evaluation.

[7]  Jorge Herbert de Lira,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[8]  Zhang Li,et al.  Contrast Limited Adaptive Histogram Equalization , 2010 .

[9]  Ye Wei,et al.  Automatic Detection of Welding Defects using Deep Neural Network , 2018 .

[10]  Jayendra Kumar,et al.  Multi - Class welding flaws classification using texture feature for radiographic images , 2014, 2014 International Conference on Advances in Electrical Engineering (ICAEE).

[11]  David A Clausi An analysis of co-occurrence texture statistics as a function of grey level quantization , 2002 .

[12]  Alan George,et al.  Inside the FFT Black Box: Serial and Parallel Fast Fourier Transform Algorithms , 2019 .

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[15]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[16]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[17]  Maria Petrou,et al.  Image processing - the fundamentals , 1999 .

[18]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[19]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[20]  Aleksandra Pizurica,et al.  A deep learning approach to crack detection in panel paintings , 2018 .

[21]  Stuart Harvey Rubin,et al.  Automatic detection of welding defects , 2011, Int. J. Reason. based Intell. Syst..

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[24]  Domingo Mery,et al.  Automatic detection of welding defects using texture features , 2003 .