Augmented Ultrasonic Data for Machine Learning

Flaw detection in non-destructive testing, especially for complex signals like ultrasonic data, has thus far relied heavily on the expertise and judgement of trained human inspectors. While automated systems have been used for a long time, these have mostly been limited to using simple decision automation, such as signal amplitude threshold. The recent advances in various machine learning algorithms have solved many similarly difficult classification problems, that have previously been considered intractable. For non-destructive testing, encouraging results have already been reported in the open literature, but the use of machine learning is still very limited in NDT applications in the field. Key issue hindering their use, is the limited availability of representative flawed data-sets to be used for training. In the present paper, we develop modern, deep convolutional network to detect flaws from phased-array ultrasonic data. We make extensive use of data augmentation to enhance the initially limited raw data and to aid learning. The data augmentation utilizes virtual flaws—a technique, that has successfully been used in training human inspectors and is soon to be used in nuclear inspection qualification. The results from the machine learning classifier are compared to human performance. We show, that using sophisticated data augmentation, modern deep learning networks can be trained to achieve human-level performance.

[1]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[2]  Jian Sun,et al.  Accelerating Very Deep Convolutional Networks for Classification and Detection , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Mehdi Salkhordeh Haghighi,et al.  Improving nondestructive characterization of dual phase steels using data fusion , 2018, Journal of Magnetism and Magnetic Materials.

[4]  Robert J. Thomas,et al.  Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete , 2018, Construction and Building Materials.

[5]  Jin H. Huang,et al.  Detection of cracks using neural networks and computational mechanics , 2002 .

[6]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[7]  Iikka Virkkunen,et al.  Virtual flaws for NDE training and qualification , 2014 .

[8]  Hannu Hänninen,et al.  Effect of Feedback and Variation on Inspection Reliability , 2017 .

[9]  Gary Marcus,et al.  Deep Learning: A Critical Appraisal , 2018, ArXiv.

[10]  In-Sik Yun,et al.  The defect detection and non-destructive evaluation in weld zone of austenitic stainless steel 304 using neural network-ultrasonic wave , 1998 .

[11]  Tuomas Koskinen,et al.  Producing a POD curve with emulated signal response data , 2018 .

[12]  Min Meng,et al.  Ultrasonic signal classification and imaging system for composite materials via deep convolutional neural networks , 2017, Neurocomputing.

[13]  Gwo Giun Lee,et al.  Neural networks for ultrasonic NDE signal classification using time-frequency analysis , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[15]  Iikka Virkkunen,et al.  Practical Experiences in POD Determination for Airframe ET Inspection , 2016 .

[16]  Tim Barden,et al.  Automated defect detection for Fluorescent Penetrant Inspection using Random Forest , 2019, NDT & E International.

[17]  Sung-Jin Song,et al.  Investigation of deep neural network with drop out for ultrasonic flaw classification in weldments , 2018 .

[18]  Mayank Bansal,et al.  ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst , 2018, Robotics: Science and Systems.

[19]  Sung-Jin Song,et al.  Convolutional neural network for ultrasonic weldment flaw classification in noisy conditions. , 2019, Ultrasonics.

[20]  A. Masnata,et al.  Neural network classification of flaws detected by ultrasonic means , 1996 .

[21]  Mikko Virkkunen,et al.  The use of virtual flaws to increase flexibility of qualification , 2018 .

[22]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  C. Fei,et al.  An ultrasonic flaw-classification system with wavelet-packet decomposition, a mutative scale chaotic genetic algorithm, and a support vector machine and its application to petroleum-transporting pipelines , 2006 .

[24]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[25]  F C Cruz,et al.  Efficient feature selection for neural network based detection of flaws in steel welded joints using ultrasound testing , 2017, Ultrasonics.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Yiming Deng,et al.  A novel machine learning model for eddy current testing with uncertainty , 2019, NDT & E International.

[28]  S. Sambath,et al.  Automatic Defect Classification in Ultrasonic NDT Using Artificial Intelligence , 2011 .

[29]  Jie Gao,et al.  Innovative method for recognizing subgrade defects based on a convolutional neural network , 2018 .