Performance enhancement of convolutional neural network for ultrasonic flaw classification by adopting autoencoder

Abstract The industrial application of deep neural networks to automate the ultrasonic weldment flaw classification system has some limitations. The major problem that affects the classification performance of deep neural networks is the noise in the ultrasonic signals. So, in this article, a deep neural network, also known as autoencoder is investigated to remove noise from ultrasonic signals before feeding them to deep learning classifiers. A database was generated from specimens that were closely resembled with pipe weldment geometry having counterbore and weldment defects. Those signals were, later on, corrupted with noise to mimic industrial applicability. An autoencoder was then employed to remove noise from counterbore, planer and volumetric weldment defect signals. The classification performance of the convolutional neural network (CNN) was evaluated in three different ways. At first, without employing the autoencoder, secondly, on the denoised outputs of the autoencoder and on third CNN was trained with the noiseless signals but was tested on the denoised outputs of the autoencoder. The results demonstrate that the autoencoder can successfully remove noise from the ultrasonic weldment defect signals, which consequently improve the defect classification accuracy of the artificially intelligent deep learning classifiers.

[1]  Jin H. Huang,et al.  Detection of cracks using neural networks and computational mechanics , 2002 .

[2]  Kilian Q. Weinberger,et al.  Marginalized Denoising Autoencoders for Domain Adaptation , 2012, ICML.

[3]  Sung-Jin Song,et al.  Ultrasonic flaw classification in weldments using probabilistic neural networks , 1992 .

[4]  Changchun Bao,et al.  Wiener filtering based speech enhancement with Weighted Denoising Auto-encoder and noise classification , 2014, Speech Commun..

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Sung-Jin Song,et al.  Development of an intelligent system for ultrasonic flaw classification in weldments , 2002 .

[8]  Lovedeep Gondara,et al.  Medical Image Denoising Using Convolutional Denoising Autoencoders , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[9]  P. Testoni,et al.  Artificial neural networks for non-destructive evaluation with ultrasonic waves in not accessible pipes , 2005, Fourtieth IAS Annual Meeting. Conference Record of the 2005 Industry Applications Conference, 2005..

[10]  James R. Glass,et al.  Speech feature denoising and dereverberation via deep autoencoders for noisy reverberant speech recognition , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[12]  Ronald Davis,et al.  Neural networks and deep learning , 2017 .

[13]  S. Sambath,et al.  Automatic Defect Classification in Ultrasonic NDT Using Artificial Intelligence , 2011 .

[14]  P. C. M. A. Farias,et al.  Flexible decision support system for ultrasound evaluation of fiber–metal laminates implemented in a DSP , 2016 .

[15]  Sung-Jin Song,et al.  Convolutional neural network for ultrasonic weldment flaw classification in noisy conditions. , 2019, Ultrasonics.

[16]  Michael Martens,et al.  Minimum Counterbore Length and Taper Angle Criteria for Transition Welds , 2016 .

[17]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[18]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[19]  S.S. Udpa,et al.  Frequency invariant classification of ultrasonic weld inspection signals , 1998, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[20]  R. Gallager Principles of Digital Communication , 2008 .

[21]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  F C Cruz,et al.  Efficient feature selection for neural network based detection of flaws in steel welded joints using ultrasound testing , 2017, Ultrasonics.

[24]  Redouane Drai,et al.  Time frequency and wavelet transform applied to selected problems in ultrasonics NDE , 2002 .

[25]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[26]  Yu Tsao,et al.  Speech enhancement based on deep denoising autoencoder , 2013, INTERSPEECH.

[27]  François Chollet,et al.  Deep Learning with Python , 2017 .

[28]  Bixio Rimoldi,et al.  Principles of Digital Communication: A Top-Down Approach , 2016 .

[29]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[30]  Yasuo Horiuchi,et al.  Reverberant speech recognition based on denoising autoencoder , 2013, INTERSPEECH.

[31]  Min Meng,et al.  Ultrasonic signal classification and imaging system for composite materials via deep convolutional neural networks , 2017, Neurocomputing.

[32]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[33]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[34]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[35]  Sung-Jin Song,et al.  Investigation of deep neural network with drop out for ultrasonic flaw classification in weldments , 2018 .

[36]  David A. Bradley,et al.  The use of neural networks in ultrasonic flaw detection , 1999 .

[37]  A. Masnata,et al.  Neural network classification of flaws detected by ultrasonic means , 1996 .