Process Monitoring in Friction Stir Welding Using Convolutional Neural Networks

Preliminary studies have shown the superiority of convolutional neural networks (CNNs) compared to other network architectures for determining the surface quality of friction stir welds. In this paper, CNNs were employed to detect cavities inside friction stir welds by evaluating inline measured process data. The aim was to determine whether CNNs are suitable for identifying surface defects exclusively, or if the approach is transferable to internal weld defects. For this purpose, 120 welds were produced and examined by ultrasonic testing, which was the basis for labeling the data as “good” or “defective.” Different types of artificial neural network were tested for predicting the placement of the welds into the defined classes. It was found that the way of labeling the data is significant for the accuracy achievable. When the complete welds were uniformly labeled as “good” or “defective,” an accuracy of 98.5% was achieved by a CNN, which was a significant improvement compared to the state of the art. When the welds were labeled segment-wise, an accuracy of 79.2% was obtained by using a CNN, showing that a segment-wise prediction of the cavities is also possible. The results confirm that CNNs are well suited for process monitoring in friction stir welding and their application enables the identification of various defect types.

[1]  Bernd Richter Robot-based Friction Stir Welding for E-mobility and General Applications , 2017 .

[2]  C. R. Bird Ultrasonic phased array inspection technology for the evaluation of friction stir welds , 2004 .

[3]  Alvin M. Strauss,et al.  Misalignment detection and enabling of seam tracking for friction stir welding , 2009 .

[4]  Tarasankar DebRoy,et al.  Conditions for void formation in friction stir welding from machine learning , 2019, npj Computational Materials.

[5]  Artificial Neural Network Model for Friction Stir Processing , 2014 .

[6]  Warren W. Harper,et al.  Investigation of Nondestructive Testing Methods for Friction Stir Welding , 2019, Metals.

[7]  Michael F. Zaeh,et al.  Improving the surface quality of friction stir welds using reinforcement learning and Bayesian optimization , 2020, The International Journal of Advanced Manufacturing Technology.

[8]  Klaus-Dieter Thoben,et al.  Machine learning in manufacturing: advantages, challenges, and applications , 2016 .

[9]  Andrew Kusiak,et al.  Convolutional and generative adversarial neural networks in manufacturing , 2019, Int. J. Prod. Res..

[10]  Boualem Boashash,et al.  Estimating and interpreting the instantaneous frequency of a signal. I. Fundamentals , 1992, Proc. IEEE.

[11]  Gerd Dobmann,et al.  Monitoring of the Friction Stir Welding Process to Describe Parameter Effects on Joint Quality , 2008 .

[12]  K. J. Colligan,et al.  The friction stir welding process: an overview , 2010 .

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  N. Murugan,et al.  Application of artificial neural network in predicting the wear rate of copper surface composites produced using friction stir processing , 2020, Australian Journal of Mechanical Engineering.

[15]  M. F. Zaeh,et al.  The effect of additive geometry on the integration of secondary elements during Friction Stir Processing , 2018, IOP Conference Series: Materials Science and Engineering.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[18]  Surjya K. Pal,et al.  A review on sensor based monitoring and control of friction stir welding process and a roadmap to Industry 4.0 , 2018, Journal of Manufacturing Processes.

[19]  M. Zaeh,et al.  Real-time prediction of quality characteristics in laser beam welding using optical coherence tomography and machine learning , 2020 .

[20]  Göran Falkman,et al.  Using recurrent neural networks with attention for detecting problematic slab shapes in steel rolling , 2019, Applied Mathematical Modelling.

[21]  Akshansh Mishra Convolution Neural Network for Image Processing of Friction Stir Welded and Conventional Welded Joints Texture , 2019 .

[22]  Antonette M. Logar,et al.  The use of neural network and discrete Fourier transform for real-time evaluation of friction stir welding , 2011, Appl. Soft Comput..

[23]  Natarajan Sriraam,et al.  Pattern recognition of spectral entropy features for detection of alcoholic and control visual ERP’s in multichannel EEGs , 2017, Brain Informatics.

[24]  R. Hartl,et al.  Prediction of the surface quality of friction stir welds by the analysis of process data using Artificial Neural Networks , 2020, Proceedings of the Institution of Mechanical Engineers, Part L: Journal of Materials: Design and Applications.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).