A weld line detection robot based on structure light for automatic NDT

In automatic non-destructive testing (NDT), weld bead tracking is usually performed outside. However, irregular weld boundaries, unconstrained illumination, and rough metal surfaces can cause noise, which increases the difficulty of seam tracking. In this paper, a method of parallel structured light (PSL) sensing based on deep learning and information fusion is proposed to detect weld lines. First, a camera is used to capture the laser stripe image projected by the PSL on the weld bead. Then, a MobileNet-SSD deep learning model is trained to extract the regions of interest (ROIs) to de-noise the laser stripe image. Finally, the weld line is obtained by fusing information from multiple weld boundaries.

[1]  Daniel F. García,et al.  Fast and robust laser stripe extraction for 3D reconstruction in industrial environments , 2010, Machine Vision and Applications.

[2]  Nadia Bhuiyan,et al.  A new model of sustainable product development process for making trade-offs , 2018 .

[3]  Guisheng Yin,et al.  A Cross Structured Light Sensor and Stripe Segmentation Method for Visual Tracking of a Wall Climbing Robot , 2015, Sensors.

[4]  Shuzhi Sam Ge,et al.  Automatic Welding Seam Tracking and Identification , 2017, IEEE Transactions on Industrial Electronics.

[5]  Bimal Kumar Mishra,et al.  Library Formation of Known Malicious Attacks and their Future Variants , 2016 .

[6]  Liang Lu,et al.  Terrain surface classification with a control mode update rule using a 2D laser stripe-based structured light sensor , 2011, Robotics Auton. Syst..

[7]  Li Xiang,et al.  Image Processing of Seam Tracking System Using Laser Vision , 2007 .

[8]  Yong-Hua Shi,et al.  Adaptive Robotic Welding System Using Laser Vision Sensing for Underwater Engineering , 2007, 2007 IEEE International Conference on Control and Automation.

[9]  Radovan Kovacevic,et al.  Development of a real-time laser-based machine vision system to monitor and control welding processes , 2012 .

[10]  Wei Yang,et al.  Weld Line Detection and Tracking via Spatial-Temporal Cascaded Hidden Markov Models and Cross Structured Light , 2014, IEEE Transactions on Instrumentation and Measurement.

[11]  Dong Du,et al.  A Precise Visual Method for Narrow Butt Detection in Specular Reflection Workpiece Welding , 2016, Sensors.

[12]  Y. S. Choi,et al.  Development of a Multiline Laser Vision Sensor for Joint Tracking in Welding , 2009 .

[13]  De Xu,et al.  Image-based visual seam tracking system for fillet joint , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[14]  Kaspar Althoefer,et al.  Automated Pipe Defect Detection and Categorization Using Camera/Laser-Based Profiler and Artificial Neural Network , 2007, IEEE Transactions on Automation Science and Engineering.

[15]  Zhang Wenzeng.  Visual method for weld seam recognition based on multi-feature extraction and information fusion , 2013 .

[16]  Qixiang Ye,et al.  Robust weld line detection with cross structured light and Hidden Markov Model , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[17]  Jae-Woong Kim,et al.  A study on a vision sensor system for tracking the I-Butt weld joints , 2005 .

[18]  Li Wang,et al.  A Weld Position Recognition Method Based on Directional and Structured Light Information Fusion in Multi-Layer/Multi-Pass Welding , 2018, Sensors.

[19]  De Xu,et al.  Visual seam tracking system for butt weld of thin plate , 2010 .

[20]  De Xu,et al.  Measurement and Defect Detection of the Weld Bead Based on Online Vision Inspection , 2010, IEEE Transactions on Instrumentation and Measurement.

[21]  Wen Wan,et al.  Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor , 2013 .

[22]  Essam Abo-Serie,et al.  A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision , 2018 .

[23]  Katsumasa Saito,et al.  Noncontact 3-D Digitizing and Machining System for Free-Form Surfaces , 1991 .

[24]  Juan C. Granda,et al.  Uncertainty Propagation Analysis in 3-D Shape Measurement Using Laser Range Finding , 2012, IEEE Transactions on Instrumentation and Measurement.