Weld seam profile extraction of T-joints based on orientation saliency for path planning and seam tracking

In the development of intelligentized robotic welding, weld seam profile extraction is a prerequisite in thick plate welding for path planning and seam tracking. This paper presents a robotic welding system to implement autonomous welding for T-joints, where a novel vision sensor is employed to capture weld seam profiles and weld pools simultaneously in the same frame. It exploits lasers to profile the T-joint. This paper concentrates on accurately extracting the seam profile from the background of the weld pool. An effective procedure of extracting the weld seam profile of the T-joint based on the orientation saliency of the laser stripe is proposed. Experimental results showed the effectiveness of the proposed method.

[1]  Wen Wan,et al.  Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor , 2013 .

[2]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[3]  Hyeong-Soon Moon,et al.  Multi sensor data fusion for improving performance and reliability of fully automatic welding system , 2006 .

[4]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[5]  Shanben Chen,et al.  Passive vision based seam tracking system for pulse-MAG welding , 2013 .

[6]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[7]  Yanxi Zhang,et al.  Analysis of characteristics of molten pool using cast shadow during high-power disk laser welding , 2014 .

[8]  Ming-liang Wu,et al.  Extract the aluminum alloy MIG welding pool edge with Otsu threshold selection based on the genetic algorithmic , 2010, The 2nd International Conference on Information Science and Engineering.

[9]  Ziqin Chen,et al.  Detection of weld pool width using infrared imaging during high-power fiber laser welding of type 304 austenitic stainless steel , 2014 .

[10]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[11]  Jeom-Goo Kim,et al.  Development of Automatic Welding System for Multi-Layer and Multi-Pass Welding , 2008 .

[13]  Yuxi Chen,et al.  Autonomous Detection of Weld Seam Profiles via a Model of Saliency-Based Visual Attention for Robotic Arc Welding , 2016, J. Intell. Robotic Syst..

[14]  Yanling Xu,et al.  Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model , 2016 .

[15]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Guorong Wang,et al.  Image Processing of Welding Seam Based on Single-stripe Laser Vision System , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[17]  De Xu,et al.  A Vision-Based Self-Tuning Fuzzy Controller for Fillet Weld Seam Tracking , 2011, IEEE/ASME Transactions on Mechatronics.

[18]  K. Masubuchi,et al.  Technologies and Practices of Underwater Welding , 1983 .