A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor

With the rapid development of computer vision and industrial technology, the requirements of the intelligent welding robots are increasing in the real industrial production. The traditional teaching-playback mode and the off-line programming mode cannot meet the automation demand and self-adaptive ability of welding robots. In order to improve the efficiency of welding robots, this paper proposes a novel 3-D path extraction method of weld seams based on a stereo-structured light sensor. Faced with the low efficiency of the line-structured light and the poor robustness of passive vision, the seam extraction based on a point cloud processing algorithm is proposed which could well adapt to the weld seams with different types and different groove sizes. Meanwhile, the position information and pose information of weld seam are established to serve 3-D path teaching of a welding robot. The experimental results show that the maximum path extraction error of V-type butt joint is less than 0.7 mm. The proposed scheme could well serve for the 3-D path teaching task before welding.

[1]  Drago Bračun,et al.  Stereo vision based measuring system for online welding path inspection , 2015 .

[2]  Hongzhi Cui,et al.  Influence of ultrasonic vibration on the plasticity of metals during compression process , 2018 .

[3]  Min Tan,et al.  Automatic recognition system of welding seam type based on SVM method , 2017, The International Journal of Advanced Manufacturing Technology.

[4]  Diego González-Aguilera,et al.  Feasibility Study of a Structured Light System Applied to Welding Inspection Based on Articulated Coordinate Measure Machine Data , 2017, IEEE Sensors Journal.

[5]  Yanling Xu,et al.  Real-time seam tracking control technology during welding robot GTAW process based on passive vision sensor , 2012 .

[6]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[7]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[8]  De Xu,et al.  Measurement and Defect Detection of the Weld Bead Based on Online Vision Inspection , 2010, IEEE Transactions on Instrumentation and Measurement.

[9]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Zhen Ye,et al.  Welding seam tracking in robotic gas metal arc welding , 2017 .

[11]  De Xu,et al.  A Vision-Based Self-Tuning Fuzzy Controller for Fillet Weld Seam Tracking , 2011, IEEE/ASME Transactions on Mechatronics.

[12]  Deyong You,et al.  Seam Tracking Monitoring Based on Adaptive Kalman Filter Embedded Elman Neural Network During High-Power Fiber Laser Welding , 2012, IEEE Transactions on Industrial Electronics.

[13]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[14]  Gu Fang,et al.  Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding , 2013 .

[15]  Cláudio T. Silva,et al.  Robust Smooth Feature Extraction from Point Clouds , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[16]  Lei Wu,et al.  Wind speed forecasting based on the hybrid ensemble empirical mode decomposition and GA-BP neural network method , 2016 .

[17]  Jiayou Wang,et al.  An infrared visual sensing detection approach for swing arc narrow gap weld deviation , 2017 .

[18]  Gu Fang,et al.  Human Machine Interface in Weld Seam Detection Using an RGB-D Camera , 2014 .

[19]  I. C. Ume,et al.  Measuring on-line and off-line noncontact ultrasound time of flight weld penetration depth , 2007 .

[20]  Yanling Xu,et al.  Automated control of welding penetration based on audio sensing technology , 2017 .

[21]  Sadek C. A. Alfaro,et al.  Exploring Infrared Sensoring for Real Time Welding Defects Monitoring in GTAW , 2010, Sensors.

[22]  Li Jing,et al.  A new teaching system for arc welding robots with auxiliary path point generation module , 2016, 2016 35th Chinese Control Conference (CCC).

[23]  Song Zhang,et al.  Toward superfast three-dimensional optical metrology with digital micromirror device platforms , 2014 .

[24]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[25]  David T. Branson,et al.  Flexible robot sealant dispensing cell using RGB-D sensor and off-line programming , 2017 .

[26]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Yifan Zhao,et al.  A Passive Imaging System for Geometry Measurement for the Plasma Arc Welding Process , 2017, IEEE Transactions on Industrial Electronics.

[28]  Tao Lin,et al.  Arc welding robot system with seam tracking and weld pool control based on passive vision , 2008 .

[29]  Deyong You,et al.  Kalman Filtering Compensated by Radial Basis Function Neural Network for Seam Tracking of Laser Welding , 2013, IEEE Transactions on Control Systems Technology.

[30]  YuMing Zhang,et al.  Iterative Local ANFIS-Based Human Welder Intelligence Modeling and Control in Pipe GTAW Process: A Data-Driven Approach , 2015, IEEE/ASME Transactions on Mechatronics.

[31]  Ws Yoo,et al.  Determination of 3-D weld seams in ship blocks using a laser vision sensor and a neural network , 2003 .

[32]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[33]  Chee-Meng Chew,et al.  Object detection and motion planning for automated welding of tubular joints , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  YuMing Zhang,et al.  A tutorial on learning human welder's behavior: Sensing, modeling, and control , 2014 .

[35]  Lin Tao,et al.  Inspection of weld shape based on the shape from shading , 2006 .

[36]  Jing Xu,et al.  High-accuracy, high-speed 3D structured light imaging techniques and potential applications to intelligent robotics , 2017, International Journal of Intelligent Robotics and Applications.