Stereo vision for path correction in off-line programmed robot welding

The paper describes a versatile machine vision system for correcting off-line programmed nominal robot trajectories for advanced welding. Weld trajectory corrections are needed due to slight variations in weld joints. Such variations occur naturally because of varying tolerances in parts and to heat induced deformations during earlier weld sequences. The developed system uses one camera and a weld tool mounted on the robot hand. As a first step, the whole system, including the camera, is calibrated. Then the system takes images of the weld joint from different positions and orientations, and determines the weld joint geometry in 3D using a stereo vision algorithm and a novel camera model. The weld trajectory is then updated in the robot control system, and weld operation is performed. These steps are repeated for all weld sequences of the work piece. The strategy has successfully been demonstrated for a standard industrial welding robot and a standard Fire Wire CMOS camera. The maximum deviation of the trajectory found by the system compared to a reference (coordinate measuring machine) is 0.7 mm and the mean deviation is 0.23 mm. Thus, the system shows high potential for industrial implementation.

[1]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Ronald G.K.M. Aarts,et al.  Integrated sensors for robotic laser welding , 2005 .

[5]  Janne Heikkilä,et al.  Geometric Camera Calibration Using Circular Control Points , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Roger Y. Tsai,et al.  Real time versatile robotics hand/eye calibration using 3D machine vision , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[7]  Bengt Lennartson,et al.  Camera Modelling and Calibration - with Applications , 2008 .

[8]  Shan-Ben Chen,et al.  Acquisition of Weld Seam Dimensional Position Information for Arc Welding Robot Based on Vision Computing , 2005, J. Intell. Robotic Syst..

[9]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Per Nylén,et al.  Three Dimensional Simulation of Robot path, Heat Trnasfer and Residual stresses of a welded Part with Complex Geometry , 2002 .

[12]  Lindsay Kleeman,et al.  Visual Perception and Robotic Manipulation - 3D Object Recognition, Tracking and Hand-Eye Coordination , 2006, Springer Tracts in Advanced Robotics.

[13]  Xinhua Tang,et al.  A visual seam tracking system for robotic arc welding , 2008 .

[14]  Rolf Bernhardt,et al.  Robot Calibration , 1993 .

[15]  Sudeep Sarkar,et al.  Comparison of Edge Detectors: A Methodology and Initial Study , 1998, Comput. Vis. Image Underst..

[16]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Fredrik Sikström,et al.  Tools for Simulation Based Fixture Design to Reduce Deformation in Advanced Fusion Welding , 2008, ICIRA.

[18]  Geoffrey Taylor,et al.  Visual Perception and Robotic Manipulation: 3D Object Recognition, Tracking and Hand-Eye Coordination (Springer Tracts in Advanced Robotics) , 2006 .