Seam tracking investigation via striped line laser sensor

Purpose This paper aims to propose a set of six-axis robot arm welding seam tracking experiment platform based on Halcon machine vision library to resolve the curve seam tracking issue. Design/methodology/approach Robot-based and image coordinate systems are converted based on the mathematical model of the three-dimensional measurement of structured light vision and conversion relations between robot-based and camera coordinate systems. An object tracking algorithm via weighted local cosine similarity is adopted to detect the seam feature points to prevent effectively the interference from arc and spatter. This algorithm models the target state variable and corresponding observation vector within the Bayes framework and finds the optimal region with highest similarity to the image-selected modules using cosine similarity. Findings The paper tests the approach and the experimental results show that using metal inert-gas (MIG) welding with maximum welding current of 200A can achieve real-time accurate curve seam tracking under strong arc light and splash. Minimal distance between laser stripe and welding molten pool can reach 15 mm, and sensor sampling frequency can reach 50 Hz. Originality/value Designing a set of six-axis robot arm welding seam tracking experiment platform with a system of structured light sensor based on Halcon machine vision library; and adding an object tracking algorithm to seam tracking system to detect image feature points. By this technology, this system can track the curve seam while welding.

[1]  Junzhou Huang,et al.  Robust tracking using local sparse appearance model and K-selection , 2011, CVPR 2011.

[2]  Deyong You,et al.  Kalman Filtering Compensated by Radial Basis Function Neural Network for Seam Tracking of Laser Welding , 2013, IEEE Transactions on Control Systems Technology.

[3]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[4]  D. Fritsch,et al.  Accuracy of videometry with CCD sensors , 1990 .

[5]  Ayoub Al-Hamadi,et al.  Multi hypotheses based object tracking in HCI environments , 2012, 2012 19th IEEE International Conference on Image Processing.

[6]  Cassidy R. Sugimoto,et al.  Topics in dynamic research communities: An exploratory study for the field of information retrieval , 2012, J. Informetrics.

[7]  Wiro J. Niessen,et al.  Particle Filtering for Multiple Object Tracking in Dynamic Fluorescence Microscopy Images: Application to Microtubule Growth Analysis , 2008, IEEE Transactions on Medical Imaging.

[8]  Vipin Kumar,et al.  Introduction to Data Mining , 2022, Data Mining and Machine Learning Applications.

[9]  Philip H. S. Torr,et al.  Struck: Structured output tracking with kernels , 2011, ICCV.

[10]  Tieniu Tan,et al.  A multi-object tracking system for surveillance video analysis , 2004, ICPR 2004.

[11]  Mamoru Kawahara,et al.  Tracking control system using image sensor for arc welding , 1983, Autom..

[12]  Huchuan Lu,et al.  Visual Tracking via Weighted Local Cosine Similarity , 2015, IEEE Transactions on Cybernetics.

[13]  K. Mehrotra,et al.  A jerk model for tracking highly maneuvering targets , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Hyungsuck Cho,et al.  A robust method for vision-based seam tracking in robotic arc welding , 1995, Proceedings of Tenth International Symposium on Intelligent Control.

[15]  Yanling Xu,et al.  Computer vision technology for seam tracking in robotic GTAW and GMAW , 2015 .

[16]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Xinhua Tang,et al.  A visual seam tracking system for robotic arc welding , 2008 .

[18]  Jeremy S. Smith,et al.  Weld bead placement system for multipass welding , 1996 .

[19]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..