Precise pose and assembly detection of generic tubular joints based on partial scan data

Intelligent and accurate determination of the position and orientation, or pose, of a workpiece which is manually placed is essential for automating fabrication tasks such as welding. In this paper, a novel algorithm based on minimizing the area of a boundary enclosing partial scan data points is proposed for detecting both the pose and assembly of tubular joints with the aid of reference ideal models. The proposed algorithm can also be applied to tubular joints with non-cylindrical cross sections. The fit-up information obtained can be used to determine whether realignment is required or combined with the pose information to re-plan paths for subsequent tasks. The focus of existing state-of-the-art is on objects with features, and the localization of featureless objects such as generic tubular joints using partial and sparse scan data remains a challenge. The proposed algorithm is applied to an actual robotic welding system to locate a tubular workpiece. Experiment results using the scan data as ground truth show that root mean square error is less than 1% of the pipe diameters, considering both brace and chord components with diameters greater than 200 mm.

[1]  Kenji Shimada,et al.  Automated workpiece localization for robotic welding , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[2]  H. Ding,et al.  A Distance Function Based Approach for Localization and Profile Error Evaluation of Complex Surface , 2004 .

[3]  Yanbiao Zou,et al.  Research on a real-time pose estimation method for a seam tracking system , 2020 .

[4]  Gim Song Soh,et al.  Seam tracking of large pipe structures for an agile robotic welding system mounted on scaffold structures , 2018 .

[5]  Hans Martin Kjer,et al.  Evaluation of surface registration algorithms for PET motion correction , 2010 .

[6]  Heng Yang,et al.  TEASER: Fast and Certifiable Point Cloud Registration , 2021, IEEE Transactions on Robotics.

[7]  Howie Choset,et al.  One Framework to Register Them All: PointNet Encoding for Point Cloud Alignment , 2019, ArXiv.

[8]  Manuel Ferre,et al.  Object Detection and 6D Pose Estimation for Precise Robotic Manipulation in Unstructured Environments , 2017, ICINCO.

[9]  Shan-Ben Chen,et al.  The autonomous detection and guiding of start welding position for arc welding robot , 2010, Ind. Robot.

[10]  Douglas R. Fussner,et al.  Design of Input Coupled Split Power Transmissions, Arrangements, and Their Characteristics , 2004 .

[11]  Yi Sun,et al.  Scale invariant point feature (SIPF) for 3D point clouds and 3D multi-scale object detection , 2017, Neural Computing and Applications.

[12]  Zhenyuan Jia,et al.  A unified localization approach for machining allowance optimization of complex curved surfaces , 2009 .

[13]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[14]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Abdullah Al Mamun,et al.  Precise Detection of Pose and Assembly Error Based on Partial Scan Data for Fabrication of Tubular Joints , 2018, 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM).

[16]  Jae-Bok Song,et al.  Precision robotic deburring based on force control for arbitrarily shaped workpiece using CAD model matching , 2013 .

[17]  Jiaolong Yang,et al.  Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yasuhiro Aoki,et al.  PointNetLK: Robust & Efficient Point Cloud Registration Using PointNet , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Chee-Meng Chew,et al.  Object detection and motion planning for automated welding of tubular joints , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Zhiguo Cao,et al.  A fast and robust local descriptor for 3D point cloud registration , 2016, Inf. Sci..

[21]  Yue Wang,et al.  Deep Closest Point: Learning Representations for Point Cloud Registration , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[22]  Amir Rabani,et al.  An advanced method for matching partial 3D point clouds to free-form CAD models for in-situ inspection and repair , 2019, Optical Metrology.

[23]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..