Correspondence Matching and Time Delay Estimation for Hand-Eye Calibration

For visually aided industrial robots, the transformation between the mounted visual information system and the end-effector must be calibrated prior to the practical use. However, during the data acquisition stage, measurement uncertainties will lead to inevitable mismatched data. This article proposes a novel correspondence matching method for the hand-eye calibration system of the type <inline-formula> <tex-math notation="LaTeX">$\boldsymbol {AX} = \boldsymbol {XB}$ </tex-math></inline-formula>. The correspondence matching refers to the problem of finding out the well-matched <inline-formula> <tex-math notation="LaTeX">$\boldsymbol {A}$ </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">$\boldsymbol {B}$ </tex-math></inline-formula> and the relative time delay between them, from a series of measurements. A neat Lie algebra formulation has been obtained to cast the original problem into a high-dimensional point-cloud registration problem. This solution allows for the simultaneous solution of the hand-eye calibration, correspondence matching, and time-delay estimation as well as the uncertainty description of the obtained results. Synthetic simulations verify the correctness of the proposed method. Experimental studies have also confirmed its practical feasibility on an automatic welding platform.

[1]  Gregory S. Chirikjian,et al.  New probabilistic approaches to the AX = XB hand-eye calibration without correspondence , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[3]  Yuxiang Sun,et al.  Hand-Eye Calibration: 4-D Procrustes Analysis Approach , 2020, IEEE Transactions on Instrumentation and Measurement.

[4]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[5]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Zijian Zhao,et al.  Simultaneous robot-world and hand-eye calibration by the alternative linear programming , 2019, Pattern Recognit. Lett..

[7]  Imad M. Jaimoukha,et al.  A Semidefinite Relaxation-Based Algorithm for Robust Attitude Estimation , 2012, IEEE Transactions on Signal Processing.

[8]  Quang-Cuong Pham,et al.  On the covariance of X in AX = XB , 2018, IEEE Trans. Robotics.

[9]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[10]  Farhad Aghili,et al.  A Prediction and Motion-Planning Scheme for Visually Guided Robotic Capturing of Free-Floating Tumbling Objects With Uncertain Dynamics , 2012, IEEE Transactions on Robotics.

[11]  Jin Wu,et al.  Optimal Continuous Unit Quaternions from Rotation Matrices , 2019, Journal of Guidance, Control, and Dynamics.

[12]  Rui Li,et al.  Fast Symbolic 3-D Registration Solution , 2018, IEEE Transactions on Automation Science and Engineering.

[13]  Kenichi Kanatani,et al.  Calibration of Ultrawide Fisheye Lens Cameras by Eigenvalue Minimization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Michal Havlena,et al.  Globally Optimal Hand-Eye Calibration Using Branch-and-Bound , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Qiang Huang,et al.  An Integrated Two-Pose Calibration Method for Estimating Head-Eye Parameters of a Robotic Bionic Eye , 2020, IEEE Transactions on Instrumentation and Measurement.

[16]  Marc Levoy,et al.  Fitting smooth surfaces to dense polygon meshes , 1996, SIGGRAPH.

[17]  Adrian Burlacu,et al.  Orthogonal dual tensor method for solving the AX = XB sensor calibration problem , 2016 .

[18]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[19]  Frank Chongwoo Park,et al.  Robot sensor calibration: solving AX=XB on the Euclidean group , 1994, IEEE Trans. Robotics Autom..

[20]  Hassen Fourati,et al.  Generalized Linear Quaternion Complementary Filter for Attitude Estimation From Multisensor Observations: An Optimization Approach , 2019, IEEE Transactions on Automation Science and Engineering.

[21]  Hannes Sommer,et al.  Evaluation of Combined Time-Offset Estimation and Hand-Eye Calibration on Robotic Datasets , 2017, FSR.

[22]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[23]  Gaurav S. Sukhatme,et al.  Determining the Time Delay Between Inertial and Visual Sensor Measurements , 2014, IEEE Transactions on Robotics.

[24]  Frank Chongwoo Park,et al.  A Stochastic Global Optimization Algorithm for the Two-Frame Sensor Calibration Problem , 2016, IEEE Transactions on Industrial Electronics.

[25]  Jiaolong Yang,et al.  Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[27]  Hannes Sommer,et al.  Continuous-Time Estimation of Attitude Using B-Splines on Lie Groups , 2016 .

[28]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.