Automatic self-contained calibration of an industrial dual-arm robot with cameras using self-contact, planar constraints, and self-observation

We present a robot kinematic calibration method that combines complementary calibration approaches: self-contact, planar constraints, and self-observation. We analyze the estimation of the end effector parameters, joint offsets of the manipulators, calibration of the complete kinematic chain (DH parameters), and we compare our results with ground truth measurements provided by a laser tracker. Our main findings are: (1) When applying the complementary calibration approaches in isolation, the self-contact approach yields the best and most stable results. (2) All combinations of more than one approach were always superior to using any single approach in terms of calibration errors as well as the observability of the estimated parameters. Combining more approaches delivers robot parameters that better generalize to the parts of workspace not used for the calibration. (3) Sequential calibration, i.e.\ calibrating cameras first and then robot kinematics, is more effective than simultaneous calibration of all parameters. In real experiments, we employ two industrial manipulators mounted on a common base. The manipulators are equipped with force/torque sensors at their wrists, with two cameras attached to the robot base, and with special end effectors with fiducial markers. We collect a new comprehensive dataset for robot kinematic calibration and make it publicly available. The dataset and its analysis provide quantitative and qualitative insights that go beyond the specific manipulators used in this work and are applicable to self-contained robot kinematic calibration in general.

[1]  Matej Hoffmann,et al.  Robot Self-Calibration Using Multiple Kinematic Chains—A Simulation Study on the iCub Humanoid Robot , 2018, IEEE Robotics and Automation Letters.

[2]  Hee-Jun Kang,et al.  Selecting Optimal Measurement Poses for Kinematic Calibration of Industrial Robots , 2014 .

[3]  In-Chul Ha Kinematic parameter calibration method for industrial robot manipulator using the relative position , 2008 .

[4]  Alessandro Roncone,et al.  Automatic kinematic chain calibration using artificial skin: Self-touch in the iCub humanoid robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Jwu-Sheng Hu,et al.  Kinematic calibration of manipulator using single laser pointer , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Jian Zhou,et al.  A New Full Pose Measurement Method for Robot Calibration , 2013, Sensors.

[7]  Alexandr Klimchik,et al.  Combination of geometric and parametric approaches for kinematic identification of an industrial robot , 2021, Robotics Comput. Integr. Manuf..

[8]  Gordon Cheng,et al.  Adaptive Robot Body Learning and Estimation Through Predictive Coding , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  P. Alam ‘S’ , 2021, Composites Engineering: An A–Z Guide.

[10]  Bojan Jerbić,et al.  Calibration of an Industrial Robot Using a Stereo Vision System , 2014 .

[11]  John M. Hollerbach,et al.  Self-calibration of single-loop, closed kinematic chains formed by dual or redundant manipulators , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[12]  Siddhartha S. Srinivasa,et al.  The manifold particle filter for state estimation on high-dimensional implicit manifolds , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  John M. Hollerbach,et al.  Kinematic calibration using a plane constraint , 1997, Proceedings of International Conference on Robotics and Automation.

[14]  David Daney,et al.  Choosing Measurement Poses for Robot Calibration with the Local Convergence Method and Tabu Search , 2005, Int. J. Robotics Res..

[15]  Ilian A. Bonev,et al.  Non-kinematic calibration of a six-axis serial robot using planar constraints , 2015 .

[16]  Francesco Nori,et al.  Self-calibration of joint offsets for humanoid robots using accelerometer measurements , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[17]  Jakub Rozlivek,et al.  Multisensorial robot calibration framework and toolbox , 2021, 2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids).

[18]  Chia-Hsiang Menq,et al.  Experimental study of observability of parameter errors in robot calibration , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[19]  Ravinder Dahiya,et al.  Flexible Electronic Skin: From Humanoids to Humans , 2019, Proc. IEEE.

[20]  Dahu Zhu,et al.  Calibration and accuracy analysis of robotic belt grinding system using the ruby probe and criteria sphere , 2018, Robotics and Computer-Integrated Manufacturing.

[21]  Gordon Cheng,et al.  Humanoid Multimodal Tactile-Sensing Modules , 2011, IEEE Transactions on Robotics.

[22]  Jian S. Dai,et al.  Analysis of unified error model and simulated parameters calibration for robotic machining based on Lie theory , 2020, Robotics Comput. Integr. Manuf..

[23]  Evgeni Magid,et al.  Humanoid robot kinematic calibration using industrial manipulator , 2017, 2017 International Conference on Mechanical, System and Control Engineering (ICMSC).

[24]  Hanqi Zhuang,et al.  Robot calibration with planar constraints , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[25]  Morris Driels,et al.  Significance of observation strategy on the design of robot calibration experiments , 1990, J. Field Robotics.

[26]  Jun Wang,et al.  A point and distance constraint based 6R robot calibration method through machine vision , 2020, Robotics Comput. Integr. Manuf..

[27]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[28]  Wisama Khalil,et al.  Model Identification , 2019, Springer Handbook of Robotics, 2nd Ed..

[29]  Ilian A. Bonev,et al.  Kinematic calibration of a six-axis serial robot using distance and sphere constraints , 2015 .

[30]  P. Alam ‘K’ , 2021, Composites Engineering.

[31]  Gebräuchliche Fertigarzneimittel,et al.  V , 1893, Therapielexikon Neurologie.

[32]  John M. Hollerbach,et al.  The noise amplification index for optimal pose selection in robot calibration , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[33]  Berthold Bäuml,et al.  Rapid calibration of a multi-sensorial humanoid’s upper body: An automatic and self-contained approach , 2015, Int. J. Robotics Res..

[34]  Chiara Bartolozzi,et al.  Robots with a sense of touch. , 2016, Nature materials.

[35]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[36]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  José Mauricio S. T. Motta,et al.  Theoretical and practical aspects of robot calibration with experimental verification , 2011 .

[38]  John M. Hollerbach,et al.  Autonomous calibration of single-loop closed kinematic chains formed by manipulators with passive endpoint constraints , 1991, IEEE Trans. Robotics Autom..

[39]  Ilian A. Bonev,et al.  Absolute calibration of an ABB IRB 1600 robot using a laser tracker , 2013 .

[40]  Jonathan Kelly,et al.  Self-Calibration of Mobile Manipulator Kinematic and Sensor Extrinsic Parameters Through Contact-Based Interaction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Wyatt S. Newman,et al.  Calibration of a Motoman P8 robot based on laser tracking , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[42]  Manuel Lopes,et al.  Body schema acquisition through active learning , 2010, 2010 IEEE International Conference on Robotics and Automation.

[43]  Alexandre Bernardino,et al.  Online Body Schema Adaptation Based on Internal Mental Simulation and Multisensory Feedback , 2016, Front. Robot. AI.

[44]  Kevin Nickels,et al.  Hand-Eye Calibration of Robonaut , 2004 .

[45]  Zhijiang Du,et al.  A universal index and an improved PSO algorithm for optimal pose selection in kinematic calibration of a novel surgical robot , 2018 .

[46]  Yu Sun,et al.  Observability index selection for robot calibration , 2008, 2008 IEEE International Conference on Robotics and Automation.

[47]  Vincent Hayward,et al.  Calibration of a parallel robot using multiple kinematic closed loops , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[48]  Xiaoqi Tang,et al.  A new calibration method for joint-dependent geometric errors of industrial robot based on multiple identification spaces , 2021, Robotics Comput. Integr. Manuf..

[49]  Gordon Cheng,et al.  Open-loop self-calibration of articulated robots with artificial skins , 2012, 2012 IEEE International Conference on Robotics and Automation.

[50]  Michael Valášek,et al.  Experiments with redundant parallel calibration and measuring machine RedCaM , 2007 .

[51]  Lai Zou,et al.  A novel kinematic parameters calibration method for industrial robot based on Levenberg-Marquardt and Differential Evolution hybrid algorithm , 2021, Robotics Comput. Integr. Manuf..

[52]  Alexandre Bernardino,et al.  Incremental adaptation of a robot body schema based on touch events , 2018, 2018 Joint IEEE 8th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[53]  John M. Hollerbach,et al.  The Calibration Index and Taxonomy for Robot Kinematic Calibration Methods , 1996, Int. J. Robotics Res..

[54]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[55]  Helge J. Ritter,et al.  Towards body schema learning using training data acquired by continuous self-touch , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[56]  Kui Sun,et al.  Optimal measurement configurations for kinematic calibration of six-DOF serial robot , 2011 .

[57]  Aude Billard,et al.  Online Learning of the Body Schema , 2008, Int. J. Humanoid Robotics.

[58]  Alessandro Roncone,et al.  3D stereo estimation and fully automated learning of eye-hand coordination in humanoid robots , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.