Stereo vision based autonomous robot calibration

Robot calibration has been demonstrated to be a useful method to decrease the absolute positioning errors of a robot. Compared to the traditional calibration methods which require expensive external measurement devices, this paper proposes a stereo vision based self-calibration procedure which only needs a stereo camera mounted to a fixed location and a planar marker attached to the robot end-effector. The procedure consists of three consecutive steps: the automatic generation of target configurations and trajectories based on the nominal geometric models of the robot; a camera and obstacles, marker poses estimated by the two stage estimation algorithm; and the kinematic parameters identification based on a local product of exponential (local POE) formulized error model. The advantage of this self-calibration method is that the whole robot camera system can be calibrated without any manual intervention, which enables robot calibration to be completely online and suitable for the fast programming of the robot and computer vision combined work cell. A set of simulations and experiments on a UR5 robot demonstrate the convenience, efficiency and robustness of the proposed calibration procedure. A systematic stereo vision based robot calibration procedure is present.The proposed calibration process is automatic, friendly to use and inexpensive.Results demonstrate the efficiency and robustness of the calibration method.

[1]  Bahram Ravani,et al.  An overview of robot calibration , 1987, IEEE Journal on Robotics and Automation.

[2]  Michael Grethlein,et al.  Complete, minimal and model-continuous kinematic models for robot calibration , 1997 .

[3]  John M. Hollerbach,et al.  Autonomous calibration of single-loop closed kinematic chains formed by manipulators with passive endpoint constraints , 1991, IEEE Trans. Robotics Autom..

[4]  Philippe Martinet,et al.  Unifying Kinematic Modeling, Identification, and Control of a Gough–Stewart Parallel Robot Into a Vision-Based Framework , 2006, IEEE Transactions on Robotics.

[5]  William K. Veitschegger,et al.  Robot accuracy analysis based on kinematics , 1986, IEEE J. Robotics Autom..

[6]  Morris Driels,et al.  Full-pose calibration of a robot manipulator using a coordinate-measuring machine , 1993 .

[7]  Hanqi Zhuang,et al.  Simultaneous calibration of a robot and a hand-mounted camera , 1993, IEEE Trans. Robotics Autom..

[8]  G. Gatti,et al.  A practical approach to compensate for geometric errors in measuring arms: application to a six-degree-of-freedom kinematic structure , 2007 .

[9]  Hanqi Zhuang,et al.  Robot calibration by mobile camera systems , 1994, J. Field Robotics.

[10]  Wisama Khalil,et al.  Self calibration of Stewart-Gough parallel robots without extra sensors , 1999, IEEE Trans. Robotics Autom..

[11]  Hanqi Zhuang,et al.  Self-calibration of parallel mechanisms with a case study on Stewart platforms , 1997, IEEE Trans. Robotics Autom..

[12]  J. Denavit,et al.  A kinematic notation for lowerpair mechanism based on matrices , 1955 .

[13]  Guilin Yang,et al.  Kinematic calibration of modular reconfigurable robots using product-of-exponentials formula , 1997, J. Field Robotics.

[14]  Guilin Yang,et al.  Self-calibration of three-legged modular reconfigurable parallel robots based on leg-end distance errors , 2001, Robotica.

[15]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[16]  Philippe Martinet,et al.  Vision-based kinematic calibration of a H4 parallel mechanism , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  Markus Vincze,et al.  A Laser Tracking System to Measure Position and Orientation of Robot End Effectors Under Motion , 1994, Int. J. Robotics Res..

[18]  John M. Hollerbach,et al.  Autonomous Robot Calibration for Hand-Eye Coordination , 1991, Int. J. Robotics Res..

[19]  Hanqi Zhuang,et al.  Calibration of stewart platforms and other parallel manipulators by minimizing inverse kinematic residuals , 1998, J. Field Robotics.

[20]  Shuzi Yang,et al.  Kinematic-Parameter Identification for Serial-Robot Calibration Based on POE Formula , 2010, IEEE Transactions on Robotics.

[21]  Hanqi Zhuang,et al.  Autonomous robot calibration using vision technology , 2007 .

[22]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[23]  Hanqi Zhuang,et al.  A complete and parametrically continuous kinematic model for robot manipulators , 1992, IEEE Trans. Robotics Autom..

[24]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[25]  Jimmy A. Jørgensen,et al.  RobWork: A Flexible Toolbox for Robotics Research and Education , 2010, ISR/ROBOTIK.

[26]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[27]  Gregory D. Hager,et al.  Real-time vision-based robot localization , 1993, IEEE Trans. Robotics Autom..

[28]  Frank Chongwoo Park,et al.  Kinematic calibration using the product of exponentials formula , 1996, Robotica.

[29]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[30]  Arthur C. Sanderson,et al.  A prototype arm signature identification system , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[31]  Koichi Hashimoto,et al.  A review on vision-based control of robot manipulators , 2003, Adv. Robotics.

[32]  Guilin Yang,et al.  Local POE model for robot kinematic calibration , 2001 .

[33]  Tielin Shi,et al.  A kinematic calibration method based on the product of exponentials formula for serial robot using position measurements , 2015, Robotica.

[34]  John M. Hollerbach,et al.  The Calibration Index and Taxonomy for Robot Kinematic Calibration Methods , 1996, Int. J. Robotics Res..

[35]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[36]  Luo Fei,et al.  An Overview of Robot Calibration , 2004 .

[37]  Samad Hayati,et al.  Robot arm geometric link parameter estimation , 1983, The 22nd IEEE Conference on Decision and Control.

[38]  Ping Zhang,et al.  Online robot calibration based on vision measurement , 2013 .

[39]  Hanqi Zhuang,et al.  Calibration of stewart platforms and other parallel manipulators by minimizing inverse kinematic residuals , 1998 .