A flexible method combining camera calibration and hand-eye calibration

We consider the conventional techniques of vision robot system calibration where camera parameters and robot hand–eye parameters are computed separately, i.e., first performing camera calibration and then carrying out hand–eye calibration based on the calibrated parameters of cameras. In this paper we propose a joint algorithm that combines the camera calibration and the hand–eye calibration together. The proposed algorithm gives the solutions of the cameras' parameters and the hand–eye parameters simultaneously by using nonlinear optimization. Both simulations and real experiments show the superiority of our algorithm. We also apply our algorithm in the real application of the robot-assisted surgical system, and very good results have been obtained.

[1]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[4]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[5]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[6]  Zijian Zhao,et al.  Hand-eye calibration using convex optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Lihi Zelnik-Manor,et al.  Multiview Constraints on Homographies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[9]  Wang Zeng-fu.  Stereo Camera Calibration Based on Rectification Error , 2012 .

[10]  Hanqi Zhuang,et al.  Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation equations of the form AX=YB , 1994, IEEE Trans. Robotics Autom..

[11]  Songde Ma,et al.  A complete two-plane camera calibration method and experimental comparisons , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[13]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Fumiaki Tomita,et al.  Plane-based calibration algorithm for multi-camera systems via factorization of homography matrices , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[16]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[17]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[18]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[19]  Richard I. Hartley,et al.  An algorithm for self calibration from several views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Anders Heyden,et al.  Simplified intrinsic camera calibration and hand-eye calibration for robot vision , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[21]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[22]  Radu Horaud,et al.  On-line hand-eye calibration , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[23]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Zhanyi Hu,et al.  Camera calibration with moving one-dimensional objects , 2005, Pattern Recognit..

[25]  Yiu Cheung Shiu,et al.  A noise-tolerant algorithm for robotic hand-eye calibration with or without sensor orientation measurement , 1993, IEEE Trans. Syst. Man Cybern..

[26]  Sundaram Ganapathy,et al.  Decomposition of transformation matrices for robot vision , 1984, Pattern Recognit. Lett..

[27]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[28]  Peter F. Sturm,et al.  Algorithms for plane-based pose estimation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[29]  H.H. Chen,et al.  A screw motion approach to uniqueness analysis of head-eye geometry , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Yuncai Liu,et al.  Hand-Eye Calibration Based on Screw Motions , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[32]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[33]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).