Automatic Calibration of Hand–Eye–Workspace and Camera Using Hand-Mounted Line Laser

This paper develops a novel calibration method for simultaneously calibrating the intrinsic parameters of a camera and the hand-eye-workspace relationships of an eye-to-hand system using a line laser module. Errors in the parameters of a hand-eye coordination system lead to errors in the position targeting in the control of robots. To solve these problems, the proposed method utilizes a line laser module that is mounted on the hand to project laser beams onto the working plane. As well as calibrating the system parameters, the proposed method is effective when the eye cannot see the hand and eliminates the need for a precise calibration pattern or object. The collected laser stripes in the images must satisfy nonlinear constraints at each hand pose. A closed-form solution is derived by decoupling nonlinear relationships based on the homogeneous transform and parallel plane/line constraints. A nonlinear optimization, which considers all parameters simultaneously without error propagation problem, is to refine the closed-form solution. This two-stage process can be executed automatically without manual intervention. The computer simulation and experiment verify the effectiveness of the proposed method and reveal that using a line laser is more accurate than using a single-point laser.

[1]  In-Won Park,et al.  Laser-Based Kinematic Calibration of Robot Manipulator Using Differential Kinematics , 2012, IEEE/ASME Transactions on Mechatronics.

[2]  T. Echigo A camera calibration technique using sets of parallel lines , 1989, International Workshop on Industrial Applications of Machine Intelligence and Vision,.

[3]  Hanqi Zhuang,et al.  Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation equations of the form AX=YB , 1994, IEEE Trans. Robotics Autom..

[4]  Éric Marchand,et al.  Eye-in-hand/eye-to-hand cooperation for visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[7]  Ching-Cheng Wang,et al.  Extrinsic calibration of a vision sensor mounted on a robot , 1992, IEEE Trans. Robotics Autom..

[8]  Defeng Wu,et al.  Simultaneous robot-world and hand-eye calibration using dual-quaternions and Kronecker product , 2010 .

[9]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[10]  Cezary Zielinski,et al.  Structures of visual servos , 2010, Robotics Auton. Syst..

[11]  Arnoud Visser,et al.  A low-cost pose-measuring system for robot calibration , 1995, Robotics Auton. Syst..

[12]  Reg G. Willson Modeling and calibration of automated zoom lenses , 1994, Other Conferences.

[13]  Songde Ma,et al.  A self-calibration technique for active vision systems , 1996, IEEE Trans. Robotics Autom..

[14]  Gerd Hirzinger,et al.  Active self-calibration of robotic eyes and hand-eye relationships with model identification , 1998, IEEE Trans. Robotics Autom..

[15]  Jwu-Sheng Hu,et al.  Calibration of an eye-to-hand system using a laser pointer on hand and planar constraints , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Jwu-Sheng Hu,et al.  Eye-hand-workspace calibration using laser pointer projection on plane surface , 2012, Ind. Robot.

[17]  K. Ohnishi,et al.  Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing , 2004, IEEE/ASME Transactions on Mechatronics.

[18]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[21]  Juan Lu,et al.  A self-calibration approach to hand-eye relation using a single point , 2008, 2008 International Conference on Information and Automation.

[22]  Jwu-Sheng Hu,et al.  A robotic ball catcher with embedded visual servo processor , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[24]  Gerald Sommer,et al.  Automatic high-precision self-calibration of camera-robot systems , 2009, 2009 IEEE International Conference on Robotics and Automation.

[25]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[26]  Gerd Hirzinger,et al.  More accurate camera and hand-eye calibrations with unknown grid pattern dimensions , 2008, 2008 IEEE International Conference on Robotics and Automation.

[27]  Radu Horaud,et al.  Robot Hand-Eye Calibration Using Structure-from-Motion , 2001, Int. J. Robotics Res..

[28]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Sun Lei,et al.  Geometry-based robot calibration method , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[30]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[31]  Anders Heyden,et al.  Self-calibration from image derivatives for active vision systems , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..