Automatic calibration of a robot manipulator and multi 3D camera system

With 3D sensing becoming cheaper, environment-aware and visually-guided robot arms capable of safely working in collaboration with humans will become common. However, a reliable calibration is needed, both for camera internal calibration, as well as Eye-to-Hand calibration, to make sure the whole system functions correctly. We present a framework, using a novel combination of well proven methods, allowing a quick automatic calibration for the integration of systems consisting of the robot and a varying number of 3D cameras by using a standard checkerboard calibration grid. Our approach allows a quick camera-to-robot recalibration after any changes to the setup, for example when cameras or robot have been repositioned. Modular design of the system ensures flexibility regarding a number of sensors used as well as different hardware choices. The framework has been proven to work by practical experiments to analyze the quality of the calibration versus the number of positions of the checkerboard used for each of the calibration procedures.

[1]  P. Payeur,et al.  Calibration of a network of Kinect sensors for robotic inspection over a large workspace , 2013, 2013 IEEE Workshop on Robot Vision (WORV).

[2]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[3]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[4]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hanqi Zhuang,et al.  Simultaneous calibration of a robot and a hand-mounted camera , 1993, IEEE Trans. Robotics Autom..

[7]  B. Siciliano,et al.  Eye-in-Hand/Eye-to-Hand Multi-Camera Visual Servoing , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[8]  Ferdinand Fuhrmann,et al.  EVALUATION OF THE SPATIAL RESOLUTION ACCURACY OF THE FACE TRACKING SYSTEM FOR KINECT FOR WINDOWS V 1 AND V 2 , 2014 .

[9]  Mikko Sallinen,et al.  Flexible hand-eye calibration for multi-camera systems , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[10]  Oussama Khatib,et al.  A depth space approach to human-robot collision avoidance , 2012, 2012 IEEE International Conference on Robotics and Automation.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Andrea Fossati,et al.  Consumer Depth Cameras for Computer Vision , 2013, Advances in Computer Vision and Pattern Recognition.

[13]  Reinhard Koch,et al.  Calibration of a Multi-camera Rig from Non-overlapping Views , 2007, DAGM-Symposium.

[14]  Cliff Fitzgerald,et al.  Developing baxter , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[15]  Songde Ma,et al.  Hand-Eye Calibration , 2014, Computer Vision, A Reference Guide.

[16]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[18]  Roland Siegwart,et al.  Kinect v2 for mobile robot navigation: Evaluation and modeling , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[19]  Miti Ruchanurucks,et al.  Kinect-based obstacle detection for manipulator , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[20]  ZhangZhengyou.  A Flexible New Technique for Camera Calibration , 2000 .

[21]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[22]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[23]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[24]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..