On the calibration of active binocular and RGBD vision systems for dual-arm robots

This paper describes a camera and hand-eye calibration methodology for integrating an active binocular robot head within a dual-arm robot. For this purpose, we derive the forward kinematic model of our active robot head and describe our methodology for calibrating and integrating our robot head. This rigid calibration provides a closed-form hand-to-eye solution. We then present an approach for updating dynamically camera external parameters for optimal 3D reconstruction that are the foundation for robotic tasks such as grasping and manipulating rigid and deformable objects. We show from experimental results that our robot head achieves an overall sub millimetre accuracy of less than 0.3 millimetres while recovering the 3D structure of a scene. In addition, we report a comparative study between current RGBD cameras and our active stereo head within two dual-arm robotic testbeds that demonstrates the accuracy and portability of our proposed methodology.

[1]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[2]  Hans-Joachim Wünsche,et al.  Continuous extrinsic online calibration for stereo cameras , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[3]  Gerardo Aragon-Camarasa,et al.  A Portable Active Binocular Robot Vision Architecture for Scene Exploration , 2016, TAROS.

[4]  Francesc Moreno-Noguer,et al.  Very Fast Solution to the PnP Problem with Algebraic Outlier Rejection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Branko Karan.  Calibration of Kinect-type RGB-D sensors for robotic applications , 2015 .

[6]  J. Paul Siebert,et al.  Parallel Stereo Vision Algorithm , 2012, MARC@RWTH.

[7]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[8]  Christian Hoffmann,et al.  Continuous Stereo Self-Calibration by Camera Parameter Tracking , 2009, IEEE Transactions on Image Processing.

[9]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Simon Rogers,et al.  A Precise Method for Cloth Configuration Parsing Applied to Single-Arm Flattening , 2016 .

[11]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[12]  Livio Pinto,et al.  Calibration of Kinect for Xbox One and Comparison between the Two Generations of Microsoft Sensors , 2015, Sensors.

[13]  Avinash C. Kak,et al.  A New Approach for Active Stereo Camera Calibration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Li Sun,et al.  Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Joachim Denzler,et al.  Intrinsic and extrinsic active self-calibration of multi-camera systems , 2013, Machine Vision and Applications.

[16]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[17]  Brett Browning,et al.  Online continuous stereo extrinsic parameter estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  J. Paul Siebert,et al.  Recognising the clothing categories from free-configuration using Gaussian-Process-based interactive perception , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Nicola J. Ferrier,et al.  Robust active stereo calibration , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[20]  David W. Murray,et al.  On the kinematics of robot heads , 1997, IEEE Trans. Robotics Autom..

[21]  Radu Horaud,et al.  Real-time visuomotor update of an active binocular head , 2012, Autonomous Robots.