A Flexible Grasping Policy Based on Simple Robot-Camera Calibration and Pose Repeatability of Arm

Manipulation has been a rising focus of robotics research, from industrial automation to personal service robots. Most existing control method are based on accurate kinematic modelling of robot manipulators and robot calibration that needs trained personnel, laboratory environment and data collection is time-consuming. However, robots, especially service robots, similar to other mechanical devices can be affected by slight changes or drifts caused by wear of parts, dimensional drifts, and tolerances, and all of them need a new calibration. Most methods lack robustness due to these slight changes. In this work, for mobile robots, we propose a convenient robot-camera calibration approach and a flexible control approach based on simple robot sensor calibration and pose repeatability of arm. In prototype grasping experiments on the robot Kejia, the approach is validated to be effective and robust, achieving a high success rate of grasping, and using the same control policy, we achieve 1st place in Manipulation and Object Recognition of RoboCup@Home League 2016, here Manipulation and Object Recognition is a sub challenge of Home League.

[1]  Mili Shah,et al.  An overview of robot-sensor calibration methods for evaluation of perception systems , 2012, PerMIS.

[2]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[3]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[4]  R. Halír Numerically Stable Direct Least Squares Fitting of Ellipses , 1998 .

[5]  Bahram Ravani,et al.  An overview of robot calibration , 1987, IEEE Journal on Robotics and Automation.

[6]  Dirk Bartz,et al.  Alternative online extrinsic calibration techniques for minimally invasive surgery , 2008, VRST '08.

[7]  Terry M. Peters,et al.  An augmented reality platform for planning of minimally invasive cardiac surgeries , 2012, Medical Imaging.

[8]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[9]  Arturo de la Escalera,et al.  Automatic Chessboard Detection for Intrinsic and Extrinsic Camera Parameter Calibration , 2010, Sensors.

[10]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Didier Stricker,et al.  Comparison of Kinect V1 and V2 Depth Images in Terms of Accuracy and Precision , 2016, ACCV Workshops.

[12]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[16]  Zhanyi Hu,et al.  A vision-based fully-automatic calibration method for hand-eye serial robot , 2015, Ind. Robot.

[17]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[18]  Michal Havlena,et al.  A branch-and-bound algorithm for globally optimal hand-eye calibration , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Sergey Levine,et al.  Learning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection , 2016, ISER.