Pose Determination of a Robot Manipulator Based on Monocular Vision

This paper presents an approach to determine the pose of a robot manipulator by using a single fixed camera. Conventionally, the pose determination is usually achieved by using the encoders to sense the joint angles, and then the pose of the end effector is obtained by using the direct kinematics of the manipulator. However, when the encoders or the manipulators are malfunctioning, the pose may not be accurately determined. This paper presents an approach based on machine vision, where a single camera is fixed away from the base of the manipulator. Besides, based on the kinematics of the manipulator and a calibrated camera, the pose of the manipulator can be determined. Furthermore, a graphical user interface is developed, which is convenient for users to operate the entire system. Two examples are demonstrated, and the estimated results are compared with those from the encoders. The proposed approach does not compete with the encoders. Instead, the approach can be treated as a backup method, which can provide a reference solution.

[1]  Venkat Krovi,et al.  Estimating Dynamics On-the-Fly Using Monocular Video For Vision-Based Robotics , 2014 .

[2]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bin Wu,et al.  Monocular-vision-based method for online measurement of pose parameters of weld stud , 2015 .

[4]  Fan Zhang,et al.  Monocular vision-based iterative pose estimation algorithm from corresponding feature points , 2010, Science China Information Sciences.

[5]  Morris Driels,et al.  Full-pose calibration of a robot manipulator using a coordinate-measuring machine , 1993 .

[6]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  L. L. Huang,et al.  Monocular Camera Calibration Method for Robot System , 2015 .

[8]  Riby Abraham Boby,et al.  Single image based camera calibration and pose estimation of the end-effector of a robot , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Kyrre Glette,et al.  Automatic calibration of a robot manipulator and multi 3D camera system , 2016, 2016 IEEE/SICE International Symposium on System Integration (SII).

[10]  Farrokh Janabi-Sharifi,et al.  Virtual Visual Servoing for Multicamera Pose Estimation , 2015, IEEE/ASME Transactions on Mechatronics.

[11]  Jian Zhou,et al.  A New Full Pose Measurement Method for Robot Calibration , 2013, Sensors.

[12]  Philippe Martinet,et al.  Unifying Kinematic Modeling, Identification, and Control of a Gough–Stewart Parallel Robot Into a Vision-Based Framework , 2006, IEEE Transactions on Robotics.

[13]  Ling Yun Liu,et al.  Study of Pose Detection Algorithm for Specific Object Based on Monocular Vision , 2014 .

[14]  L. W. Tsai,et al.  Robot Analysis: The Mechanics of Serial and Parallel Ma-nipulators , 1999 .

[15]  Zhanyi Hu,et al.  PnP Problem Revisited , 2005, Journal of Mathematical Imaging and Vision.

[16]  Zheng H. Zhu,et al.  Autonomous robotic capture of non-cooperative target using visual servoing and motion predictive control , 2014, Auton. Robots.

[17]  Tao Zhang,et al.  Vision-Based Pose Estimation From Points With Unknown Correspondences , 2014, IEEE Transactions on Image Processing.

[18]  Ying Bai,et al.  Robot manipulator calibration using neural network and a camera-based measurement system , 2012 .

[19]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Kostas Daniilidis,et al.  Linear Pose Estimation from Points or Lines , 2002, ECCV.

[21]  Jason J. Corso,et al.  Estimating Dynamics On-the-Fly Using Monocular Video For Vision-Based Robotics , 2014, IEEE/ASME Transactions on Mechatronics.

[22]  Jun Ota,et al.  Proposal of Artificial Mark to Measure 3D Pose by Monocular Vision , 2007 .

[23]  Sumant Sharma,et al.  Comparative assessment of techniques for initial pose estimation using monocular vision , 2016 .

[24]  Chunhui Liu,et al.  Training-based head pose estimation under monocular vision , 2016, IET Comput. Vis..

[25]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[26]  Gen Endo,et al.  In-field self-calibration of robotic manipulator using stereo camera: application to Humanitarian Demining Robot , 2015, Adv. Robotics.

[27]  Ilian A. Bonev,et al.  Comparison of two calibration methods for a small industrial robot based on an optical CMM and a laser tracker , 2013, Robotica.

[28]  Jun Chen,et al.  A quaternion pose determination solution based on monocular vision model , 2011, Photoelectronic Detection and Imaging.

[29]  Yongsheng Ding,et al.  An efficient two-step solution for vision-based pose determination of a parallel manipulator , 2012 .