A Hybrid Image Based Visual Servoing for a Manipulator using Kinect

In this paper, we propose a hybrid image based visual servoing for 6 degrees of freedom (DoF) robot manipulators. It avoids the drawbacks of classical position-based visual servoing. Contrary to the position-based visual servoing, this method does not require any knowledge of the geometric 3 DoF model of the object. On the other hand, the depth information of the object is required. In the proposed approach, a Kinect sensor is used as a camera, which provides depth information of the object from the point cloud. This method tracks the position of the target object. The method is simulated in Gazebo platform with Kinect sensor mounted on 6 DoF Universal Robot 5 (UR5) manipulator, where all the physical parameters of the robot and Kinect sensor is considered. The solution is developed in C++ integrated with ROS, OpenCV. The method illustrated with a variety of simulation results with an eye-in-hand robotic system which shows the convergence of the system and potential of our method.

[1]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[2]  François Chaumette,et al.  Analysis of classical and new visual servoing control laws , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[4]  Patrick Rives,et al.  Robustness of image-based visual servoing with respect to depth distribution errors , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  W. Wilson,et al.  Comparison of Basic Visual Servoing Methods , 2011, IEEE/ASME Transactions on Mechatronics.

[6]  Martin Jägersand,et al.  Global Visual-Motor Estimation for Uncalibrated Visual Servoing , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Lee E. Weiss,et al.  Dynamic visual servo control of robots: An adaptive image-based approach , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[8]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[9]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[10]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[11]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[12]  Farrokh Janabi-Sharifi,et al.  Generalizations to Control Laws of Image-Based Visual Servoing , 2009 .

[13]  S. Hutchinson,et al.  A new hybrid image-based visual servo control scheme , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[14]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[15]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[16]  Martin Jägersand,et al.  Robust Jacobian Estimation for Uncalibrated Visual Servoing , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[18]  Hu Lei,et al.  Visual servo control in Massage robot , 2010, The 2nd International Conference on Information Science and Engineering.