Set space visual servoing of a 6-DOF manipulator

This article develops a set space visual servoing method that is quiet different from state-of-the-art approaches. Our approach does not require complex image processing techniques for the extraction, matching and tracking of image features. Instead, it only requires a simple matching algorithm and builds visual errors in set space. Each error is mainly related to one degree of freedom of the camera; therefore, we can design a decoupled control law. This control law is robust and does not require calibrated inner parameters of the camera. Our approach has been validated in 4-degree-of-freedom (DOF) visual servoing simulations with common image patterns and 6-DOF visual servoing experiments with specific image patterns. These visual servoing tasks are properly achieved even when partial occlusions occur.

[1]  Cédric Demonceaux,et al.  Visual Servoing Based on Shifted Moments , 2015, IEEE Transactions on Robotics.

[2]  J. Flusser,et al.  Moments and Moment Invariants in Pattern Recognition , 2009 .

[3]  Bo Song,et al.  Non-vector space control for nanomanipulations based on compressive feedbacks , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[5]  Günter Rudolph,et al.  Visual Servoing with Moments of SIFT Features , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[6]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[7]  W. F. Xie,et al.  Multiple cameras-multiple target points visual servoing in large scale 3D manufacturing systems , 2011, 2011 6th IEEE Conference on Industrial Electronics and Applications.

[8]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[10]  François Chaumette,et al.  Appearance-Based Indoor Navigation by IBVS Using Line Segments , 2016, IEEE Robotics and Automation Letters.

[11]  Gregory D. Hager,et al.  Kernel-based visual servoing , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Yunhui Liu,et al.  Uncalibrated dynamic visual servoing using line features , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  François Chaumette,et al.  Image moments: a general and useful set of features for visual servoing , 2004, IEEE Transactions on Robotics.

[14]  Christophe Collewet,et al.  Photometric Visual Servoing , 2011, IEEE Transactions on Robotics.

[15]  Éric Marchand,et al.  Mutual Information-Based Visual Servoing , 2011, IEEE Transactions on Robotics.

[16]  Guoqiang Ye,et al.  Novel hybrid IBVS based on the unified projection model , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[17]  Luc Doyen,et al.  Mutational equations for shapes and vision-based control , 1995, Journal of Mathematical Imaging and Vision.

[18]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[19]  Gordon Cheng,et al.  Robust second order sliding mode control for 6D position based visual servoing with a redundant mobile manipulator , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[20]  Weiguang Li,et al.  Novel two-stage hybrid IBVS controller combining Cartesian and polar based methods , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[21]  Tolga Yuksel,et al.  IBVS with fuzzy sliding mode for robot manipulators , 2015, 2015 International Workshop on Recent Advances in Sliding Modes (RASM).

[22]  T. Martin McGinnity,et al.  A position based visual tracking system for a 7 DOF robot manipulator using a Kinect camera , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[23]  Abolfazl Mohebbi,et al.  Augmented Image-Based Visual Servoing of a Manipulator Using Acceleration Command , 2014, IEEE Transactions on Industrial Electronics.