Hybrid Visual-Ranging Servoing for Positioning Based on Image and Measurement Features

In this article, a hybrid visual-ranging servoing method is proposed to realize high-precision positioning tasks with a 6-degree of freedom (DOF) manipulator. This method utilizes the image and measurement features directly in the control loop. Without the need of complex image feature design and attitude estimation, this method realizes the 6-DOF control of a robot. A vital challenge in traditional vision-based systems is avoiding local minima and singularity problems. To tackle this issue, a full-rank interaction matrix hybrid visual servo (FRHVS) design criterion is proposed, which guarantees that the hybrid interaction matrix and its pseudoinverse matrix are both full rank. Moreover, the interaction matrix for these hybrid strategies, which combines image features with other sensors features, is derived in an analytical form. Experiments on a 6-DOF manipulator show that the proposed method is effective and has global asymptotic stability and high precision.

[1]  Yunhui Liu,et al.  Fully Uncalibrated Image-Based Visual Servoing of 2DOFs Planar Manipulators With a Fixed Camera , 2021, IEEE Transactions on Cybernetics.

[2]  Akio Namiki,et al.  Target Tracking of Moving and Rotating Object by High-Speed Monocular Active Vision , 2020, IEEE Sensors Journal.

[3]  Zane Zake,et al.  Robust 2½D Visual Servoing of A Cable-Driven Parallel Robot Thanks to Trajectory Tracking , 2020, IEEE Robotics and Automation Letters.

[4]  Jian Chen,et al.  Visual Tracking and Depth Estimation of Mobile Robots Without Desired Velocity Information , 2020, IEEE Transactions on Cybernetics.

[5]  Anders Eriksson,et al.  3D Move to See: Multi-perspective visual servoing towards the next best view within unstructured and occluded environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Jianbin Qiu,et al.  Quality Inspection of Remote Radio Units Using Depth-Free Image-Based Visual Servo With Acceleration Command , 2019, IEEE Transactions on Industrial Electronics.

[7]  Xuebo Zhang,et al.  Visual Servoing of Wheeled Mobile Robots Without Desired Images , 2019, IEEE Transactions on Cybernetics.

[8]  Omar Tahri,et al.  A Direct Dense Visual Servoing Approach Using Photometric Moments , 2018, IEEE Transactions on robotics.

[9]  Xian-Da Zhang,et al.  Matrix Analysis and Applications , 2017 .

[10]  Yanbin Gao,et al.  An Enhanced IBVS Controller of a 6DOF Manipulator Using Hybrid PD-SMC Method , 2017, International Journal of Control, Automation and Systems.

[11]  Ilian A. Bonev,et al.  Dynamic path tracking of industrial robots with high accuracy by visual servoing , 2017, 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[12]  Wen-Fang Xie,et al.  Image-Based Visual Servoing Using an Optimized Trajectory Planning Technique , 2017, IEEE/ASME Transactions on Mechatronics.

[13]  Tingting Wang,et al.  Robust Online Model Predictive Control for a Constrained Image-Based Visual Servoing , 2016, IEEE Transactions on Industrial Electronics.

[14]  Cédric Demonceaux,et al.  Visual Servoing Based on Shifted Moments , 2015, IEEE Transactions on Robotics.

[15]  Abolfazl Mohebbi,et al.  Augmented Image-Based Visual Servoing of a Manipulator Using Acceleration Command , 2014, IEEE Transactions on Industrial Electronics.

[16]  W. Wilson,et al.  Comparison of Basic Visual Servoing Methods , 2011, IEEE/ASME Transactions on Mechatronics.

[17]  Ying Wang,et al.  A Hybrid Visual Servo Controller for Robust Grasping by Wheeled Mobile Robots , 2010, IEEE/ASME Transactions on Mechatronics.

[18]  Zheng Li,et al.  Switching Control of Image-Based Visual Servoing With Laser Pointer in Robotic Manufacturing Systems , 2009, IEEE Transactions on Industrial Electronics.

[19]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[20]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[21]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[22]  François Chaumette,et al.  2 1/2 D visual servoing: a possible solution to improve image-based and position-based visual servoings , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[23]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[24]  Seth Hutchinson,et al.  Visual compliance: task-directed visual servo control , 1994, IEEE Trans. Robotics Autom..

[25]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[26]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[27]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[28]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[29]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[30]  Patrick Rives,et al.  Singularities in the determination of the situation of a robot effector from the perspective view of 3 points , 1993 .