Partially Decoupled Image-Based Visual Servoing Using Different Sensitive Features

A new image-based visual servoing method based on sensitive features is presented to separately realize the position control and orientation control. Line features are used for the orientation control because of their sensitivities to rotational motions. Point features and area size features are employed to realize the position control since area size features are very sensitive to the objects’ depths. The translations resulting from rotational motions are introduced into the position control as the compensation in order to eliminate the influence of the camera’s motions on the point features. The depths for all active features are estimated via interaction matrices, features variations, and the executed camera motions. The proposed method can keep the tracked objects in the camera’s field of view in the visual servoing process. In addition, the determination methods of the interaction matrices for point, line, and area size features are proposed. Comparing to the traditional method, the proposed determination method of the interaction matrix for line is independent from the parameters of the plane containing the line. Experimental results verify the effectiveness of the proposed methods.

[1]  Jianhua Wang,et al.  Control Strategy for a Low Cost Manipulator to Transport and Align IC Mask-Plates , 2009, IEEE Transactions on Control Systems Technology.

[2]  Nabil Aouf,et al.  Image Based Visual Servo control for Fixed Wing UAVs tracking linear infrastructure in wind , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Rolf Unbehauen,et al.  Robot visual servoing with iterative learning control , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Peter I. Corke,et al.  Generic decoupled image-based visual servoing for cameras obeying the unified projection model , 2009, 2009 IEEE International Conference on Robotics and Automation.

[5]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[6]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[7]  De Xu,et al.  A general recursive linear method and unique solution pattern design for the perspective-n-point problem , 2008, Image Vis. Comput..

[8]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Danica Kragic,et al.  Survey on Visual Servoing for Manipulation , 2002 .

[10]  Henk Nijmeijer,et al.  Direct Motion Planning for Vision-Based Control , 2014, IEEE Transactions on Automation Science and Engineering.

[11]  Xiaoqin Zhang,et al.  Human Pose Estimation and Tracking via Parsing a Tree Structure Based Human Model , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Kelvin Chen Chih Peng,et al.  Using Machine Vision and Hand-Motion Control to Improve Crane Operator Performance , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Jean-Michel Pflimlin,et al.  Automatic landing on aircraft carrier by visual servoing , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[15]  Selim Benhimane,et al.  Homography-based 2D Visual Tracking and Servoing , 2007, Int. J. Robotics Res..

[16]  Yunhui Liu,et al.  Adaptive visual servoing using common image features with unknown geometric parameters , 2013, Autom..

[17]  Hui Xie,et al.  IBVS of a rotary wing UAV using line features , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[18]  De Xu,et al.  High Precision Automatic Assembly Based on Microscopic Vision and Force Information , 2016, IEEE Transactions on Automation Science and Engineering.

[19]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[20]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[21]  Radu Horaud,et al.  Visual Servoing from Lines , 2002, Int. J. Robotics Res..

[22]  Christophe Doignon,et al.  Stereo visual servoing with decoupling control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Vittoria Bruni,et al.  An Improvement of Kernel-Based Object Tracking Based on Human Perception , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Hesheng Wang,et al.  An adaptive controller for image-based visual servoing of robot manipulators , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[25]  Dongbing Gu,et al.  Visual Imaging of Invisible Hazardous Substances Using Bacterial Inspiration , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[27]  De Xu,et al.  A Fast Orientation Estimation Approach of Natural Images , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  John T. Wen,et al.  A Sensor-Based Dual-Arm Tele-Robotic System , 2015, IEEE Transactions on Automation Science and Engineering.

[29]  Zhi Liu,et al.  Adaptive Visual Tracking Control for Manipulator With Actuator Fuzzy Dead-Zone Constraint and Unmodeled Dynamic , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  Hesheng Wang,et al.  Visual tracking of robots in uncalibrated environments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Colin Bradley,et al.  Hierarchical Model Predictive Image-Based Visual Servoing of Underwater Vehicles With Adaptive Neural Network Dynamic Control , 2016, IEEE Transactions on Cybernetics.

[32]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.