Improving Image-Based Visual Servoing with Three-Dimensional Features

Neither of the classical visual servoing approaches, position-based and image-based, are completely satisfactory. In position-based visual servoing the trajectory of the robot is well stated, but the approach suffers mainly from the image features going out of the visual field of the cameras. On the other hand, image-based visual servoing has been found generally satisfactory and robust in the presence of camera and hand-eye calibration errors. However, in some cases, singularities and local minima may arise, and the robot can go further from its joint limits. This paper is a step towards the synthesis of both approaches with their particular advantages, i.e., the trajectory of the camera motion is predictable and the image features remain in the field of view of the camera. The basis is the introduction of three-dimensional information in the feature vector. Point depth and object pose produce useful behavior in the control of the camera. Using the task-function approach, we demonstrate the relationship between the velocity screw of the camera and the current and desired poses of the object in the camera frame. Camera calibration is assumed, at least coarsely. Experimental results on real robotic platforms illustrate the presented approach.

[1]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[2]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[3]  Fumio Miyazaki,et al.  Manipulator Control by Visual Ser-voing with the Stereo Vision , 1993 .

[4]  Fumio Miyazaki,et al.  Manipulator control by using servoing with the stereo vision , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[5]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[6]  Nikolaos Papanikolopoulos,et al.  Selection of features and evaluation of visual measurements during robotic visual servoing tasks , 1995, J. Intell. Robotic Syst..

[7]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[8]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[9]  Éric Marchand,et al.  Using the task function approach to avoid robot joint limits and kinematic singularities in visual servoing , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[10]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[11]  Giulio Sandini,et al.  Robust visual servoing in 3-D reaching tasks , 1996, IEEE Trans. Robotics Autom..

[12]  J. Gallice,et al.  Vision Based Control Law using 3 D Visual , 1996 .

[13]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[14]  William J. Wilson,et al.  Automatic selection of image features for visual servoing , 1997, IEEE Trans. Robotics Autom..

[15]  Philippe Martinet,et al.  Vision Based Control Law using 3D Visual Features , 1997 .

[16]  Philippe Martinet,et al.  Trajectory generation by visual servoing , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Gregory D. Hager,et al.  The confluence of vision and control, Block Island Workshop on Vision and Control, June 23-27, 1997, Block Island, Rhode Island, USA , 1998, Block Island Workshop on Vision and Control.

[18]  Philippe Martinet,et al.  Real Time Visual Servoing Around a Complex Object , 1998, MVA.

[19]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[20]  Philippe Martinet,et al.  Visual servoing with indirect image control and a predictable camera trajectory , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[21]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Guillaume Morel,et al.  Explicit Incorporation of 2D Constraints in Vision Based Control of Robot Manipulators , 1999, ISER.

[23]  Philippe Martinet,et al.  Visual feedback in camera motion generation: experimental results , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[24]  Philippe Martinet,et al.  Position based visual servoing using a non-linear approach , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[25]  Robust real-time visual tracking using a 2 D-3 D model-based approach , 1999 .

[26]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[27]  S. Hutchinson,et al.  A new hybrid image-based visual servo control scheme , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[28]  Toshiro Noritsugu,et al.  Potential problems and switching control for visual servoing , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[29]  Radu Horaud,et al.  What metric stereo can do for visual servoing , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[30]  Franck Plestan,et al.  Robust vision based 3D trajectory tracking using sliding mode control , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[31]  François Chaumette,et al.  2 1/2 D visual servoing: a possible solution to improve image-based and position-based visual servoings , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[32]  P. Souéres,et al.  Advanced Control Strategy for the Visual Servoing Scheme , 2000 .

[33]  Radu Horaud,et al.  Controlling robots with two cameras: how to do it properly , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[34]  Youcef Mezouar.  Planification de trajectoires pour l'asservissement visuel , 2001 .

[35]  François Chaumette,et al.  Design and tracking of desirable trajectories in the image space by integrating mechanical and visibility constraints , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[36]  P. Martinet,et al.  IMAGE-BASED STEREO VISUAL SERVOING: 2D VS 3D FEATURES , 2002 .

[37]  Philippe Martinet,et al.  Position based visual servoing: keeping the object in the field of vision , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[38]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.