Visual servoing for large camera displacements

The first aim of any visual-servoing strategy is to avoid features being lost from the field of view and that the desired location may not be reached. However, avoiding both these system failures turns out to be very difficult, especially when the initial and desired locations are distant. Moreover, the methods that succeed in presence of large camera displacements often produce a long translational trajectory that may not be allowed by the robot workspace and/or joint limits. In this paper, a new strategy for dealing with such problems is proposed, which consists of generating circular-like trajectories that may satisfy the task requirements more naturally than other solutions. Knowledge of geometrical models of the object or points depth is not required. It is shown that system failures are avoided for a calibrated camera. Moreover, necessary and sufficient conditions are provided for establishing tolerable errors on the estimates of the intrinsic and extrinsic parameters, in order to guarantee a robust field of view and robust local asymptotic stability. Several simulation results show that the translational trajectories obtained in presence of large displacements are significantly shorter than those produced by the existing methods, in cases of both correct and bad camera calibration. Very satisfactory results are achieved also in presence of small displacements.

[1]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[2]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[3]  Ehud Rivlin,et al.  Visual homing: Surfing on the epipoles , 1997, Block Island Workshop on Vision and Control.

[4]  Patrick Rives,et al.  Robustness of image-based visual servoing with respect to depth distribution errors , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[6]  James P. Ostrowski,et al.  Visual motion planning for mobile robots , 2002, IEEE Trans. Robotics Autom..

[7]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[8]  Guillaume Morel,et al.  Explicit Incorporation of 2D Constraints in Vision Based Control of Robot Manipulators , 1999, ISER.

[9]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[10]  橋本 浩一 Visual servoing : real-time control of robot manipulators based on visual sensory feedback , 1993 .

[11]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[12]  Daniel E. Koditschek,et al.  Visual servoing via navigation functions , 2002, IEEE Trans. Robotics Autom..

[13]  Philippe Martinet,et al.  Position based visual servoing: keeping the object in the field of vision , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[14]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[15]  Camillo J. Taylor,et al.  Robust vision-based pose control , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Ezio Malis,et al.  Vision-based control invariant to camera intrinsic parameters: stability analysis and path tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[18]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[19]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[20]  Koichiro Deguchi,et al.  Optimal Motion Control for Image-Based Visual Servoing by Decoupling Translation and Rotation , 1999 .

[21]  Peter K. Allen,et al.  Visual servoing by partitioning degrees of freedom , 2001, IEEE Trans. Robotics Autom..

[22]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[23]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[24]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..