2D 1/2 Visual Servoing

In this paper, the problem of estimating the partial camera displacement from two images of a static object is studied. The classical approach to linearly estimate the motion parameters is based on the computation of the essential matrix. In this paper, we propose another approach, based on the estimation of an homography matrix related to a chosen plane of an unknown object. Simulations and experiments on a real scene show that this method gives a more robust reconstruction of the motion parameters, especially in the singular cases. The motion parameters are used to design a new vision-based control scheme, called 2D 1/2 visual servoing. Indeed, visual features and data extracted from the partial displacement allow us to design a decoupled control law controlling the six camera d.o.f. The robustness of our visual servoing scheme with respect to camera calibration errors is also analyzed: the necessary and sufficient conditions for local asymptotic stability are easily obtained. Then, thanks to the simple structure of the system, sufficient conditions for global asymptotic stability are established. Finally, experimental results with an eye-in-hand robotic system confirm the improvement in the stability and robustness of the 2D 1/2 visual servoing with respect to classical position-ba- sed and image-based visual servoings.

[1]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[2]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[4]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[5]  Olivier D. Faugeras,et al.  Some Properties of the E Matrix in Two-View Motion Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[7]  Ramesh C. Jain,et al.  Structure from motion-a critical analysis of methods , 1991, IEEE Trans. Syst. Man Cybern..

[8]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[9]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[10]  Bernard Espiau,et al.  Effect of Camera Calibration Errors on Visual Servoing in Robotics , 1993, ISER.

[11]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[12]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[13]  橋本 浩一 Visual servoing : real-time control of robot manipulators based on visual sensory feedback , 1993 .

[14]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[15]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[16]  A. Hanson,et al.  Scaled Euclidean 3D reconstruction based on externally uncalibrated cameras , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[17]  Roger MohrLifia Epipole and Fundamental Matrix Estimation Using the Virtual Parallax Property , 1995 .

[18]  François Chaumette,et al.  Compensation of abrupt motion changes in target tracking by visual servoing , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[19]  Nassir Navab,et al.  Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Michael Brady,et al.  On the Appropriateness of Camera Models , 1996, ECCV.

[21]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[22]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[23]  B. Triggs,et al.  Projective Geometry for Image Analysis , 1996 .

[24]  P. Anandan,et al.  Parallax Geometry of Pairs of Points for 3D Scene Analysis , 1996, ECCV.

[25]  Zhangy,et al.  3 D Reconstruction Based on Homography Mapping Zhongfei , 1996 .

[26]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  E. Malis,et al.  Positioning a Coarse-Calibrated Camera with Respect to an Unknown Planar Object by 2D 1/2 Visual Servoing , 1997 .

[28]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).