Visual Servoing from Lines

In this paper, we present a new approach to visual servoing using lines. It is based on a theoretical and geometrical study of the main line representations, which allows us to define a new representation, the so-called binormalized Plücker coordinates. These are particularly well suited for visual servoing. Indeed, they allow the definition of an image line alignment concept. Moreover, the control law which realizes such an alignment has several properties: partial decoupling between rotation and translation, analytical inversion of the motion equations and global asymptotic stability conditions. This control law was validated both in simulation and experimentally in the specific case of an orthogonal trihedron.

[1]  J. Plucker I. On a new geometry of space , Proceedings of the Royal Society of London.

[2]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[3]  P. Rives,et al.  7 - Estimation récursive de primitives 3D au moyen d'une caméra mobile , 1987 .

[4]  Jorge Stolfi,et al.  Oriented projective geometry , 1987, SCG '87.

[5]  R. Lathe Phd by thesis , 1988, Nature.

[6]  Olivier D. Faugeras,et al.  Determination of camera location from 2D to 3D line and point correspondences , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Thomas S. Huang,et al.  Estimation of rigid body motion using straight line correspondences , 1986, Comput. Vis. Graph. Image Process..

[8]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[10]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Olivier D. Faugeras,et al.  Determination of Camera Location from 2-D to 3-D Line and Point Correspondences , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J. Michael McCarthy,et al.  Introduction to theoretical kinematics , 1990 .

[13]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[14]  Homer H. Chen Pose Determination from Line-to-Plane Correspondences: Existence Condition and Closed-Form Solutions , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[17]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[18]  Peter Corke,et al.  VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW , 1993 .

[19]  Richard I. Hartley,et al.  Projective reconstruction from line correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[21]  Guy Motyl,et al.  Real-Time Visual Servoing Using Controlled Illumination , 1994, Int. J. Robotics Res..

[22]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[23]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[24]  Philippe Martinet,et al.  Visual servoing in robotics scheme using a camera/laser-stripe sensor , 1996, IEEE Trans. Robotics Autom..

[25]  T. Kanade,et al.  Affine structure from line correspondences with uncalibrated affine cameras , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Gert Vegter,et al.  In handbook of discrete and computational geometry , 1997 .

[27]  Gregory D. Hager,et al.  A modular system for robust positioning using feedback from stereo vision , 1997, IEEE Trans. Robotics Autom..

[28]  Philippe Martinet,et al.  Vision-Based Control in Driving Assistance of Agricultural Vehicles , 1998, Int. J. Robotics Res..

[29]  E. Panteley,et al.  On global uniform asymptotic stability of nonlinear time-varying systems in cascade , 1998 .

[30]  Michael Lützeler,et al.  ROAD RECOGNITION WITH MARVEYE , 1998 .

[31]  Ezio Malis Contributions a la modelisation et a la commande en asservissement visuel , 1998 .

[32]  H. Pottmann,et al.  Approximation in Line Space — Applications in Robot Kinematics and Surface Reconstruction , 1998 .

[33]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[34]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[35]  Nicolas Andreff Asservissement visuel à partir de droites et auto-étalonnage pince-caméra , 1999 .

[36]  Radu Horaud,et al.  Visual Servoing of Robot Manipulators Part I: Projective Kinematics , 1999, Int. J. Robotics Res..

[37]  Stéphane Christy,et al.  Iterative Pose Computation from Line Correspondences , 1999, Comput. Vis. Image Underst..

[38]  Radu Horaud,et al.  Visual Servoing from Lines , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[39]  Roberto Cipolla,et al.  Real-Time Tracking of Multiple Articulated Structures in Multiple Views , 2000, ECCV.

[40]  José Santos-Victor,et al.  Visual servoing and appearance for navigation , 2000, Robotics Auton. Syst..

[41]  Visual servoing for automatic and uncalibrated needle placement for percutaneous procedures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[42]  Robert E. Mahony,et al.  Visual servoing using linear features for under-actuated rigid body dynamics , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[43]  Radu Horaud,et al.  Robot Hand-Eye Calibration Using Structure-from-Motion , 2001, Int. J. Robotics Res..

[44]  Andrew Zisserman,et al.  Robust Object Tracking , 2001 .

[45]  Robert E. Mahony,et al.  Visual servoing for a scale model autonomous helicopter , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[46]  Yangquan Chen,et al.  Visual servoing of an omni-directional mobile robot for alignment with parking lot lines , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[47]  Radu Horaud,et al.  Multiple-Camera Tracking of Rigid Objects , 2002, Int. J. Robotics Res..

[48]  B. Espiau,et al.  Revisiting Plücker Coordinates in Vision-Based Control , 2002 .

[49]  A. ADoefaa,et al.  ? ? ? ? f ? ? ? ? ? , 2003 .

[50]  Olivier D. Faugeras,et al.  Motion of points and lines in the uncalibrated case , 2004, International Journal of Computer Vision.

[51]  Hans-Hellmut Nagel,et al.  Model-Based Stereo-Tracking of Non-Polyhedral Objects for Automatic Disassembly Experiments , 2000, International Journal of Computer Vision.

[52]  Minas E. Spetsakis,et al.  Structure from motion using line correspondences , 1990, International Journal of Computer Vision.