Is 3D useful in stereo visual control?

The main goal of this paper, is the study of image-based stereo visual servoing. A pair of cameras is mounted on the end-effector of the manipulator arm. The visual features are the pair of images of an unknown object. The developed control laws use either the raw image points, or the estimated 3D coordinates. The experimental setup is challenging: large rotations are involved, images are noisy, and cameras are coarsely calibrated. In this setup, the trajectory of the end-effector differs notably, sometimes leading the arm near its joint range limits. Experimental results demonstrate that using pixel coordinates is disadvantageous, compared with 3D coordinates estimated from the same pixel data.

[1]  Radu Horaud,et al.  Controlling robots with two cameras: how to do it properly , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[2]  François Berry,et al.  Stereo Visual Servoing with a Single Point: a Comparative Study , 2001 .

[3]  Minoru Asada,et al.  Adaptive binocular visual servoing for independently moving target tracking , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[4]  Hideki Hashimoto,et al.  Image-based visual servoing control of a SCARA type dual-arm robot , 2000, ISIE'2000. Proceedings of the 2000 IEEE International Symposium on Industrial Electronics (Cat. No.00TH8543).

[5]  Gregory D. Hager,et al.  Robot hand-eye coordination based on stereo vision , 1995 .

[6]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[7]  Giulio Sandini,et al.  Robust visual servoing in 3-D reaching tasks , 1996, IEEE Trans. Robotics Autom..

[8]  Fumio Miyazaki,et al.  Manipulator Control by Visual Ser-voing with the Stereo Vision , 1993 .