Image-based visual feedback control of a dual-arm robot

In this paper, the authors present a new approach to visual feedback control using image-based visual servoing with stereo vision. In order to control the position and orientation of a robot with respect to an object, a new technique is proposed using a binocular stereo vision. The stereo vision enables one to calculate an exact image Jacobian not only at around a desired location, but also at the other locations. The suggested technique can guide a robot manipulator to the desired location without giving such priori knowledge as the relative distance to the desired location or the model of an object, even if the initial positioning error is large. This paper describes a model of stereo vision and how to generate feedback commands. The performance of the proposed visual servoing system is illustrated by the simulation and experimental results and compared with the case of conventional method for an assembling robot.

[1]  Hidenori Kimura,et al.  Dynamic Visual Feedback Control For A Hand-eye Manipulator , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[3]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[4]  Patrick Rives,et al.  Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[5]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[6]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[7]  Patrick Bouthemy,et al.  Exploiting Image Motion for Active Vision in a Visual Servoing Framework , 1996, Int. J. Robotics Res..

[8]  Peter K. Allen,et al.  Real-time visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[9]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..