Manipulator control with image-based visual servo

A visual feedback control scheme, called image-based visual servo, is proposed for manipulators with cameras on their hands. To accomplish specific tasks in unstructured environments, it is essential to have capabilities of recognizing the object position with respect to the manipulator hand. Using the Jacobian matrix relating the camera motion to the object position change in the acquired image, a state space formulation of a visual feedback system is established. On the basis of the task defined in the image plane, the desired motion of the hand is achieved by time-variant state feedback. The image-based scheme is applied to a task of tracking a moving object by the camera (and the hand). Simulations show that the control scheme is stable even under noisy conditions, while the conventional position-based servo tends to be unstable. Experiments on a PUMA 560 show the validity and the effectiveness of the image-based visual servo.<<ETX>>

[1]  Yoshiaki Shirai,et al.  Guiding a robot by visual feedback in assembling tasks , 1973, Pattern Recognit..

[2]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[3]  Olivier D. Faugeras,et al.  Building visual maps by combining noisy stereo measurements , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[4]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[5]  Rashpal S. Ahluwalia,et al.  A modular approach to visual servoing , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[6]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[7]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[8]  Olivier D. Faugeras,et al.  Building, Registrating, and Fusing Noisy Visual Maps , 1988, Int. J. Robotics Res..

[9]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[10]  Hidenori Kimura,et al.  A New Parallel Algorithm for Inverse Dynamics , 1989, Int. J. Robotics Res..

[11]  Tsutomu Kimoto,et al.  Cartesian-Space Nonlinear Feedback Control with a Parallel Processing System , 1990 .

[12]  橋本 浩一.  Model-based control of a manipulator with dynamic visual servo , 1990 .

[13]  Hidenori Kimura,et al.  An Implementation of a Parallel Algorithm for Real-Time Model- Based Control on a Network of Microprocessors , 1990, Int. J. Robotics Res..