Visual Servoing—Optimal Control Approach—

The visual servoing system is composed of an object and an eye-in-hand robot. The object is moving around the robot work space and the robot is tracking the object by using a visual sensor mounted on the hand. This paper proposes a control theoretic formulation for the visual servoing system. The system is modeled by the perspective transformation of the camera and the kinematic transformation of the robot. The system is linearized at the reference point yielding an MIMO time-invariant model. An optimal control approach is proposed to design a robust feedback controller. Controllability and stability of the system is also discussed. Realtime experiments on PUMA560 are carried out to evaluate and compare the proposed approach with previously proposed algorithms.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Rashpal S. Ahluwalia,et al.  A modular approach to visual servoing , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[3]  Peter K. Allen,et al.  Real-time visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[4]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[5]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[6]  Antti J. Koivo,et al.  Real-time vision feedback for servoing robotic manipulator with self-tuning controller , 1991, IEEE Trans. Syst. Man Cybern..

[7]  William J. Wilson,et al.  Direct dynamic control of a robot using an end-point mounted camera and Kalman filter position estimation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[8]  Z. Zenn Bien,et al.  Feature-based visual servoing of an eye-in-hand robot with improved tracking performance , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[9]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[10]  Patrick Rives,et al.  Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[11]  Takeo Kanade,et al.  Vision and control techniques for robotic visual tracking , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.