Adaptive Visual Servoing for Various Kinds of Robot Systems

This paper propose an adaptive visual servoing method consisting of an on-line estimator of the robot/image Jacobian matrix and a feedback/feedforward controller for uncalibrated camera-manipulator systems. The estimator does not need a priori knowledge on the kinematic structure nor on parameters of the camera-manipulator system. The controller consists of feedforward and feedback terms to make the image features converge to the desired trajectories using the estimated results. Some experimental results are given to show the validity of the proposed method.

[1]  Minoru Asada,et al.  Vision-based servoing control for legged robots , 1997, Proceedings of International Conference on Robotics and Automation.

[2]  Nikolaos Papanikolopoulos,et al.  Six degree-of-freedom hand/eye visual tracking with uncertain parameters , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  Peter K. Allen,et al.  Alignment using an uncalibrated camera system , 1995, IEEE Trans. Robotics Autom..

[4]  C. S. George Lee,et al.  Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera , 1990, IEEE Trans. Syst. Man Cybern..

[5]  Nikolaos Papanikolopoulos,et al.  Adaptive robotic visual tracking: theory and experiments , 1993, IEEE Trans. Autom. Control..

[6]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[7]  Peter Corke,et al.  VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW , 1993 .

[8]  William L. Wilson,et al.  VISUAL SERVO CONTROL OF ROBOTS USING KALMAN FILTER ESTIMATES OF ROBOT POSE RELATIVE TO WORK-PIECES , 1993 .

[9]  Masayuki Inaba,et al.  Rope handling by mobile hand-eye robots , 1993 .

[10]  Seth Hutchinson,et al.  Visual compliance: task-directed visual servo control , 1994, IEEE Trans. Robotics Autom..

[11]  Minoru Asada,et al.  Trajectory generation for obstacle avoidance of uncalibrated stereo visual servoing without 3D reconstruction , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[12]  Minoru Asada,et al.  Adaptive hybrid visual servoing/force control in unknown environment , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[13]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[14]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[15]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[16]  Fumio Miyazaki,et al.  Manipulator Control by Visual Ser-voing with the Stereo Vision , 1993 .

[17]  Nikolaos Papanikolopoulos,et al.  Visual Servoing for Robotic Assembly , 1993 .

[18]  Christopher Brown,et al.  Gaze controls with interactions and decays , 1989, IEEE Trans. Syst. Man Cybern..

[19]  Z. Zenn Bien,et al.  Feature-based visual servoing of an eye-in-hand robot with improved tracking performance , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[20]  Gregory D. Hager,et al.  Robot feedback control based on stereo vision: towards calibration-free hand-eye coordination , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[21]  Ernst D. Dickmanns,et al.  An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles , 1990, IEEE Trans. Syst. Man Cybern..