Model-based visual feedback control for a hand-eye coordinated robotic system

The integration of a single camera into a robotic system to control the relative position and orientation between the robot's end-effector and a moving part in real time is discussed. Only monocular vision techniques are considered because of current limitations in the speed of computer vision analysis. The approach uses geometric models of both the part and the camera, as well as the extracted image features, to generate the appropriate robot control signals for tracking. Part and camera models are also used during the teaching stage to predict important image features that appear during task completion.<<ETX>>

[1]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  D. E. Whitney,et al.  The mathematics of coordinated control of prosthetic arms and manipulators. , 1972 .

[4]  C. S. G. Lee,et al.  Robotics: Control, Sensing, Vision, and Intelligence , 1987 .

[5]  R. Paul Robot manipulators : mathematics, programming, and control : the computer control of robot manipulators , 1981 .

[6]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[7]  Lee E. Weiss,et al.  Adaptive Visual Servo Control of Robots , 1983 .

[8]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[9]  Suguru Arimoto,et al.  Stability and robustness of PID feedback control for robot manipulators of sensory capability , 1984 .

[10]  O. Robert Mitchell Global And Partial Shape Discrimination For Computer Vision , 1983, Optics & Photonics.

[11]  John Todd Feddema,et al.  Real-time visual feedback control for hand-eye coordinated robotic systems , 1989 .

[12]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[13]  Gerhard Hirzinger,et al.  Robot Systems Completely Based on Sensory Feedback , 1986, IEEE Transactions on Industrial Electronics.