Performing temporal action with a hand-eye system using the SHOSLIF approach

In this paper we present a general framework by which a robotic system can be trained to perform some tasks. In the training phase, the system learns the relationship between the sensors and the actuators from a series of training examples supplied interactively by a system trainer. The system automatically builds a recursive partition tree (RPT) which approximates the mapping from the input to the output. Each node of the RPT represents a cell of the space which is further partitioned by its children via a Voronoi tessellation. Each leaf node corresponds to a training sample and stores the corresponding output. In the performance phase, given an input, the RPT is used to retrieve the desired output by interpolating among all the leaf nodes that are good matches to the input. Such a mechanism is used to accomplish major components of the system, including stereo calibration and sensor-based action sequence learning and execution. A hand-eye system with a PUMA 560 robotic manipulator is used to test the method.

[1]  Anneliese Schrott.  Feature-based camera-guided grasping by an eye-in-hand robot , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[2]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[3]  Klaus Schulten,et al.  Implementation of self-organizing neural networks for visuo-motor control of an industrial robot , 1993, IEEE Trans. Neural Networks.

[4]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[5]  R. Sharma,et al.  Toward robust vision-based control: hand/eye coordination without calibration , 1991, Proceedings of the 1991 IEEE International Symposium on Intelligent Control.

[6]  Shaoyun Chen,et al.  Autonomous navigation through case-based learning , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[7]  Rajeev Sharma,et al.  Dynamic robot manipulation using visual tracking , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[8]  John,et al.  On Comprehensive Visual Learning , 1994 .

[9]  W. Sardha Wijesoma,et al.  Eye-to-Hand Coordination for Vision-Guided Robot Control Applications , 1993, Int. J. Robotics Res..

[10]  Seth Hutchinson,et al.  Hybrid vision/position servo control of a robotic manipulator , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.