Optical target location using machine vision in space robotics tasks

For practical use of robotics in space machine vision is required to automatically locate objects in order to guide an autonomous control system or to assist a human teleoperator. The vision task is facilitated by placing optical targets or markings in advance on the objects to be located. We have experimented with techniques to locate such optical targets from monocular images. These include camera calibration determination of the camera to tool endpoint transformation feature extraction and pose estimation. This paper describes our experiences with these techniques as they were implemented in an integrated robot-vision system to perform tasks characteristic of space construction and servicing. The accuracies of the target location techniques were also verified separately using an optical bench and positioning devices. The usefulness of the optical target location system was demonstrated in the autonomous control of two Cincinnati Milacron T3-726 robot arms. 1 .

[1]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  D. W. Thompson,et al.  Three-dimensional model matching from an unconstrained viewpoint , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[4]  Roger Y. Tsai,et al.  Overview Of A Unified Calibration Trio For Robot Eye, Eye-To-Hand, And Hand Calibration Using 3D Machine Vision , 1989, Optics East.

[5]  James S. Albus,et al.  NASA/NBS Standard Reference Model for Telerobot Control System Architecture (NASREM) , 1989 .

[6]  Morris Driels,et al.  Vision-based automatic theodolite for robot calibration , 1991, IEEE Trans. Robotics Autom..

[7]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[8]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[9]  William J. Wolfe,et al.  Locating Known Objects In 3-D From A Single Perspective View , 1989, Other Conferences.

[10]  Guy Bruno,et al.  Testbed for tele-autonomous operation of multiarmed robotic servicers in space , 1991, Other Conferences.

[11]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[12]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[14]  David Harwood,et al.  Passive ranging to known planar point sets , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[15]  Ernest L. Hall,et al.  Intelligent Robots and Computer Vision VI , 1987 .