Fast Calibrated Stereo Vision for Manipulation

To make sensors in general, and vision in particular, work for robotic systems, we must find ways to extract timely, relevant, accurate information. Building such sensors will require employing any special devices, constraints or calibration that can help us meet these goals. This paper describes in detail issues in developing a calibrated stereo vision system for robotic part manipulation. A robot arm is used to generate calibration data. A high-speed pipeline processor generates correspondences at 4 Hz, using an image warping device to rectify the right image according to the epipolar transformation at frame rates. A highly simplified localization system determines part position to within acceptable tolerances for the robot manipulator within 5?7 s. The result is a complete vision/manipulation system for part manipulation.

[1]  H. K. Nishihara,et al.  Practical Real-Time Imaging Stereo Matcher , 1984 .

[2]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[3]  T. Poggio,et al.  A parallel algorithm for real-time computation of optical flow , 1989, Nature.

[4]  Rajiv Gupta,et al.  Computing matched-epipolar projections , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[6]  G. Salgian,et al.  Electronically directed "focal" stereo , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  Tomaso A. Poggio,et al.  On parallel stereo , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[9]  Bill Ross,et al.  A practical stereo vision system , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Nicholas Ayache,et al.  Towards Real-time Trinocular Stereo , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[11]  Charles Hansen,et al.  Rectification of images for binocular and trinocular stereovision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.