Alignment using an uncalibrated camera system

We describe a method for the visual control of a robotic system which does not require the formulation of an explicit calibration between image coordinates and the world coordinates. By extracting control information directly from the image, we free our technique from the errors normally associated with a fixed calibration. We attach a camera system to a robot such that the camera system and the robot's gripper rotate simultaneously. As the camera system rotates about the gripper's rotational axis, the circular path traced out by a point-like feature projects to an elliptical path in image space. We gather the projected feature points over part of a rotation and fit the gathered data to an ellipse. The distance from the rotational axis to the feature point in world space is proportional to the size of the generated ellipse. As the rotational axis gets closer to the feature, the feature's projected path will form smaller and smaller ellipses. When the rotational axis is directly above the object, the trajectory degenerates from an ellipse to a single point. We demonstrate the efficacy of the algorithm on the peg-in-hole problem. >

[1]  Warren P. Seering,et al.  A machine learning algorithm for automated assembly , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[2]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[3]  Armando Fox,et al.  Exploiting visual constraints in the synthesis of uncertainty-tolerant motion plans , 1995, IEEE Trans. Robotics Autom..

[4]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[5]  J. Y. S. Luh,et al.  A Three-Dimensional Vision by Off-Shelf System with Multi-Cameras , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[7]  John M. Hollerbach,et al.  Autonomous Robot Calibration for Hand-Eye Coordination , 1991, Int. J. Robotics Res..

[8]  Robert M. Haralick,et al.  Solving camera parameters from the perspective projection of a parameterized curve , 1984, Pattern Recognit..

[9]  Steven B. Skaar,et al.  Camera-Space Manipulation , 1987 .

[10]  Daniel E. Whitney,et al.  Computer-controlled Assembly , 1978 .

[11]  Robert J. Holt,et al.  Camera calibration problem: Some new results , 1991, CVGIP Image Underst..

[12]  H. M. Karara,et al.  Non-topographic photogrammetry , 1989 .

[13]  Martin Herman,et al.  Kinematic calibration of an active camera system , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[15]  Masahiko Yachida,et al.  Model-Guided Monitoring of a Building Environment by a Mobile Robot , 1983, IJCAI.

[16]  Antti J. Koivo,et al.  Real-time vision feedback for servoing robotic manipulator with self-tuning controller , 1991, IEEE Trans. Syst. Man Cybern..

[17]  Kiriakos N. Kutulakos,et al.  Recovering shape by purposive viewpoint adjustment , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Yiu Cheung Shiu,et al.  3D location of circular and spherical features by monocular model-based vision , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[19]  Roberto Cipolla,et al.  Uncalibrated stereo hand-eye coordination , 1994, Image Vis. Comput..

[20]  Takeo Kanade,et al.  Vision and control techniques for robotic visual tracking , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[21]  J. K. Aggarwal,et al.  Determining the position of a robot using a single calibration object , 1984, ICRA.

[22]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[23]  Seth Hutchinson,et al.  Visual compliance: task-directed visual servo control , 1994, IEEE Trans. Robotics Autom..

[24]  Beno Benhabib,et al.  Accurate estimation of elliptical shape parameters from a grey-level image , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[25]  Beno Benhabib,et al.  Three-dimensional location estimation of circular features for machine vision , 1992, IEEE Trans. Robotics Autom..

[26]  Allen R. Hanson,et al.  Description and reconstruction from image trajectories of rotational motion , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[27]  Karen B. Sarachik Characterising an indoor environment with a mobile robot and uncalibrated stereo , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[28]  Ruzena Bajcsy,et al.  Autonomous observation under uncertainty , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[29]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[30]  Alan D. Christiansen Manipulation planning for empirical backprojections , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[31]  Roger Tsai,et al.  Synopsis of recent progress on camera calibration for 3D machine vision , 1989 .

[32]  Andrew Blake,et al.  The dynamic analysis of apparent contours , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[33]  G. Thomas Calculus and Analytic Geometry , 1953 .

[34]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[35]  Daniel Raviv A quantitative approach to camera fixation , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Daniel E. Whitney,et al.  Quasi-Static Assembly of Compliantly Supported Rigid Parts , 1982 .

[37]  Andrew Zisserman,et al.  Appendix—projective geometry for machine vision , 1992 .

[38]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..