The MVP sensor planning system for robotic vision tasks

The MVP (machine vision planner) model-based sensor planning system for robotic vision is presented. MVP automatically synthesizes desirable camera views of a scene based on geometric models of the environment, optical models of the vision sensors, and models of the task to be achieved. The generic task of feature detectability has been chosen since it is applicable to many robot-controlled vision systems. For such a task, features of interest in the environment are required to simultaneously be visible, inside the field of view, in focus, and magnified as required. In this paper, we present a technique that poses the vision sensor planning problem in an optimization setting and determines viewpoints that satisfy all previous requirements simultaneously and with a margin. In addition, we present experimental results of this technique when applied to a robotic vision system that consists of a camera mounted on a robot manipulator in a hand-eye configuration. >

[1]  Roger Y. Tsai,et al.  Automated sensor planning for robotic vision tasks , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[2]  Franklin Gracer,et al.  TGMS: An object‐oriented system for programming geometry , 1989, Softw. Pract. Exp..

[3]  K. Tarabanis,et al.  Planning viewpoints that simultaneously satisfy several feature detectability constraints for robotic vision , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[4]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[5]  K. Schittkowski.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[6]  Joseph L. Mundy.  Industrial Machine Vision — Is It Practical? , 1988 .

[7]  Tomás Lozano-Pérez,et al.  A Geometric Modeling System for Automated Mechanical Assembly , 1980, IBM J. Res. Dev..

[8]  Kai Tang,et al.  Maximum Intersection of Spherical Polygons and Workpiece Orientation for 4- and 5-Axis Machining , 1992 .

[9]  T. C. Woo,et al.  Computational Geometry on the Sphere With Application to Automated Machining , 1992 .

[10]  Michael Magee,et al.  Task Panel Sensing with a Movable Camera , 1990, Other Conferences.

[11]  Eric Paul Krotkov,et al.  Active Computer Vision by Cooperative Focus and Stereo , 1989, Springer Series in Perception Engineering.

[12]  Alan L. Yuille,et al.  Determining The Optimal Weights In Multiple Objective Function Optimization , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[13]  Aristides A. G. Requicha,et al.  Accessibility analysis for the automatic inspection of mechanical parts by coordinate measuring machines , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[14]  Cregg K. Cowan.  Model-based synthesis of sensor location , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[15]  Klaus Schittkowski,et al.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[16]  Tomomasa Sato,et al.  Automatic planning of light source and camera placement for an active photometric stereo system , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[18]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[19]  Greg Hager,et al.  Interval-Based Techniques for Sensor Data Fusion , 1990 .

[20]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Takeo Kanade,et al.  Modelling sensors: Toward automatic generation of object recognition program , 1989, Comput. Vis. Graph. Image Process..

[23]  Robert M. Haralick,et al.  Automatic sensor and light source positioning for machine vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[24]  Roger Y. Tsai,et al.  Calibration of a computer controlled robotic vision sensor with a zoom lens , 1994 .

[25]  Rudolf Kingslake,et al.  Optical System Design , 1983 .

[26]  Konstantinos A. Tarabanis,et al.  Computing viewpoints that satisfy optical constraints , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Roger Y. Tsai,et al.  Model-Based Planning of Sensor Placement and Optical Settings , 1990, Other Conferences.

[28]  Steven A. Shafer.  Automation and calibration for robot vision systems , 1988 .

[29]  L. Lieberman.  Model-Driven Vision for Industrial Automation , 1979 .

[30]  Konstantinos A. Tarabanis,et al.  Modeling of a computer-controlled zoom lens , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[31]  Konstantinos A. Tarabanis,et al.  Computing occlusion-free viewpoints , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.