A survey of sensor planning in computer vision

A survey of research in the area of vision sensor planning is presented. The problem can be summarized as follows: given information about the environment as well as information about the task that the vision system is to accomplish, develop strategies to automatically determine sensor parameter values that achieve this task with a certain degree of satisfaction. With such strategies, sensor parameters values can be selected and can be purposefully changed in order to effectively perform the task at hand. The focus here is on vision sensor planning for the task of robustly detecting object features. For this task, camera and illumination parameters such as position, orientation, and optical settings are determined so that object features are, for example, visible, in focus, within the sensor field of view, magnified as required, and imaged with sufficient contrast. References to, and a brief description of, representative sensing strategies for the tasks of object recognition and scene reconstruction are also presented. For these tasks, sensor configurations are sought that will prove most useful when trying to identify an object or reconstruct a scene. >

[1]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[2]  Jeanine Meyer,et al.  An emulation system for programmable sensory robots , 1981 .

[3]  Aviv Bergman,et al.  Determining the camera and light source location for a visual task , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[4]  Aristides A. G. Requicha,et al.  Accessibility analysis for the automatic inspection of mechanical parts by coordinate measuring machines , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[5]  Steven K. Feiner,et al.  Automated generation of intent-based 3D Illustrations , 1991, SIGGRAPH.

[6]  Cregg K. Cowan Model-based synthesis of sensor location , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[7]  Roger Y. Tsai,et al.  Model-Based Planning of Sensor Placement and Optical Settings , 1990, Other Conferences.

[8]  Thomas C. Henderson,et al.  CAGD-Based Computer Vision , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Steven A. Shafer Automation and calibration for robot vision systems , 1988 .

[10]  M. Huck,et al.  Sensor simulation in robot applications , 1987 .

[11]  Tomomasa Sato,et al.  Automatic planning of light source and camera placement for an active photometric stereo system , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[12]  Kevin W. Bowyer,et al.  Creating The Perspective Projection Aspect Graph Of Polyhedral Objects , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[13]  Chris Goad,et al.  Special purpose automatic programming for 3D model-based vision , 1987 .

[14]  Jörg Raczkowsky,et al.  Simulation of cameras in robot applications , 1989, IEEE Computer Graphics and Applications.

[15]  Michael Werman,et al.  Active vision: 3D from an image sequence , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[16]  James J. Clark,et al.  Modal Control Of An Attentive Vision System , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[17]  Kai Tang,et al.  Maximum Intersection of Spherical Polygons and Workpiece Orientation for 4- and 5-Axis Machining , 1992 .

[18]  Gregory D. Hager,et al.  Task-Directed Sensor Fusion and Planning , 1990 .

[19]  T. C. Woo,et al.  Computational Geometry on the Sphere With Application to Automated Machining , 1992 .

[20]  Michael Magee,et al.  Task Panel Sensing with a Movable Camera , 1990, Other Conferences.

[21]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[22]  Tomomasa Sato,et al.  Planning Focus of Attentions for Visual Feedback Control , 1988 .

[23]  D. Eggert,et al.  Computing the orthographic projection aspect graph of solids of revolution , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[24]  L. Lieberman Model-Driven Vision for Industrial Automation , 1979 .

[25]  H. Tamura,et al.  An expert system for industrial machine vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[26]  Robert C. Bolles,et al.  Locating Partially Visible Objects: The Local Feature Focus Method , 1980, AAAI.

[27]  Konstantinos A. Tarabanis,et al.  Dynamic sensor planning , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[28]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  David P. Anderson An orientation method for central projection programs , 1982, Comput. Graph..

[30]  Bruce G. Batchelor A Prolog Lighting Advisor , 1990, Other Conferences.

[31]  Roger Y. Tsai,et al.  Automated sensor planning for robotic vision tasks , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[32]  Amir Novini Lighting And Optics Expert System For Machine Vision , 1988, Optics & Photonics.

[33]  Narendra Ahuja,et al.  Generating Octrees from Object Silhouettes in Orthographic Views , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  John R. Kender,et al.  What is a 'Degenerate' View? , 1987, IJCAI.

[35]  K. Tarabanis,et al.  Planning viewpoints that simultaneously satisfy several feature detectability constraints for robotic vision , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[36]  D. Kriegman,et al.  Computing exact aspect graphs of curved objects: Solids of revolution , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[37]  Frank P. Ferrie,et al.  From uncertainty to visual exploration , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[38]  R. Jain,et al.  Generating aspect graphs for curved objects , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[39]  Ruzena Bajcsy,et al.  How to Decide From the First View Where to Look Next , 1990 .

[40]  Robert M. Haralick,et al.  PREMIO: an overview (object recognition) , 1991, [1991 Proceedings] Workshop on Directions in Automated CAD-Based Vision.

[41]  Roger Y. Tsai,et al.  Calibration of a computer controlled robotic vision sensor with a zoom lens , 1994 .

[42]  Robert M. Haralick,et al.  Automatic sensor and light source positioning for machine vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[43]  C. Ian Connolly,et al.  The determination of next best views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[44]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[45]  Michael Shneier,et al.  Describing a Robot's Workspace Using a Sequence of Views from a Moving Camera , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Takeo Kanade,et al.  Modelling sensors: Toward automatic generation of object recognition program , 1989, Comput. Vis. Graph. Image Process..

[47]  Bruce G. Batchelor Integrating Vision and AI for Industrial Applications , 1990, Other Conferences.

[48]  W. Eric L. Grimson,et al.  Sensing strategies for disambiguating among multiple objects in known poses , 1986, IEEE J. Robotics Autom..

[49]  Takeo Kanade,et al.  Towards automatic generation of object recognition programs , 1988 .

[50]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[51]  Konstantinos A. Tarabanis,et al.  Computing occlusion-free viewpoints , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Andrea Califano,et al.  Data and model driven foveation , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[53]  Yoshiaki Shirai,et al.  Illumination setup planning for a hand-eye system based on an environmental model , 1991, Adv. Robotics.

[54]  Avinash C. Kak,et al.  Planning sensing strategies in a robot work cell with multi-sensor capabilities , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[55]  Richard A. Volz,et al.  Object recognition using multiple views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[56]  Christian Laugier,et al.  Combining vision based information and partial geometric models in automatic grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[57]  Konstantinos A. Tarabanis,et al.  Computing viewpoints that satisfy optical constraints , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[58]  Katsushi Ikeuchi,et al.  Modeling sensor detectability with the VANTAGE geometric/sensor modeler , 1989, IEEE Trans. Robotics Autom..

[59]  Joseph L. Mundy Industrial Machine Vision — Is It Practical? , 1988 .

[60]  Bharath R. Modayur,et al.  Edge-based placement of camera and light source for object recognition and location , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[61]  R. Bajcsy Active perception , 1988 .

[62]  Roddy Cowie The Viewer's Place in Theories of Vision , 1983, IJCAI.

[63]  A. Lynn Abbott,et al.  Active surface reconstruction by integrating focus, vergence, stereo, and camera calibration , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[64]  Yoshiaki Shirai,et al.  Object recognition using multiple view invariance based on complex features , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[65]  David P. Anderson Efficient algorithms for automatic viewer orientation , 1985, Comput. Graph..

[66]  Masayoshi Kakikura,et al.  Occlusion avoidance of visual sensors based on a hand-eye action simulator system: HEAVEN , 1987, Adv. Robotics.