Next view planning for a combination of passive and active acquisition techniques

In order to create a complete three-dimensional model of an object based on its two-dimensional images, the images have to be acquired from different views. An increasing number of views generally improves the accuracy of the final 3D model but it also increases the time needed to build the model. The number of the possible views can theoretically be infinite. Therefore, it makes sense to try to reduce the number of views to a minimum while preserving a certain accuracy of the model, especially in applications for which the performance is an important issue. We show an approach to next view planning for a fusion of shape from Silhouette, as an example of a passive 3D reconstruction technique, and shape from structured light, as an example of an active 3D reconstruction technique in order to get 3D shape reconstruction with minimal different views. Results of the algorithm developed are presented for both synthetic and real input images.

[1]  S. Suess,et al.  Three dimensional modelling , 1974 .

[2]  Martin Kampel,et al.  Combining shape from silhouette and shape from structured light for volume estimation of archaeological vessels , 2002, Object recognition supported by user interaction for service robots.

[3]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[4]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[5]  Paul J. Besl,et al.  Active, optical range imaging sensors , 1988, Machine Vision and Applications.

[6]  C. Ian Connolly,et al.  The determination of next best views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[7]  Olivier D. Faugeras,et al.  3D articulated models and multi-view tracking with silhouettes , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Peter K. Allen,et al.  Constraint-based sensor planning for scene modeling , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[9]  Thomas S. Huang,et al.  A survey of construction and manipulation of octrees , 1988, Comput. Vis. Graph. Image Process..

[10]  Jake K. Aggarwal,et al.  Volume/surface octrees for the representation of three-dimensional objects , 1986, Comput. Vis. Graph. Image Process..

[11]  Mohan M. Trivedi,et al.  3-D Computer Vision Using Structured Light: Design, Calibration, and Implementation Issues , 1996, Adv. Comput..

[12]  Frank P. Ferrie,et al.  Autonomous exploration: driven by uncertainty , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Peter K. Allen,et al.  Constraint-Based Sensor Planning for Scene Modeling , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Robert Sablatnig,et al.  3D modeling of archaeological vessels using shape from silhouette , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[15]  Roberto Cipolla,et al.  Structure and motion from silhouettes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Wolfgang Niem,et al.  Robust and fast modeling of 3D natural objects from multiple views , 1994, Electronic Imaging.

[17]  Jake K. Aggarwal,et al.  Volumetric Descriptions of Objects from Multiple Views , 1983, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Konstantinos A. Tarabanis,et al.  A survey of sensor planning in computer vision , 1995, IEEE Trans. Robotics Autom..

[19]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[20]  Michael Potmesil.  Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[21]  Ruzena Bajcsy,et al.  Occlusions as a Guide for Planning the Next View , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..