The view-cube: an efficient method of view planning for 3D modelling from range data

When aiming at the automated reconstruction of real world scenes from range images, one has to address the problem of planning the image acquisition. Although solutions for small objects in well defined environments are already available, the insufficient scalability of these approaches to large scenes and to a high number of degrees of freedom limits their applicability. In this paper we present a new planning algorithm with emphasis on practical usability in initially unknown, large indoor environments. Using a surface representation of seen and unseen parts of the environment, we propose an objective function based on the analysis of occlusions. In addition to previous approaches, we take into account both a quality criterion and the cost of the next acquisition. By optimising this objective function, the parameters of the next view are computed efficiently for a large search space with eight degrees of freedom (3D position, viewing direction, field of view, and resolution). Our technique exploits hardware-accelerated rendering (OpenGL) in order to perform the expensive visibility computation, which reduces the computation time of one planning step to a couple of minutes. Results are shown for two large indoor scenes-an artificial scene and a real world room-with numerous self occlusions.

[1]  Kia Ng,et al.  Automated reconstruction of 3D models from real environments , 1999 .

[2]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[3]  K. Klein,et al.  Adaptive Triangulation Of Objects Reconstructed From Multiple Range Images , 2001 .

[4]  Richard Pito,et al.  A sensor-based solution to the "next best view" problem , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  A. David Marshall,et al.  Viewpoint Selection for Complete Surface Coverage of Three Dimensional Objects , 1998, BMVC.

[6]  Ruzena Bajcsy,et al.  Occlusions as a Guide for Planning the Next View , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[8]  Frank P. Ferrie,et al.  From Uncertainty to Visual Exploration , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  C. Ian Connolly,et al.  The determination of next best views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[10]  Francis Schmitt,et al.  Mesh Simplification , 1996, Comput. Graph. Forum.

[11]  Donald P. Greenberg,et al.  The hemi-cube: a radiosity solution for complex environments , 1985, SIGGRAPH.

[12]  Ioannis Stamos,et al.  3-D modeling from range imagery: an incremental method with a planning component , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[13]  M. Isabel Ribeiro,et al.  Active view selection for efficient 3D scene reconstruction , 1996, Proceedings of 13th International Conference on Pattern Recognition.