Efficient Generation of 3-D Models Out of Depth Maps

Depth reconstruction or acquisition with a 3-D camera results in a video sequence where each pixel of a frame is annotated with a depth value. We propose an approach to combine this depth information into a 3-D model of the assumedly static scene. For processing of video, we have to satisfy strong requirements on computational and storage efficiency, incremental processing and handling of uncertainty in the depth maps. Our approach is based on an octree structure. Cells are split until the topology of the scene can be recovered uniquely. A signeddistance function to the nearest surface is computed in the octree vertices. The scene can then be reconstructed by extraction and triangulation of an implicit surface. The depth uncertainty results in boundary conditions for the implicit surface.

[1]  Baba C. Vemuri,et al.  3-D MODEL CONSTRUCTION FROM MULTIPLE VIEWS USING RANGE AND INTENSITY DATA. , 1986 .

[2]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[3]  Ying-Lin Ke,et al.  Surface reconstruction from unorganized points based on 2D Delaunay neighbors , 2002, Other Conferences.

[4]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jules Bloomenthal,et al.  Polygonization of implicit surfaces , 1988, Comput. Aided Geom. Des..

[6]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[7]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[8]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[9]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[10]  Ruzena Bajcsy,et al.  Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Adrian Hilton,et al.  Implicit Surface-Based Geometric Fusion , 1998, Comput. Vis. Image Underst..

[12]  C.W.A.M. van Overveld,et al.  Depth from motion using confidence based block matching , 1998 .

[13]  Tosiyasu L. Kunii,et al.  A Graphics Compiler for a 3-Dimensional Captured Image Database and Captured Image Reusability , 1998, CAPTECH.

[14]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[15]  Ronald N. Perry,et al.  Adaptively sampled distance fields: a general representation of shape for computer graphics , 2000, SIGGRAPH.

[16]  Aldo Laurentini,et al.  How Far 3D Shapes Can Be Understood from 2D Silhouettes , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[18]  Shigeru Muraki,et al.  Volumetric shape description of range data using “Blobby Model” , 1991, SIGGRAPH.

[19]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).