Exact Visual Hull From Marching Cubes

The marching cubes algorithm has been widely adopted for extracting a surface mesh from a volumetric description of the visual hull reconstructed from silhouettes. However, typical volumetric descriptions, such as an octree, provide only a binary description about the visual hull. The lack of interpolation information along each voxel edge, which is required by the marching cubes algorithm, usually results in inaccurate and bumpy surface mesh. In this paper, we propose a novel method to efficiently estimate the exact intersections between voxel edges and the visual hull boundary, which replace the missing interpolation information. The method improves both the visual quality and accuracy of the estimated visual hull mesh, while retaining the simplicity and robustness of the volumetric approach. To verify this claim, we present both synthetic and real-world experiments, as well as comparisons with existing volumetric approaches and other approaches targeting at an exact visual hull reconstruction.

[1]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jake K. Aggarwal,et al.  Volume/surface octrees for the representation of three-dimensional objects , 1986, Comput. Vis. Graph. Image Process..

[3]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[4]  Edmond Boyer,et al.  A hybrid approach for computing visual hulls of complex objects , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Concettina Guerra,et al.  Model-based and image-based 3D scene representation for interactive visualization , 2004, Comput. Vis. Image Underst..

[6]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[7]  Edmond Boyer,et al.  Exact polyhedral visual hulls , 2003, BMVC.

[8]  Michael Potmesil Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[9]  Bruce G. Baumgart A polyhedron representation for computer vision , 1975, AFIPS '75.

[10]  Bruno Mercier,et al.  Shape from Silhouette: Image Pixels for Marching Cubes , 2005, J. WSCG.

[11]  Mircea Nicolescu,et al.  Visual Hull Construction Using Adaptive Sampling , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[12]  Andrew Zisserman,et al.  Surface Reconstruction from Multiple Views Using Apparent Contours and Surface Texture , 2000, Confluence of Computer Vision and Computer Graphics.

[13]  Francis Schmitt,et al.  Silhouette and stereo fusion for 3D object modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[14]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[15]  Roberto Cipolla,et al.  Structure and motion from silhouettes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Andrew Blake,et al.  The dynamic analysis of apparent contours , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[17]  Jean Ponce,et al.  Projective Visual Hulls , 2007, International Journal of Computer Vision.

[18]  Roberto Scopigno,et al.  Discretized Marching Cubes , 1994, Proceedings Visualization '94.

[19]  Wojciech Matusik,et al.  Polyhedral Visual Hulls for Real-Time Rendering , 2001, Rendering Techniques.

[20]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[21]  Hans-Peter Seidel,et al.  A Silhouette-Based Algorithm for Texture Registration and Stitching , 2001, Graph. Model..