State-Based Visibility for 3D Reconstruction from Multiple Views

Estimating visibility is one of the most important steps for multi-view reconstruction using volumetric scene representation. In this paper, we propose a simple approach to estimating visibility based on the current state of a scene which is implicitly represented as the zero level set of a function. Our method can determine the regions of a 3D space visible to several given viewpoints efficiently. Using this visibility method, we also present a new variational formulation for multi-view reconstruction. We cast the multi-view reconstruction problem as an op- timization of a novel energy functional amenable for minimization with an Euler-Lagrange driven evolution. The proposed algorithm has been applied to both synthetic and real datasets with promising results.

[1]  Stanley Osher,et al.  Dynamic Visibility in an Implicit Framework , 2007 .

[2]  O. Faugeras,et al.  Variational principles, surface evolution, PDE's, level set methods and the stereo problem , 1998, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[3]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Roberto Cipolla,et al.  Multi-view stereo via volumetric graph-cuts , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Steven M. Seitz,et al.  Multi-View Multi-Exposure Stereo , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[6]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[7]  Carlos Hernández Esteban,et al.  Modélisation d'objets 3D par fusion silhouettes-stéréo à partir de séquences d'images en rotation non calibrées. (Stereo and silhouette fusion for 3D object modeling from uncalibrated images under circular motion) , 2004 .

[8]  Victor S. Lempitsky,et al.  Oriented Visibility for Multiview Reconstruction , 2006, ECCV.

[9]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Marc Pollefeys,et al.  Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[12]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[13]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.