A novel approach for computing exact visual hull from silhouettes

Abstract Modeling from silhouettes is one of the main technologies for 3D reconstruction in computer vision. The existing methods are generally divided into two classes: volume-based approaches and surface-based approaches. The former are robust for complex objects but inaccurate, while the latter are accurate but time consuming and usually suffer from numerical instabilities. This paper proposes a novel method to compute exact visual hull by taking advantage of surface-based approaches while retaining the simplicity and robustness of volume-based approaches. To this aim, a line-based model is built for each cube on the edge of octree volume structure of object. Convex surface points of visual hull in line-based model are searched by the idea of surface-based approaches. Experiments with real data are conducted to test the efficiency and exactness of our method.

[1]  Jean Ponce,et al.  On computing exact visual hulls of solids bounded by smooth surfaces , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Thomas Malzbender,et al.  A Survey of Methods for Volumetric Scene Reconstruction from Photographs , 2001, VG.

[3]  Chen Liang,et al.  Exact Visual Hull From Marching Cubes , 2008, VISAPP.

[4]  Xin Liu,et al.  Shape from silhouettes based on a centripetal pentahedron model , 2008, Graph. Model..

[5]  Jean Ponce,et al.  Projective Visual Hulls , 2007, International Journal of Computer Vision.

[6]  Kunwoo Lee,et al.  Proceedings of the sixth ACM symposium on Solid modeling and applications , 2001 .

[7]  Wojciech Matusik,et al.  Polyhedral Visual Hulls for Real-Time Rendering , 2001, Rendering Techniques.

[8]  Zen Chen,et al.  3D shape recovery of complex objects from multiple silhouette images , 2003, Pattern Recognit. Lett..

[9]  Hans-Peter Seidel,et al.  A Silhouette-Based Algorithm for Texture Registration and Stitching , 2001, Graph. Model..

[10]  Edmond Boyer,et al.  Efficient Polyhedral Modeling from Silhouettes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[12]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[13]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[14]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Michael Goesele,et al.  Multi-View Stereo Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[17]  Jean Ponce,et al.  Carved Visual Hulls for Image-Based Modeling , 2006, International Journal of Computer Vision.

[18]  Yeung Sam Hung,et al.  Shape recovery from turntable sequence using rim reconstruction , 2008, Pattern Recognit..

[19]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[20]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[21]  Jake K. Aggarwal,et al.  Volume/surface octrees for the representation of three-dimensional objects , 1986, Comput. Vis. Graph. Image Process..

[22]  Edmond Boyer,et al.  A hybrid approach for computing visual hulls of complex objects , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[23]  Chen Liang,et al.  3D reconstruction using silhouettes from unordered viewpoints , 2010, Image Vis. Comput..

[24]  Takeo Kanade,et al.  Visual hull alignment and refinement across time: a 3D reconstruction algorithm combining shape-from-silhouette with stereo , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[25]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Daniel Cremers,et al.  Continuous Global Optimization in Multiview 3D Reconstruction , 2007, International Journal of Computer Vision.

[27]  Marc Pollefeys,et al.  Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[29]  Xin Liu,et al.  Incorporating object-centered sampling and Delaunay tetrahedrization for visual hull reconstruction , 2009, The Visual Computer.