Shape from Silhouette Under Varying Lighting and Multi-viewpoints

We present a new segmentation method for visual hull (VH) reconstruction from an image sequence. The camera moves on a hemisphere around an object set on a turntable with complex and unknown background. Even though the background is assumed to be constant, it cannot be modeled from all possible viewpoints. A series of images of a moving object under different lighting conditions are captured and analyzed. In this analysis, information from space, time and light domains are fused into an MRF framework. The method is validated by VH reconstruction of challenging objects with different optical properties.

[1]  Paul A. Beardsley,et al.  Image-based 3D photography using opacity hulls , 2002, ACM Trans. Graph..

[2]  James F. Blinn,et al.  Blue screen matting , 1996, SIGGRAPH.

[3]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[4]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Woontack Woo,et al.  Identifying Foreground from Multiple Images , 2007, ACCV.

[7]  Harry Shum,et al.  Flash Cut: Foreground Extraction with Flash and No-flash Image Pairs , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[10]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[11]  Roberto Cipolla,et al.  Automatic 3D object segmentation in multiple views using volumetric graph-cuts , 2007, Image Vis. Comput..

[12]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[14]  Dana Cobzas,et al.  A Three-tier Hierarchical Model for Capturing and Rendering of 3D Geometry and Appearance from 2D Images , 2008 .