Efficiently Modeling 3D Scenes from a Single Image

A proposed system lets users create a 3D scene easily and quickly from a single image. The scene model consists of background and foreground objects whose coordinates the system calculates on the basis of a boundary between the ground plane and a wall plane. The system quickly extracts foreground objects by combining image segmentation and graph-cut-based optimization. It enables efficient modeling of foreground objects, easy creation of their textures, and rapid construction of scene models that are simple but produce sufficient 3D effects.

[1]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[2]  Ken-ichi Anjyo,et al.  Tour Into the Picture using a Vanishing Line and its Extension to Panoramic Images , 2001, Comput. Graph. Forum.

[3]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[4]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[5]  Jiawen Chen,et al.  The video mesh: A data structure for image-based three-dimensional video editing , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[6]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[7]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[8]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[11]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[12]  Harry Shum,et al.  Sketching reality: Realistic interpretation of architectural designs , 2008, TOGS.

[13]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.