Adaptive 3-D scene construction from single image using extended object placement relation

Object placement relation (OPR) is the information set representing relationship between set of image components. It can be applied for constructing various types of image scenes quickly and efficiently ranging from scenes with multi-level of the ground, natural scene, building scene to outdoor scene. OPR can also be used to predict depth of the scene without reference ground whereas other methods cannot. However, the result of using previous OPR shows some error when applying to indoor scenes with ceiling height because OPR lacks such relationship. Moreover, there still exists some distortion and unsmoothness between image components due to the local mesh computation of each image component. In this research the OPR is extended by adding more constraints to each relation, while the triangulation algorithm is adapted to preserve the global smoothness of the output 3-D scene. Our experimental result shows that, with the similar time complexity, the adaptive OPR can improve the quality of 3-D scenes with smoother surface than when using the previous OPR.

[1]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[3]  Ashutosh Saxena,et al.  Make3D: Learning 3D Scene Structure from a Single Still Image , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[5]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[7]  Ashutosh Saxena,et al.  3-D Depth Reconstruction from a Single Still Image , 2007, International Journal of Computer Vision.

[8]  Ashutosh Saxena,et al.  Learning Depth from Single Monocular Images , 2005, NIPS.

[9]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[10]  Olivier D. Faugeras,et al.  Shape from shading: a well-posed problem? , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Pizzanu Kanongchaiyos,et al.  Enhanced depth estimation by using object placement relation , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[12]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[13]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.