Depth estimation and occlusion boundary recovery from a single outdoor image

A novel depth estimation and occlusion boundary recovery approach for a single outdoor image is described. This work is distinguished by three contributions. The first contribution is the introduction of a new depth estimation model, which takes the camera rotation and pitch into account, thus improving the depth estimation accuracy. The second contribution is a depth estimation algorithm, in which we classify the standing object region with visible ground-contact points into three cases according to the information of vanishing point for the first time, meanwhile, we propose the depth reference line concept for estimating the depth of the region with depth change. Two advantages can thereby be obtained: improving the depth estimation accuracy further and avoiding the occlusion mismarked phenomenon. The third contribution is the depth estimation method for the standing object region without visible ground-contact points, which takes the mean of minimum and maximum depth estimation result as region depth and prevents the missing phenomenon of occlusion boundaries. Extensive experiments show that our works are better than previously published results.

[1]  Derek Bradley,et al.  Accurate multi-view reconstruction using robust binocular stereo and surface meshing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Stephen Gould,et al.  Single image depth estimation from predicted semantic labels , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Alexei A. Efros,et al.  Recovering Occlusion Boundaries from an Image , 2011, International Journal of Computer Vision.

[5]  Honglak Lee,et al.  A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Ashutosh Saxena,et al.  Depth Estimation Using Monocular and Stereo Cues , 2007, IJCAI.

[7]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[8]  Mark R. Stevens,et al.  Methods for Volumetric Reconstruction of Visual Scenes , 2004, International Journal of Computer Vision.

[9]  Ashutosh Saxena,et al.  Make3D: Learning 3D Scene Structure from a Single Still Image , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[11]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[12]  Ashutosh Saxena,et al.  3-D Depth Reconstruction from a Single Still Image , 2007, International Journal of Computer Vision.

[13]  Zengfu Wang,et al.  A Close-Form Iterative Algorithm for Depth Inferring from a Single Image , 2010, ECCV.