3D Reconstruction from a Single Still Image Based on Monocular Vision of an Uncalibrated Camera

we propose a framework of combining Machine Learning with Dynamic Optimization for reconstructing scene in 3D automatically from a single still image of unstructured outdoor environment based on monocular vision of an uncalibrated camera. After segmenting image first time, a kind of searching tree strategy based on Bayes rule is used to identify the hierarchy of all areas on occlusion. After superpixel segmenting image second time, the AdaBoost algorithm is applied in the integration detection to the depth of lighting, texture and material. Finally, all the factors above are optimized with constrained conditions, acquiring the whole depthmap of an image. Integrate the source image with its depthmap in point-cloud or bilinear interpolation styles, realizing 3D reconstruction. Experiment in comparisons with typical methods in associated database demonstrates our method improves the reasonability of estimation to the overall 3D architecture of image’s scene to a certain extent. And it does not need any manual assist and any camera model information.

[1]  Kenneth I. Laws,et al.  Rapid Texture Identification , 1980, Optics & Photonics.

[2]  Alex Pentland,et al.  3D structure from 2D motion , 1999, IEEE Signal Process. Mag..

[3]  Ashutosh Saxena,et al.  Learning Depth from Single Monocular Images , 2005, NIPS.

[4]  Subhasis Chaudhuri,et al.  Recovery of relative depth from a single observation using an uncalibrated (real-aperture) camera , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[6]  Zhanyi Hu,et al.  Single view metrology from scene constraints , 2005, Image Vis. Comput..

[7]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[8]  Yoram Singer,et al.  Logistic Regression, AdaBoost and Bregman Distances , 2000, Machine Learning.

[9]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[10]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Alexei A. Efros,et al.  Recovering Occlusion Boundaries from a Single Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Terence Sim,et al.  On the Recovery of Depth from a Single Defocused Image , 2009, CAIP.

[13]  Honglak Lee,et al.  A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Ashutosh Saxena,et al.  Make3D: Learning 3D Scene Structure from a Single Still Image , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  R. Victor Klassen,et al.  Modeling the effect of the atmosphere on light , 1987, TOGS.

[16]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[17]  Honglak Lee,et al.  Automatic Single-Image 3d Reconstructions of Indoor Manhattan World Scenes , 2007, ISRR.

[18]  Eric Maisel,et al.  Using vanishing points for camera calibration and coarse 3D reconstruction from a single image , 2000, The Visual Computer.

[19]  Zhanyi Hu,et al.  Camera calibration and 3D reconstruction from a single view based on scene constraints , 2005, Image Vis. Comput..

[20]  Shree K. Nayar,et al.  Shedding light on the weather , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  J. Poon,et al.  Single-Image High-Resolution Satellite Data for 3D Information Extraction , 2005 .

[22]  Edmond Boyer,et al.  Camera calibration and 3D reconstruction from single images using parallelepipeds , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[24]  Alexei A. Efros,et al.  Closing the loop in scene interpretation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[26]  Youngbae Hwang,et al.  Accurate Motion Estimation and High-Precision 3D Reconstruction by Sensor Fusion , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[27]  Lai-Man Po,et al.  Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[28]  KeeChang Lee,et al.  Fast Automatic Single-View 3-d Reconstruction of Urban Scenes , 2008, ECCV.

[29]  Feng Han,et al.  Bayesian reconstruction of 3D shapes and scenes from a single image , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[30]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[31]  Qionghai Dai,et al.  Semi-Automatic 2D-to-3D Conversion Using Disparity Propagation , 2011, IEEE Transactions on Broadcasting.

[32]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[33]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[34]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Frank A. van den Heuvel,et al.  3D reconstruction from a single image using geometric constraints , 1998 .