Semi-automatic Depth Map Extraction Method for Stereo Video Conversion

This paper present a semi-automatic method aimed to generate stereoscopic views estimating depth information from a single input video frame and decrease computation resources. Firstly, background modeling divides a 2D video into static background scene and moving object. By the viewer's acquired monocular depth cue, the user-defined points in the static scene are used to extract vanishing line. Then, the background depth map is determined and the moving objects are assigned depth values according to their position in the static scene. Finally, the motion based depth map and the geometry based map are integrated into one depth map by a depth fusion algorithm. Combining the depth map from this work and original 2D video can produce vivid 3D video.

[1]  V. Cantoni,et al.  Vanishing point detection: representation analysis and new approaches , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[2]  Ju Liu,et al.  Depth map extraction based on geometry , 2012, 2012 Proceedings of IEEE Southeastcon.

[3]  Dongxiao Li,et al.  A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion , 2009, 2009 Third International Symposium on Intelligent Information Technology Application.

[4]  Tsung-Han Tsai,et al.  Foreground Object Detection Based on Multi-model Background Maintenance , 2008 .

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Daniel Cohen-Or,et al.  Semi-automatic stereo extraction from video footage , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[8]  Yong Ju Jung,et al.  A novel 2D-to-3D conversion technique based on relative height-depth cue , 2009, Electronic Imaging.

[9]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Kyuseo Han,et al.  Geometric and texture cue based depth-map estimation for 2D to 3D image conversion , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[11]  Sebastiano Battiato,et al.  3D stereoscopic image pairs by depth-map generation , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..