Segmentation-Based Depth Propagation in Videos ∗

In this paper we propose a simple yet effective approach to convert existing 2D video content into 3D. We present a new semi-automatic algorithm that propagates sparse user-provided depth information over the whole monocular video sequence. The advantage of our algorithm over previous work comes from the use of spatio-temporal video segmentation techniques. The segmentation preserves depth discontinuities, which is challenging for previous approaches. A subsequent refinement step enables smooth depth changes over time and yields the final depth map. Quantitative evaluations show that the proposed algorithm is able to produce good quality and temporal-coherent 3D videos.

[1]  Xiaodong Liu,et al.  An efficient 2D to 3D video conversion method based on skeleton line tracking , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[2]  Hujun Bao,et al.  Stereoscopic Video Synthesis from a Monocular Video , 2007, IEEE Transactions on Visualization and Computer Graphics.

[3]  Qionghai Dai,et al.  A Novel Method for Semi-automatic 2D to 3D Video Conversion , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[4]  Daniel Cohen-Or,et al.  Semi-automatic stereo extraction from video footage , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Yiannis Aloimonos,et al.  A Roadmap to the Integration of Early Visual Modules , 2007, International Journal of Computer Vision.

[6]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[7]  Michael G. Strintzis,et al.  Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Margrit Gelautz,et al.  Simple but Effective Tree Structures for Dynamic Programming-Based Stereo Matching , 2008, VISAPP.

[10]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[11]  B. Barenbrug,et al.  Improved depth propagation for 2D to 3D video conversion using key-frames , 2007 .