Superpixel Based Depth Propagation for Semi-Automatic 2D-to-3D Video Conversion

In this paper, we proposed a super pixel based depth map propagation algorithm for the application in 2D to 3D video conversion. The proposed algorithm employs four main processes to generate depth maps for all frames in video sequences. First, the depth map of the key frames in the input sequences are generated by manual work. Second, the frames in the input sequences are over-segmented by Simple Linear Iterative Clustering (SLIC) method. Third, each super pixel in the non-key frame is used to match the corresponding super pixel in the key frame. Finally, the depth value in every super pixel is assigned by the matching result. The experiments showed that the proposed algorithm works well and give good depth generation quality and high efficiency.

[1]  Ping Wang,et al.  Stereoscopic video conversion based on depth tracking , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[2]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[3]  Dimitrios Androutsos,et al.  Semi-automatic 2D to 3D image conversion using a hybrid Random Walks and graph cuts based approach , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Carlos Vázquez,et al.  3D-TV Content Creation: Automatic 2D-to-3D Video Conversion , 2011, IEEE Transactions on Broadcasting.

[5]  Dimitrios Androutsos,et al.  Semi-automatic synthetic depth map generation for video using random walks , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[6]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[7]  Qionghai Dai,et al.  Semi-Automatic 2D-to-3D Conversion Using Disparity Propagation , 2011, IEEE Transactions on Broadcasting.

[8]  Liang Zhang,et al.  3D-TV Content Generation: 2D-to-3D Conversion , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Qionghai Dai,et al.  Depth map generation for 2D-to-3D conversion by limited user inputs and depth propagation , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[10]  B. Barenbrug,et al.  Improved depth propagation for 2D to 3D video conversion using key-frames , 2007 .

[11]  Wen-Nung Lie,et al.  2D to 3D video conversion with key-frame depth propagation and trilateral filtering , 2011 .

[12]  Neil Genzlinger.  A. and Q , 2006 .