Low-complexity 2D to 3D video conversion

3D film and 3D TV are becoming reality. More facilities and devices are now 3D capable. Compared to capture 3D video content directly, 2D to 3D video conversion is a low-cost, backward compatible alternate. There also exists a tremendous amount of monoscopic 2D video content that are of high interest to be displayed on 3D devices with noticeable immersiveness. 2D to 3D video conversion, therefore, has drawn lots of attention recently. In this paper, a low complexity 2D to 3D conversion algorithm is presented. The conversion generates stereo video pairs by 3D warping based on estimated per-pixel depth maps. The depth maps are estimated jointly by motion and color cues. Subjective tests show that the proposed algorithm achieves 3D perception with acceptable artifact.

[1]  Ramon M. Rodriguez-Dagnino,et al.  Synthesizing stereo 3D views from focus cues in monoscopic 2D images , 2003, IS&T/SPIE Electronic Imaging.

[2]  Wa James Tam,et al.  Nonuniform smoothing of depth maps before image-based rendering , 2004, SPIE Optics East.

[3]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[4]  J. Ferreira,et al.  Stereoscopic image rendering based on depth maps created from blur and edge information , 2005, IS&T/SPIE Electronic Imaging.

[5]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[6]  Qionghai Dai,et al.  2D-to-3D Conversion Based on Motion and Color Mergence , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[7]  Levent Onural,et al.  Three-Dimensional Television: Capture, Transmission, Display , 2007 .

[8]  Liang Zhang,et al.  Comparison study on feature matching and block matching for automatic 2D to 3D Video Conversion , 2006 .

[9]  C. Fehn.  A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .

[10]  William R. Mark,et al.  Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping , 1999 .

[11]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Mark Ollis,et al.  The Future of 3D Video , 2001, Computer.

[13]  Steven A. Shafer,et al.  Depth from focusing and defocusing , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Ian P. Howard,et al.  Binocular Vision and Stereopsis , 1996 .