A novel 2Dd-to-3D conversion system using edge information

Although three-dimensional (3D) displays enhance visual quality more than two-dimensional (2D) displays do, the depth information required for 3D displays is unavailable in the conventional 2D content. Therefore, converting 2D videos into 3D ones has become an important issue in emerging 3D applications. This work presents a novel algorithm that automatically converts 2D videos into 3D ones. The proposed algorithm utilizes the edge information to segment the image into object groups. A depth map is then assigned based on a hypothesized depth gradient model. Next, the depth map is block-based assigned by cooperating with a cross bilateral filter to generate visually comfortable depth maps efficiently and also diminish the block artifacts. A multiview video can be readily generated by using a depth image-based rendering method.

[1]  Sebastiano Battiato,et al.  Depth map generation by image classification , 2004, IS&T/SPIE Electronic Imaging.

[2]  Philip Victor Harman,et al.  Rapid 2D-to-3D conversion , 2002, IS&T/SPIE Electronic Imaging.

[3]  Kazuhide Sugimoto,et al.  Conversion system of monocular image sequence to stereo using motion parallax , 1997, Electronic Imaging.

[4]  Haruhiko Murata,et al.  54.2:Natural Stereo Depth Creation Methodology for a Real-Time 2D-to-3D Image Conversion 4:00(2.発表概要)(Report on SID'00) , 2000 .

[5]  George Economou,et al.  Geodesic distance and MST based image segmentation , 2004, 2004 12th European Signal Processing Conference.

[6]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[7]  Liang-Gee Chen,et al.  A block-based 2D-to-3D conversion system with bilateral filter , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[8]  Liang-Gee Chen,et al.  Depth Map Generation for 2D-to-3D Conversion by Short-Term Motion Assisted Color Segmentation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[9]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[10]  Yong Ju Jung,et al.  A novel 2D-to-3D conversion technique based on relative height-depth cue , 2009, Electronic Imaging.

[11]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[12]  Changick Kim,et al.  Extracting focused object from low depth-of-field image sequences , 2006, Electronic Imaging.

[13]  Kwanghoon Sohn,et al.  A Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis , 2008, IEEE Transactions on Broadcasting.

[14]  Liang-Gee Chen,et al.  Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[15]  Liang-Gee Chen,et al.  Relative Depth Layer Extraction for Monoscopic Video by Use of Multidimensional Filter , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[16]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[17]  P. Harman,et al.  Rapid 2 D to 3 D Conversion , 2002 .

[18]  Liang-Gee Chen,et al.  Block-based Vanishing Line and Vanishing Point Detection for 3D Scene Reconstruction , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[19]  Yo-Sung Ho,et al.  Three-dimensional natural video system based on layered representation of depth maps , 2006, IEEE Transactions on Consumer Electronics.

[20]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[21]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[22]  Liang-Gee Chen,et al.  A 2D-to-3D conversion system using edge information , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[23]  Myung-Ryul Choi,et al.  A real-time field-sequential stereoscopic image converter , 2004, IEEE Trans. Consumer Electron..

[24]  Haruhiko Murata,et al.  32.2: A Real-Time 2-D to 3-D Image Conversion Technique Using Computed Image Depth , 1998 .

[25]  Liang Zhang,et al.  3D-TV Content Generation: 2D-to-3D Conversion , 2006, 2006 IEEE International Conference on Multimedia and Expo.