A Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis

Stereoscopic video generation methods can produce stereoscopic content from conventional video filmed with monoscopic cameras. In this paper, we propose a stereoscopic video generation method using motion analysis which converts motion into disparity values and considers multi-user conditions and the characteristics of the display device. The field of view and the maximum and minimum disparity values were calculated in the stereoscopic display characterization stage and were then applied to various types of 3D displays. After motion estimation, we used three cues to decide the scale factor of motion-to-disparity conversion. These cues were the magnitude of motion, camera movements and scene complexity. A subjective evaluation showed that the proposed method generated more satisfactory video sequence.

[1]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[2]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  John Chung-Mong Lee,et al.  Video Annotation by Motion Interpretation Using Optical Flow Streams , 1996, J. Vis. Commun. Image Represent..

[4]  Liang Zhang,et al.  Comparison study on feature matching and block matching for automatic 2D to 3D Video Conversion , 2006 .

[5]  Haruhiko Murata,et al.  32.2: A Real-Time 2-D to 3-D Image Conversion Technique Using Computed Image Depth , 1998 .

[6]  Michael G. Strintzis,et al.  Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[8]  Liang Zhang,et al.  3D-TV Content Generation: 2D-to-3D Conversion , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Man-Bae Kim,et al.  Stereoscopic conversion of monoscopic video by the transformation of vertical-to-horizontal disparity , 1998, Electronic Imaging.

[10]  Kazuhide Sugimoto,et al.  Conversion system of monocular image sequence to stereo using motion parallax , 1997, Electronic Imaging.

[11]  Manbae Kim,et al.  Object-Based Stereoscopic Conversion of MPEG-4 Encoded Data , 2004, PCM.

[12]  David C. Burr,et al.  How does binocular delay give information about depth? , 1979, Vision Research.

[13]  J. Ross,et al.  The pulfrich effect and short-term memory in stereopsis , 1975, Vision Research.

[14]  Sebastiano Battiato,et al.  3D stereoscopic image pairs by depth-map generation , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[15]  Kenji Taima,et al.  New television with 2D/3D image conversion technologies , 1996, Electronic Imaging.

[16]  P PentlandAlex,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995 .

[17]  Alex Pentland,et al.  3D structure from 2D motion , 1999, IEEE Signal Process. Mag..

[18]  Li Hong,et al.  Segment-based stereo matching using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[19]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Nikolaos Grammalidis,et al.  Generation of stereoscopic image sequences using structure and rigid motion estimation by extended Kalman filters , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[21]  Karni Wolowelsky,et al.  Automatic video to stereoscopic video conversion , 2005, IS&T/SPIE Electronic Imaging.

[22]  B. J. Garcia,et al.  Approaches to stereoscopic video based on spatiotemporal interpolation , 1996, Electronic Imaging.

[23]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.