Pseudo-stereo Conversion from 2D Video

In this paper, we propose a fast and effective pseudo-stereo conversion algorithm to transform the conventional 2D videos into their stereo versions. As conventional 2D videos do not normally have sufficient true depth information for stereo conversion, we explore the principle of extracting the closest disparity to reconstruct the stereo frame pair, where a simple content-based approach is followed. The proposed algorithm features in: (i) original 2D video frame is taken as the reference frame; (ii) closest disparity information is extracted by a texture-based matching inside a library of stereo image pairs; and (iii) the extracted disparity is then used to reconstruct the right video frame to complete the pseudo-stereo conversion. Our experiments show that certain level of stereo effect has been achieved, where all test video clips are publicly available on the Internet for the convenience of repetition of our proposed work.

[1]  Zhaoyang Zhang,et al.  Object segmentation using stereo images , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[2]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[3]  Bernard Heit,et al.  Visual depth perception based on optical blur , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[4]  Jin Liu,et al.  Stereo and motion correspondence in a sequence of stereo images , 1993, Signal Process. Image Commun..

[5]  Yi Lu Murphey,et al.  DepthFinder, a real-time depth detection system for aided driving , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[6]  Michael G. Strintzis,et al.  3D object articulation and motion estimation in model-based stereoscopic videoconference image sequence analysis and coding , 1999, Signal Process. Image Commun..

[7]  Georgios Tziritas,et al.  Video Segmentation Using Fast Marching and Region Growing Algorithms , 2002, EURASIP J. Adv. Signal Process..

[8]  Jianmin Jiang,et al.  Image extraction in DCT domain , 2003 .

[9]  Moshe Kam,et al.  Disparity maps for dynamic stereo , 2001, Pattern Recognit..

[10]  Ahmed Tamtaoui,et al.  Constrained disparity and motion estimators for 3DTV image sequence coding , 1991, Signal Process. Image Commun..

[11]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Richard P. Wildes,et al.  Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yi Lu,et al.  Depth detection of targets in a monocular image sequence , 1999, Gateway to the New Millennium. 18th Digital Avionics Systems Conference. Proceedings (Cat. No.99CH37033).

[15]  Michel Jourlin,et al.  A new minimum variance region growing algorithm for image segmentation , 1997, Pattern Recognit. Lett..

[16]  TziritasGeorgios,et al.  Video segmentation using fast marching and region growing algorithms , 2002 .

[17]  Nikolaos Grammalidis,et al.  Stereo image sequence coding based on three-dimensional motion estimation and compensation , 1995, Signal Process. Image Commun..