Stereoscopic image rendering based on depth maps created from blur and edge information

Depth image based rendering (DIBR) is suited for 3D-TV and for autostereoscopic multiview displays. With DIBR, each 2D image captured with a camera at a given position has an associated depth map. This map is used to process the original 2D image so as to generate new images as if they were taken from different camera viewpoints. In the present study we examined the depth and image quality of stereoscopic 3D images that were generated using surrogate depth maps, that is, maps that were created using blur and edge information from the original 2D images. Depth maps were created with three different methods. Formal subjective assessments indicated that the stereoscopic images thus created have enhanced depth quality, with a marginal loss in image quality, when compared to the original non-stereoscopic images. This finding of enhanced depth is surprising because the surrogate depth maps contained limited depth information and mainly at object boundaries. We speculate that the visual system combines the information from pictorial depth cues and from depth interpolation between object boundaries and edges to arrive at an overall perception of depth. The methods for creating the depth maps for stereoscopic imaging that were investigated in this study might be used in applications where depth accuracy is not critical.

[1]  Wa James Tam,et al.  Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views , 1998, Signal Process. Image Commun..

[2]  P J Kellman,et al.  Surface Completion Complements Boundary Interpolation in the Visual Integration of Partly Occluded Objects , 1997, Perception.

[3]  Demin Wang,et al.  Reliability measurement of disparity estimates for intermediate view reconstruction , 2002, Proceedings. International Conference on Image Processing.

[4]  Wa James Tam,et al.  Stereoscopic video: asymmetrical coding with temporal interleaving , 2001, IS&T/SPIE Electronic Imaging.

[5]  Jung-Young Son,et al.  Synthesis of a high-resolution 3D stereoscopic image pair from a high-resolution monoscopic image and a low-resolution depth map , 1998, Electronic Imaging.

[6]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[7]  Dalibor Martisek,et al.  The two-dimensional and three-dimensional processing of images provided by conventional microscopes. , 2006, Scanning.

[8]  Demin Wang,et al.  Stereoscopic image generation based on depth images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[9]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[10]  Naoki Asada,et al.  Edge and Depth from Focus , 2004, International Journal of Computer Vision.

[11]  Wa James Tam,et al.  Bandwidth reduction for stereoscopic video signals , 2000, Electronic Imaging.

[12]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[13]  Steven A. Shafer,et al.  Depth from focusing and defocusing , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  C. Fehn A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .

[15]  Shinya Saida,et al.  Integration of binocular disparity and monocular cues at near threshold level , 2003, Vision Research.

[16]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  A. Parker,et al.  Integration of depth modules: Stereopsis and texture , 1993, Vision Research.

[18]  Filippo Speranza,et al.  Cross-switching in asymmetrical coding for stereoscopic video , 2002, IS&T/SPIE Electronic Imaging.

[19]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[20]  G. J. Mitchison,et al.  Interpolation in stereoscopic matching , 1985, Nature.

[21]  S M Würger,et al.  Depth Interpolation with Sparse Disparity Cues , 1989, Perception.

[22]  Philip Victor Harman,et al.  Low-bandwidth stereoscopic image encoding and transmission , 2003, IS&T/SPIE Electronic Imaging.

[23]  Illah R. Nourbakhsh,et al.  Mobile robot obstacle avoidance via depth from focus , 1997, Robotics Auton. Syst..