Depth maps created from blur information using images with focus at near and at far

A method of producing depth maps for depth-image-based rendering (DIBR) of stereoscopic views is proposed and tested. The method is based on depth-from-defocus techniques, utilizing two original images, one with the camera focused at a near point and the other with it focused at a far point in the captured scene to produce depth maps from blur at edge locations. It is assumed that the level of blur at an edge reflects the distance it is from the focused distance. For each image, estimates of the level of blur edges at local regions are obtained by determining the optimal scale for edge detection based on a luminance gradient. An Edge-Depth map is then obtained by evaluating differences in blur for corresponding regions in the two images. This is followed by an additional process in which regions in the Edge-Depth map that have no depth values are filled to produce a Filled-Depth map. A group of viewers assessed the depth quality of a representative set of stereoscopic images that were produced by DIBR using the two types of depth maps. It was found that the stereoscopic images generated with the Filled-Depth and the Edge-Depth maps produced depth quality ratings that were higher than those produced by their monoscopic, two-dimensional counterparts. Images rendered using the Filled-Depth maps, but not the Edge-Depth maps, produced ratings of depth quality that were equal to those produced with factual, full depth maps. A hypothesis as to how the proposed method might be improved is discussed.

[1]  J. Ferreira,et al.  Stereoscopic image rendering based on depth maps created from blur and edge information , 2005, IS&T/SPIE Electronic Imaging.

[2]  Taali Martin,et al.  Smoothing depth maps for improved steroscopic image quality , 2004, SPIE Optics East.

[3]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[4]  Philip Victor Harman,et al.  Low-bandwidth stereoscopic image encoding and transmission , 2003, IS&T/SPIE Electronic Imaging.

[5]  Subhasis Chaudhuri,et al.  Depth From Defocus: A Real Aperture Imaging Approach , 1999, Springer New York.

[6]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[7]  Murali Subbarao,et al.  Focused image recovery from two defocused images recorded with different camera settings , 1995, IEEE Transactions on Image Processing.

[8]  Demin Wang,et al.  Reliability measurement of disparity estimates for intermediate view reconstruction , 2002, Proceedings. International Conference on Image Processing.

[9]  Klaus Hopf,et al.  Key technologies for an advanced 3D TV system , 2004, SPIE Optics East.

[10]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[11]  Ramon M. Rodriguez-Dagnino,et al.  Synthesizing stereo 3D views from focus cues in monoscopic 2D images , 2003, IS&T/SPIE Electronic Imaging.

[12]  Demin Wang,et al.  Stereoscopic image generation based on depth images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[13]  Naoki Asada,et al.  Edge and Depth from Focus , 2004, International Journal of Computer Vision.

[14]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Filippo Speranza,et al.  Depth image based rendering for multiview stereoscopic displays: role of information at object boundaries , 2005, SPIE Optics East.

[16]  Wa James Tam,et al.  Nonuniform smoothing of depth maps before image-based rendering , 2004, SPIE Optics East.