Removing the cardboard effect in stereoscopic images using smoothed depth maps

Depth maps are important for generating images with new camera viewpoints from a single source image for stereoscopic applications. In this study we examined the usefulness of smoothing depth maps for reducing the cardboard effect that is sometimes observed in stereoscopic images with objects appearing flat like cardboard pieces. Six stereoscopic image pairs, manifesting different degrees of the cardboard effect, were tested. Depth maps for each scene were synthesized from the original left-eye images and then smoothed (low-pass filtered). The smoothed depth maps and the original left-eye images were then used to render new views to create new "processed" stereoscopic image pairs. Subjects were asked to assess the cardboard effect of the original stereoscopic images and the processed stereoscopic images on a continuous quality scale, using the doublestimulus method. In separate sessions, depth quality and visual comfort were also assessed. The results from 16 viewers indicated that the processed stereoscopic image pairs tended to exhibit a reduced cardboard effect, compared to the original stereoscopic image pairs. Although visual comfort was not compromised with the smoothing of the depth maps, depth quality was significantly reduced when compared to the original.

[1]  Wa James Tam,et al.  Nonuniform smoothing of depth maps before image-based rendering , 2004, SPIE Optics East.

[2]  Wa James Tam,et al.  Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views , 1998, Signal Process. Image Commun..

[3]  Demin Wang,et al.  Stereoscopic image generation based on depth images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Filippo Speranza,et al.  Three-dimensional TV: a novel method for generating surrogate depth maps using colour information , 2009, Electronic Imaging.

[5]  Ichiro Yuyama,et al.  A study on the relationship between shooting conditions and cardboard effect of stereoscopic images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[6]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[7]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[8]  Wa James Tam,et al.  Bandwidth reduction for stereoscopic video signals , 2000, Electronic Imaging.

[9]  Makoto Okui,et al.  Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Jeremy R. Cooperstock,et al.  Improving Depth Maps by Nonlinear Diffusion , 2004, WSCG.

[11]  Taali Martin,et al.  Smoothing depth maps for improved steroscopic image quality , 2004, SPIE Optics East.

[12]  Yo-Sung Ho,et al.  Discontinuity-adaptive depth map filtering for 3D view generation , 2009, IMMERSCOM.