A New Virtual View Rendering Method Based on Depth Image

Virtual view rendering has been considered as a key technique in three-dimensional display. A new virtual view rendering method aimed at flat-panel auto-stereoscopic displays which shifts each pixel in reference image horizontally based on depth image is proposed in this paper. Firstly, the depth image is pre-processed by expanding objects boundaries so as to avoid foreground being split due to the inaccuracy of depth image. The second is to horizontally shift all points in reference image to the desired virtual position based on associated disparity, which is determined by depth image and the limit of screen parallax. Finally, to handle the tradeoff between image quality and algorithm complexity, we fill the small holes with a modified interpolation method while the remaining large disoccluded regions are recovered by a depth-aided inpainting algorithm. Experiments are carried out to show the superiority of the proposed method.

[1]  Zhang Ming,et al.  Depth-image based view synthesis for threedimensional television , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.

[2]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[3]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[4]  Filippo Speranza,et al.  Stereoscopic imaging: filling disoccluded areas in depth image-based rendering , 2006, SPIE Optics East.

[5]  Liang-Gee Chen,et al.  Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  Taali Martin,et al.  Smoothing depth maps for improved steroscopic image quality , 2004, SPIE Optics East.

[7]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual evaluations and requirements of three-dimensional TV , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Ze-Nian Li,et al.  Review and Preview: Disocclusion by Inpainting for Image-Based Rendering , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Kai Luo,et al.  Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering , 2009 .

[10]  C. Fehn A 3D-TV system based on video plus depth information , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[11]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[12]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[13]  R. Sand 3-DTV-a review of recent and current developments , 1992 .