Efficient multiple virtual view generation based on reduced depth stereo image for advanced autostereoscopic displays

Recent development of autostereoscopic displays demands the synthesis of more virtual views in wider baseline, an inevitable trend for future 3DTV systems. However, current standard file formats, e.g. multi-view coding (MVC) and image plus depth, encounter challenging problems to meet the request. Therefore, we propose a new file format, called reduced depth stereo image (RDSI), which saves the color and depth images of the left view and the disoccluded regions in the right view. Based on RDSI, rendering virtual images from parallel viewpoints along the baseline can be simplified as view interpolation that is not only very efficient but also consistent in disocclusion regions. Through experiments on both simulated and real data, we demonstrate the superior performance with several quantitative assessments for the adopted file format and the rendering algorithm. The results suggest RDSI as a better choice to meet the demands for the online synthesis of many virtual views in wide baseline for advanced autostereoscopic displays.

[1]  Olga Veksler,et al.  Stereo correspondence by dynamic programming on a tree , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[5]  Shang-Hong Lai,et al.  Improved novel view synthesis from depth image with large baseline , 2008, 2008 19th International Conference on Pattern Recognition.

[6]  Manuel Menezes de Oliveira Neto,et al.  Fast Digital Image Inpainting , 2001, VIIP.

[7]  Aljoscha Smolic,et al.  Scene Representation Technologies for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Paul F. Whelan,et al.  Projective rectification from the fundamental matrix , 2005, Image Vis. Comput..

[9]  Ismo Rakkolainen,et al.  A Survey of 3DTV Displays: Techniques and Technologies , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Luc Van Gool,et al.  ATTEST: Advanced Three-dimensional Television System Technologies , 2002 .

[11]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[12]  Jian Sun,et al.  Symmetric stereo matching for occlusion handling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).