Advanced interpolation filters for depth image based rendering

Depth image based rendering (DIBR) is a powerful tool for both stereo repurposing in post-production as well as allowing a consumer to influence the stereo impression of stereoscopic content at home. For this the quality of the rendered view should be as good as possible. Up to now most DIBR implementation use a forwards mapping from source to target image and thus introduce artifacts by rounding errors and aliasing. In this paper a two-step rendering method is proposed and evaluated which allows you to use well known interpolation filters for the rendering of virtual camera images. By first forwards mapping the disparity map and in a second step rendering the new image via backwards mapping, aliasing and jagged lines which are specifically visible in fine textured image regions can be reduced significantly by using advanced interpolation filters in the back-wards mapping process.

[1]  C. Fehn.  A 3D-TV system based on video plus depth information , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[2]  Aljoscha Smolic,et al.  Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems , 2008, 2008 15th IEEE International Conference on Image Processing.

[3]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[4]  Peter H. N. de With,et al.  Free-viewpoint depth image based rendering , 2010, J. Vis. Commun. Image Represent..

[5]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[6]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  William R. Mark,et al.  Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping , 1999 .

[8]  Toshiaki Fujii,et al.  View generation with 3D warping using depth information for FTV , 2009, Signal Process. Image Commun..

[9]  Daniel Berjón,et al.  Evaluation of backward mapping DIBR for FVV applications , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[10]  Aljoscha Smolic,et al.  View Synthesis for Advanced 3D Video Systems , 2008, EURASIP J. Image Video Process..

[11]  Aljoscha Smolic,et al.  Reliability-based generation and view synthesis in layered depth video , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[12]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..