Region-Aware 3-D Warping for DIBR

In 3-D video (3DV) applications, depth-image-based rendering (DIBR) has been widely employed to synthesize virtual views. However, this approach is performed in a frame-based way, meaning each whole frame is dealt with and the characteristics of different regions in the frame are ignored. As a result, redundant pixels in some regions are abused during the subsequent warping and blending stage. This paper proposes a region-aware 3-D warping approach for DIBR in which warped frames are reasonably divided beforehand so that only the indispensable regions are used. With the proposed scheme, it is possible to avoid noneffective and repeated pixels during the warping stage. In addition, the blending process is also saved. The experimental results show that compared to the state-of-the-art VSRS3.5 and VSRS-1D-fast algorithms, our approach can achieve significant computation savings without sacrificing synthesis quality.

[1]  Fang Wei,et al.  Foreground-Object-Protected Depth Map Smoothing for DIBR , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[2]  Pei-Jun Lee,et al.  Nongeometric Distortion Smoothing Approach for Depth Map Preprocessing , 2011, IEEE Transactions on Multimedia.

[3]  Liang-Gee Chen,et al.  Single iteration view interpolation for multiview video applications , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[4]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.

[5]  Kuan-Hung Chen.  Reducing computation redundancy for high-efficiency view synthesis , 2013, 2013 International Symposium onVLSI Design, Automation, and Test (VLSI-DAT).

[6]  C. Fehn.  A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .

[7]  Zhenzhong Chen,et al.  Depth No-Synthesis-Error Model for View Synthesis in 3-D Video , 2011, IEEE Transactions on Image Processing.

[8]  Kwanghoon Sohn,et al.  Virtual View Rendering System for 3DTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[9]  Wen Gao,et al.  Low Complexity Adaptive View Synthesis Optimization in HEVC Based 3D Video Coding , 2014, IEEE Transactions on Multimedia.

[10]  Dong Tian,et al.  Boundary Artifact Reduction in View Synthesis of 3D Video: From Perspective of Texture-Depth Alignment , 2011, IEEE Transactions on Broadcasting.

[11]  Liang-Gee Chen,et al.  Hybrid motion/depth-oriented inpainting for virtual view synthesis in multiview applications , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[12]  Gavin S. P. Miller,et al.  Hierarchical Z-buffer visibility , 1993, SIGGRAPH.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[15]  Joohee Kim,et al.  Efficient view synthesis for multi-view video plus depth , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Tian-Sheuan Chang,et al.  VLSI Architecture for Real-Time HD1080p View Synthesis Engine , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Toshiaki Fujii,et al.  View generation with 3D warping using depth information for FTV , 2009, Signal Process. Image Commun..

[18]  Thomas Wiegand,et al.  Depth Image-Based Rendering With Advanced Texture Synthesis for 3-D Video , 2010, IEEE Transactions on Multimedia.

[19]  Jianjun Lei,et al.  Depth Sensation Enhancement for Multiple Virtual View Rendering , 2015, IEEE Transactions on Multimedia.

[20]  Manuel Menezes de Oliveira Neto,et al.  Relief texture mapping , 2000, SIGGRAPH.