A Novel Hole filling method based on Projection onto Convex Set in DIBR

Depth image based rending (DIBR) is a common technology for syn- thesis virtual viewpoint in 3DTV. The main problem is how to effectively reduce and fill the holes in the virtual viewpoint. In this paper, a novel hole filling method based on projection onto convex set is proposed to solve this problem. To achieve the hole-filling, the proposed method projects the pixels of the observed frame onto the holes position of reference frame by forming the convex set. The experi- mental results show that our method can improve the quality of virtual view im- ages and solve the hole-filling problem efficiently.

[1]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[2]  Hua Li,et al.  Virtual View Generation Method without Pre-processing Depth-Image for 3DTV , 2011, 2011 International Conference on Multimedia and Signal Processing.

[3]  Gavin S. P. Miller,et al.  Hierarchical Z-buffer visibility , 1993, SIGGRAPH.

[4]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[5]  Yu-Cheng Fan,et al.  The Novel Non-Hole-Filling Approach of Depth Image Based Rendering , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[6]  Pei-Jun Lee,et al.  Adaptive edge-oriented depth image smoothing approach for depth image based rendering , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[7]  Liang-Gee Chen,et al.  Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Zhang Zhao-yang,et al.  Arbitrary view generation based on DIBR , 2007, 2007 International Symposium on Intelligent Signal Processing and Communication Systems.

[9]  Hui Chen,et al.  A newly virtual view generation method based on depth image , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[10]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[11]  Demin Wang,et al.  Stereoscopic image generation based on depth images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..