A hybrid pixel-block based view synthesis for multiviewpoint 3D video

View synthesis technique is important for multi-viewpoint 3D video applications. In our technical investigation, we find that some of the current view synthesis methods perform better in boundary areas while some others in non-boundary areas. For example, MPEG VSRS is the most popular view synthesis software, which integrates a series of advanced tools. Recently, Interval-Based Image Synthesis (IBIS) algorithm is proposed, which shows advantage over MPEG VSRS in non-boundary areas but still has some unpleasant artifacts in boundary areas. To take advantage of the merits of the above methods and overcome their shortcomings, we propose a Hybrid Pixel-block Based View Synthesis(HPBVS) method. Experimental results testify that our approach outperforms the state-of-the-art view synthesis methods from both the subjective and objective perspectives.

[1]  Yannick Morvan,et al.  Acquisition, compression and rendering of depth and texture for multi-view video , 2009 .

[2]  Peter H. N. de With,et al.  Free-viewpoint depth image based rendering , 2010, J. Vis. Commun. Image Represent..

[3]  Aljoscha Smolic,et al.  Coding and intermediate view synthesis of multiview video plus depth , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  Dongxiao Li,et al.  Asymmetric bidirectional view synthesis for free viewpoint and three-dimensional video , 2009, IEEE Transactions on Consumer Electronics.

[5]  Marco Grangetto,et al.  A novel interpolation method for 3D view synthesis , 2012, 2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[6]  Aljoscha Smolic,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[7]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[8]  Toshiaki Fujii,et al.  View generation with 3D warping using depth information for FTV , 2009, Signal Process. Image Commun..

[9]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.

[10]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[11]  Jaejoon Lee,et al.  3-D video coding using depth transition data , 2010, 28th Picture Coding Symposium.