A Hole-Filling Framework Based on DIBR and Improved Criminisi's Inpainting Algorithm for 3D Videos

This study is based on the properties of Depth Image Based Rendering (DIBR), especially on the characteristics of holes caused by disocclusion. In order to recover the texture and the structure in missing areas and to improve the quality of rendered image, some research has been done on the hole-filling process for the virtual view image, starting from Criminisi's inpainting algorithm. The depth information is taken into consideration in the hole-filling framework for 3D videos we proposed. Some pre-processing steps are also added to either enhance the quality of synthesized image in the virtual view or to speed up the processing. Experimental results show that the proposed framework has better performances than the existing method. Both the quality of synthesized image and the processing speed are improved.

[1]  Shinji Miyazaki,et al.  Comparison of the performance of 3D camera systems , 1995 .

[2]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[3]  Béatrice Pesquet-Popescu,et al.  Depth-aided image inpainting for novel view synthesis , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[4]  Ghassan Al-Regib,et al.  Hierarchical Hole-Filling For Depth-Based View Synthesis in FTV and 3D Video , 2012, IEEE Journal of Selected Topics in Signal Processing.

[5]  Wei Zhou,et al.  A Novel High-Order Statistics Map Based Method for Depth Map Generation of Static Scene , 2013, 2013 Seventh International Conference on Image and Graphics.

[6]  C. Fehn.  A 3D-TV system based on video plus depth information , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[7]  Friedhelm Meyer auf der Heide,et al.  The randomized z-buffer algorithm: interactive rendering of highly complex scenes , 2001, SIGGRAPH.

[8]  Manbae Kim,et al.  2D to 3D stereoscopic conversion: depth-map estimation in a 2D single-view image , 2007, SPIE Optical Engineering + Applications.

[9]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[10]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[12]  N Iss.  Region Filling and Object Removal by Exemplar- Based Image Inpainting , 2012 .

[13]  Lai-Man Po,et al.  Depth-aided exemplar-based hole filling for DIBR view synthesis , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).