Suppressing texture-depth misalignment for boundary noise removal in view synthesis

During view synthesis based on depth maps, also known as Depth-Image-Based Rendering (DIBR), annoying artifacts are often generated around foreground objects, yielding the visual effects that slim silhouettes of foreground objects are scattered into the background. The artifacts are referred as the boundary noises. We investigate the cause of boundary noises, and find out that they result from the misalignment between texture and depth information along object boundaries. Accordingly, we propose a novel solution to remove such boundary noises by applying restrictions during forward warping on the pixels within the texture-depth misalignment regions. Experiments show this algorithm can effectively eliminate most boundary noises and it is also robust for view synthesis with compressed depth and texture information.

[1]  Aljoscha Smolic,et al.  View Synthesis for Advanced 3D Video Systems , 2008, EURASIP J. Image Video Process..

[2]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[3]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.

[4]  Yo-Sung Ho,et al.  Boundary Filtering on Synthesized Views of 3D Video , 2008, 2008 Second International Conference on Future Generation Communication and Networking Symposia.

[5]  C. Fehn A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .

[6]  Chun-Hsien Chou,et al.  A perceptually optimized 3-D subband codec for video communication over wireless channels , 1996, IEEE Trans. Circuits Syst. Video Technol..

[7]  Toshiaki Fujii,et al.  Artifact reduction using reliability reasoning for image generation of FTV , 2010, J. Vis. Commun. Image Represent..