Hybrid motion/depth-oriented inpainting for virtual view synthesis in multiview applications

Multiview video can provide users a 3D and virtual reality perception by its multiple viewing angles. To improve the quality of virtual view synthesized frame and remove the disocclusion region, hole filling technique is required. By classifying the different image artifact and applying proper hybrid motion/depth-oriented inpainting algorithm, the image quality will be closer to the real image. In addition, the simulation result and comparison with previous works on inpainting show that both objective evaluation estimates and subjective perceptual vision come to a better result by the system proposed in this paper.

[1]  Masayuki Tanimoto.  Free Viewpoint Television (FTV) , 2007 .

[2]  V. Cantoni,et al.  Vanishing point detection: representation analysis and new approaches , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[3]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[4]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Alessandro Capra,et al.  3D stereoscopic image pairs by depth-map generation , 2004 .

[6]  Yo-Sung Ho,et al.  Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video , 2009, 2009 Picture Coding Symposium.

[7]  Liang-Gee Chen,et al.  Single iteration view interpolation for multiview video applications , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[8]  Liang-Gee Chen,et al.  Depth Map Generation for 2D-to-3D Conversion by Short-Term Motion Assisted Color Segmentation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[9]  Ramon M. Rodriguez-Dagnino,et al.  Synthesizing stereo 3D views from focus cues in monoscopic 2D images , 2003, IS&T/SPIE Electronic Imaging.

[10]  Manbae Kim,et al.  2D to 3D stereoscopic conversion: depth-map estimation in a 2D single-view image , 2007, SPIE Optical Engineering + Applications.

[11]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[12]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.