Intermediate view synthesis based on edge detecting

Intermediate view synthesis is a key technique for free-viewpoint video applications. Various methods have been proposed in this filed. However, most of those methods are so complex that they can't be realized for realtime. In addition, a perfect depth image is hard to acquire for the mixtures of foreground pixels and background pixels at the object boundary. The errors in depth map would involve many holes in intermediate views when it is synthesized between the left-most view and right-most view based on depth map. How to handle the artifacts around object boundaries in intermediate view is another challenge. In this paper, we propose a simple but effective method to enhance the synthesized intermediate views based on edge detecting(SIVBE). Experiment results on typical test sequences show that the quality of intermediate view can be improved by 1.3 dB and the proposed algorithm achieves a reduction of 50% computational complexity on average.

[1]  Yo-Sung Ho,et al.  Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video , 2009, 2009 Picture Coding Symposium.

[2]  J. Canny A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yo-Sung Ho,et al.  Boundary Filtering on Synthesized Views of 3D Video , 2008, 2008 Second International Conference on Future Generation Communication and Networking Symposia.

[4]  Yannick Morvan,et al.  Acquisition, compression and rendering of depth and texture for multi-view video , 2009 .

[5]  Derek Pang,et al.  Rectification-Based View Interpolation and Extrapolation for Multiview Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Dong Tian,et al.  Boundary Artifact Reduction in View Synthesis of 3D Video: From Perspective of Texture-Depth Alignment , 2011, IEEE Transactions on Broadcasting.

[7]  Masayuki Tanimoto,et al.  Multi-View Imaging and 3DTV (Special Issue Overview and Introduction) , 2007 .

[8]  Aljoscha Smolic,et al.  View Synthesis for Advanced 3D Video Systems , 2008, EURASIP J. Image Video Process..

[9]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.