View synthesis for uncalibrated camera

View synthesis technique is essential for FTV (Free viewpoint TV) systems. In this paper, we propose a multi-step view synthesis algorithm to efficiently reconstruct an arbitrary view from limited number of known views of a 3D scene. We describe an efficient image rectification procedure which guarantees that an interpolation process produces valid views. This rectification method can be extended to multi-view images. Since, it transforms only one image. Then, to generate high quality intermediate views, we use an efficient dense disparity estimation algorithm with occlusion handling. Main concept of the algorithm is based on the region dividing bidirectional pixel matching. Estimated disparity vectors are used to synthesize intermediate view of stereo images with occlusion handling. Experimental results show that the performance is superior to other approaches.

[1]  Peter Eisert,et al.  Free viewpoint video extraction, representation, coding, and rendering , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jeffrey S. McVeigh,et al.  Efficient compression of arbitrary multi-view video signals , 1996 .

[5]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[6]  Ebroul Izquierdo Macana Stereo image analysis for multi-viewpoint telepresence applications , 1998, Signal processing. Image communication.

[7]  Kwanghoon Sohn,et al.  3D reconstruction from stereo images for interactions between real and virtual objects , 2005, Signal Process. Image Commun..