An efficient image-based rendering method

Given a set of images of the same scene, we propose an efficient method for realistically synthesizing a new image seen from a new viewpoint. Compared with some existing techniques which explicitly reconstruct the 3D geometry of the scene, we directly reconstruct the colour of each pixel in the new image by utilizing a weighted photoconsistency constraint. Global photoconsistency constraint of one pixel is firstly utilized to generate a list of plausible colours for each rendered pixel in the new image. Considering the existing of partial occlusion or the deficiencies in the image-formation model, we iteratively update the colour for each rendered pixel based on local texture statistics similar to the input images. Experimental results on the generation of a new image from a new viewing position from a set of input images show that our proposed method is promising and satisfactory.

[1]  Long Quan,et al.  Image-based rendering by joint view triangulation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Tsuhan Chen,et al.  Spectral analysis for sampling image-based rendering data , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  H. Saito,et al.  Arbitrary viewpoint video synthesis from multiple uncalibrated cameras , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Manuel Menezes de Oliveira Neto Image-Based Modeling and Rendering Techniques: A Survey , 2002, RITA.

[5]  Sanjeev R. Kulkarni,et al.  Efficiently synthesizing virtual video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Takeo Kanade,et al.  Constructing virtual worlds using dense stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Marcus A. Magnor,et al.  Multi-view coding for image-based rendering using 3-D scene geometry , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Roberto Cipolla,et al.  A Statistical Consistency Check for the Space Carving Algorithm , 2000, BMVC.

[9]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[10]  Volkan Atalay,et al.  Silhouette-based 3-D model reconstruction from multiple images , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Samuel Audet,et al.  Image-Based Rendering Using Image-Based Priors , 2006 .