Image-Based Rendering using Plane-Sweeping Modelisation

This paper presents a method to create new images of a scene from a small set of calibrated images using color matching. While most of the existing techniques attempt to build a 3d reconstruction of the scene, the only geometric constraint our color matching method requires is camera calibration. This paper describes a new adaptation of the plane-sweeping algorithm using a local dynamic scoring method that handle occlusions. We also propose a real-time implementation of our method using fragment programs. These modifications are well suited for on-line real-time rendering of dynamic scenes.

[1]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[2]  Ruigang Yang,et al.  Real-time consensus-based scene reconstruction using commodity graphics hardware , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[3]  Andrew W. Fitzgibbon,et al.  Image-Based Rendering Using Image-Based Priors , 2005, International Journal of Computer Vision.

[4]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[5]  M SeitzSteven,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1999 .

[6]  Maarten Vergauwen,et al.  AUTOMATIC 3D MODELING FROM IMAGE SEQUENCES , 2000 .

[7]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[8]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[9]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[10]  Andrew W. Fitzgibbon,et al.  Image-Based Rendering Using Image-Based Priors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[12]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[13]  Tal Hassner,et al.  What Does the Scene Look Like from a Scene Point? , 2002, ECCV.