A Scalable and Modular Solution for Virtual View Creation in Image-Based Rendering Systems

Image-based rendering systems are designed to render a virtual view of a scene based on a set of images and correspondences between these images. This approach is attractive as it does not require explicit scene reconstruction. In this paper we identify that the level of realism of the virtual view is dependent on the camera set-up and the quality of the image analysis and synthesis processes. We explain how wide-baseline convergent camera set-ups and virtual view independent approaches to surface selection have led to the development of very system specific solutions. We then introduce a unique scalable and modular system solution. This scalable system is configured using building blocks defined as SCABs. These provide design flexibility and improve the image analysis process. Virtual view creation is modular in such that we can add or remove SCABs based on our particular requirements without having to modify the view synthesis algorithm.