View-dependent nonuniform sampling for image-based rendering

In this paper, we propose an algorithm for view-dependent nonuniform sampling for image-based rendering (IBR). Given a set of virtual views, the positions of the capturing cameras are rearranged in order to obtain the optimal rendering quality. The resulting arrangement of the cameras is effectively nonuniform sampling of the plenoptic function. We formulate the above sampling problem as a recursive weighted vector quantization problem, which can be solved efficiently. Experimental results show that the nonuniform sampling scheme renders much better images than traditional uniform sampling methods.

[1]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[2]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[3]  Tsuhan Chen,et al.  Spectral analysis for sampling image-based rendering data , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[5]  Tsuhan Chen,et al.  Nonuniform sampling of image-based rendering data with the position-interval-error (PIE) function , 2003, Visual Communications and Image Processing.

[6]  Tsuhan Chen,et al.  A survey on image-based rendering - representation, sampling and compression , 2004, Signal Process. Image Commun..

[7]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[8]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[9]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.