Noniterative Adaptive Sampling for Image-Based Rendering

The contradiction between data quantity and rendering quality is a rather troublesome issue in Image-Based Rendering (IBR). In this paper, we present an adaptive sampling method to relieve the contradiction. This method determines the sampling positions by using minimum expectation error criterion of the signal waveform. It is a non-iterative sampling process and could reach a quite good rendering quality with a little date quantity. Also, the method uses each ray in a camera as an independent sample and adjusts them individually. We apply this method to the IBR sampling and reconstruction with a light field setup. The experimental results show that the rendering quality is 3.7~7.8dB higher than that of the traditional method with the same sample size. The PSNR is above 30dB with less than 15% of the original samples. This method can apply to 1-D, 2-D signals and other kinds of IBR technologies.

[1]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[2]  Harry Shum,et al.  On the number of samples needed in light field rendering with constant-depth assumption , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[4]  Aggelos K. Katsaggelos,et al.  Compressive sensing of light fields , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Dani Lischinski,et al.  Automatic camera placement for image-based modeling , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[6]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[7]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[8]  Andrew Chi-Sing Leung,et al.  A compression method for a massive image data set in image-based rendering , 2004, Signal Process. Image Commun..

[9]  Tsuhan Chen,et al.  Nonuniform sampling of image-based rendering data with the position-interval-error (PIE) function , 2003, Visual Communications and Image Processing.