Sampling and interpolation of the plenoptic function

In this paper, we present reconstruction schemes for the plenoptic function. Using new sampling methods, we show that, for some particular scenes, it is possible to perfectly reconstruct the plenoptic function from a finite number of cameras with finite resolution (Theorem 1 and Corollary 1). In more general cases, we demonstrate new ways of interpolating exactly the plenoptic function (Theorem 2). Finally, we show that it is possible to infer camera locations from a finite set of images. In all cases, we have perfect solutions due to the super-resolution property of the sampling. First numerical experiments on noisy observations show the potentiality of this new theoretical developments.

[1]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[2]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[3]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[4]  Martin Vetterli,et al.  A sampling theorem for the Radon transform of finite complexity objects , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[6]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.